Vivian Lai, Samuel Carton, Chenhao Tan @vivwylai | @SamHCarton | - - PowerPoint PPT Presentation

▶
vivian lai samuel carton chenhao tan vivwylai samhcarton
SMART_READER_LITE
LIVE PREVIEW

Vivian Lai, Samuel Carton, Chenhao Tan @vivwylai | @SamHCarton | - - PowerPoint PPT Presentation

Apr 09, 2024 326 likes •448 views

Harnessing explanations to bridge AI & humans Vivian Lai, Samuel Carton, Chenhao Tan @vivwylai | @SamHCarton | @ChenhaoTan University of Colorado Boulder CHI2020 Fair & Responsible AI Workshop 1 Ubiquitous Machine

slide-1
SLIDE 1

Harnessing explanations to bridge AI & humans

Vivian Lai, Samuel Carton, Chenhao Tan @vivwylai | @SamHCarton | @ChenhaoTan University of Colorado Boulder CHI2020 Fair & Responsible AI Workshop 1
slide-2
SLIDE 2

Ubiquitous Machine Learning

Medical diagnosis Recidivism prediction Credit score prediction Autonomous driving 2
  • Lin et al. 2011; Geiger et al. 2012; Kleinberg et al. 2017; Ardila et al. 2019
slide-3
SLIDE 3
  • 3

Full automation is not desired

Supreme Court of Wisconsin 2016; Liptak 2017; Lai & Tan 2019
slide-4
SLIDE 4
  • 1. Context
  • 2. Explanations
  • 3. Decision
4
  • Machine-in-the-loop decision making
  • Hu
Human an Kim et al. 2016; Lei et al. 2016; Ribeiro et al. 2016; Lundberg & Lee 2017; Tan 2018; Guidotti et al. 2019 Ou Outcom
  • me
AI AI Challenging tasks
slide-5
SLIDE 5 5 Poursabzi-Sangdeh et al. 2018; Green & Chen 2019; Lage et al. 2019; Lai & Tan 2019; Carton et al. 2020; Lai et al. 2020

Fail to improve performance

< + <

slide-6
SLIDE 6 6 Poursabzi-Sangdeh et al. 2018; Green & Chen 2019; Lage et al. 2019; Lai & Tan 2019; Carton et al. 2020; Lai et al. 2020

Fail to improve performance

< + <

  • AI can discov
  • ver incon
  • nspicuou
  • us and cou
  • unterintuitive patterns
slide-7
SLIDE 7 7

Misalignment between explanations and human mental model

Augment human mental model Towards human- centered explanations
slide-8
SLIDE 8

Augment human mental model

  • Model-driven tutorials
  • Interactive explanations
  • Evaluating generalization
8 Cai et al. 2019; Heer 2019; Lai et al. 2020
slide-9
SLIDE 9

Towards human-centered explanations

  • Understanding human explanations
  • Explanations as model criticism
  • Experimenting with alternative
explanation types Zaidan et al. 2007; Kaushik et al. 2020
  • 9
slide-10
SLIDE 10 workshop: https://tinyurl.com/harness-explanations full paper: https://tinyurl.com/model-driven-tutorials
  • Vivian Lai, Samuel Carton, Chenhao Tan
@vivwylai | vivwylai@gmail.com @SamHCarton | @ChenhaoTan University of Colorado Boulder