Partial Substitute tong-wang@uiowa.edu Poster #67 A black-box - - PowerPoint PPT Presentation

β–Ά
partial substitute
SMART_READER_LITE
LIVE PREVIEW

Partial Substitute tong-wang@uiowa.edu Poster #67 A black-box - - PowerPoint PPT Presentation

Tong Wang Gaining Free or Low-Cost University of Iowa Transparency with Interpretable Tippie College of Business Partial Substitute tong-wang@uiowa.edu Poster #67 A black-box model + High predictive performance - non-interpretable An


slide-1
SLIDE 1

Gaining Free or Low-Cost Transparency with Interpretable Partial Substitute

Tong Wang University of Iowa Tippie College of Business tong-wang@uiowa.edu

slide-2
SLIDE 2

A black-box model An interpretable model

+ High predictive performance + interpretable

A hybrid of both?

  • non-interpretable
  • lower predictive performance

Poster #67

slide-3
SLIDE 3

A black-box model An interpretable model

+ High predictive performance + interpretable

A hybrid of both?

  • non-interpretable
  • lower predictive performance

A key observation: there might exist a subspace where a black-box is overkill and a simple interpretable model can perform just as well as the black-box Poster #67

slide-4
SLIDE 4

A black-box model An interpretable model

A hybrid of both? A key observation: there might exist a subspace where a black-box is overkill and a simple interpretable model can perform just as well as the black-box The proposed solution: to substitute the black-box model with an interpretable model, where there is no or low- cost of predictive performance

+ High predictive performance + interpretable

An effective trade-off Poster #67

slide-5
SLIDE 5

A black-box model An interpretable model

A hybrid of both? A key observation: there might exist a subspace where a black-box is overkill and a simple interpretable model can perform just as well as the black-box

+

  • Predicted by an

interpretable model Predicted by an interpretable model The proposed solution: to substitute the black-box model with an interpretable model, where there is no or low- cost of predictive performance

+ High predictive performance + interpretable

An effective trade-off Predicted by a black-box model Poster #67

slide-6
SLIDE 6

A A hybrid rid pr predi dict ctive mod

  • del

Define transparency of model: 𝐸𝑗

𝐸

Poster #67

slide-7
SLIDE 7

A A hybrid rid pr predi dict ctive mod

  • del

Define transparency of model: 𝐸𝑗

𝐸

Learning Objective

  • Predictive performance
  • Interpretability of 𝑔

𝑗

  • Transparency

Poster #67

slide-8
SLIDE 8

A A hybrid rid pr predi dict ctive mod

  • del

A Hybrid Rule Set Define transparency of model: 𝐸𝑗

𝐸

Learning Objective

  • Predictive performance
  • Interpretability of 𝑔

𝑗

  • Transparency

Poster #67 Poster #67

slide-9
SLIDE 9

Model Training

Any pre-trained black box classifier

{ො 𝑧𝑐𝑗}𝑗=1

π‘œ

{𝑦𝑗}𝑗=1

π‘œ

training data {(𝑦𝑗, 𝑧𝑗)}𝑗=1

π‘œ

Input of the training algorithm Training algorithm and Stochastic Local Search based algorithm (see the paper for more details)

Predicted labels {ො 𝑧𝑐𝑗}𝑗=1

π‘œ

Poster #67

slide-10
SLIDE 10

Evaluation: An efficient frontier that characterizes the trade-off between transparency and accuracy

Poster #67

slide-11
SLIDE 11

Performance on Juvenile dataset

transparency accuracy Poster #67

slide-12
SLIDE 12

Thank you! Poster #67 in Pacific Ballroom