Computational Personalization: Data science methods for - - PowerPoint PPT Presentation

computational personalization data science methods for
SMART_READER_LITE
LIVE PREVIEW

Computational Personalization: Data science methods for - - PowerPoint PPT Presentation

Computational Personalization: Data science methods for personalized health Maurits Kaptein Providing the right treatment to the right patient, at the right dose at the right time Outline: Defining personalized healthcare


slide-1
SLIDE 1

Computational Personalization: Data science methods for personalized health

Maurits Kaptein

slide-2
SLIDE 2

“Providing the right treatment to the right patient, at the right dose at the right time”

slide-3
SLIDE 3

Outline:

◮ Defining personalized healthcare ◮ Analysis of the Randomized Controlled Trial (RCT) ◮ A computational approach to personalization

slide-4
SLIDE 4

Defining personalized healthcare

slide-5
SLIDE 5

{patient, time, treatment, dose} f − → outcome.

slide-6
SLIDE 6
  • utcome

f

← − {patient, time, treatment, dose} r

f

← − {patient, time, treatment, dose} r

f

← − {x, a} r = f (x, a; θ),

The reward, r, is a function of the context, x, (the characteristics of the patient), and the actions, a, (the treatment).

slide-7
SLIDE 7

arg max

a

f (x, a)

slide-8
SLIDE 8

T

  • t=1

arg max

at

f (xt, at),

We choose the treatments such that we maximize the reward over all treatments.

slide-9
SLIDE 9

Weight 20 40 60 80 Dose 0.0 0.2 0.4 0.6 0.8 1.0 S u r v i v a l 0.0 0.2 0.4 0.6

Weight 20 40 60 80 Dose 0.0 0.2 0.4 0.6 0.8 1.0 S u r v i v a l 0.0 0.2 0.4 0.6 0.0 0.2 0.4 0.6 0.8 1.0 0.1 0.2 0.3 0.4 0.5 0.6 Dose Survival Weight = 20 0.0 0.2 0.4 0.6 0.8 1.0 0.1 0.2 0.3 0.4 0.5 0.6 Dose Survival Weight = 60
slide-10
SLIDE 10

Why is this difficult?

slide-11
SLIDE 11

◮ High dimensional learning from noisy data

slide-12
SLIDE 12

◮ High dimensional learning from noisy data ◮ Learning causal relationships

slide-13
SLIDE 13

◮ High dimensional learning from noisy data ◮ Learning causal relationships ◮ Balancing learning and earning

slide-14
SLIDE 14

The Randomized Controlled Trial

slide-15
SLIDE 15

◮ Advantages:

  • 1. Transparent and understandable
  • 2. Causal effects through randomization
  • 3. Practically appealing
slide-16
SLIDE 16

◮ Advantages:

  • 1. Transparent and understandable
  • 2. Causal effects through randomization
  • 3. Practically appealing

◮ Disadvantages:

  • 1. Examines a very small number of options
  • 2. Poor balancing of earning and learning
  • 3. Inability to (re-)use data after trial
slide-17
SLIDE 17

A computational approach

slide-18
SLIDE 18

Disadvantages:

  • 1. Loss of transparency: black-box
slide-19
SLIDE 19

Disadvantages:

  • 1. Loss of transparency: black-box
  • 2. Practical challenges: no deterministic choices
slide-20
SLIDE 20

Disadvantages:

  • 1. Loss of transparency: black-box
  • 2. Practical challenges: no deterministic choices
  • 3. Causal effects not guaranteed: need additional analysis
slide-21
SLIDE 21

Disadvantages:

  • 1. Loss of transparency: black-box
  • 2. Practical challenges: no deterministic choices
  • 3. Causal effects not guaranteed: need additional analysis
  • 4. Computationally challenging
slide-22
SLIDE 22

Why would we want this?

slide-23
SLIDE 23

200 400 600 800 1000 10 20 30 Interactions Regret

Policy RCT Computational Personalization

slide-24
SLIDE 24

2000 4000 6000 8000 10000 200 400 600 800 Interactions Regret

Policy RCT (.754) Computational Personalization (1.0)

slide-25
SLIDE 25

2000 4000 6000 8000 10000 2 4 6 8 10 Interactions Estimator error

Policy RCT Computational Personalization

slide-26
SLIDE 26

Conclusion

slide-27
SLIDE 27