Prognostic and Predictive Markers: Whats the difference? & Why - - PowerPoint PPT Presentation

prognostic and predictive markers
SMART_READER_LITE
LIVE PREVIEW

Prognostic and Predictive Markers: Whats the difference? & Why - - PowerPoint PPT Presentation

CANSSI Biomarker and Drug Co-Development Workshop Prognostic and Predictive Markers: Whats the difference? & Why should I care? Susan G. Hilsenbeck, PhD Division of Biostatistics Smith Breast Center and Duncan Cancer Center Baylor


slide-1
SLIDE 1

CANSSI Biomarker and Drug Co-Development Workshop

Prognostic and Predictive Markers:

What’s the difference? & Why should I care? Susan G. Hilsenbeck, PhD Division of Biostatistics

Smith Breast Center and Duncan Cancer Center Baylor College of Medicine Houston, TX

slide-2
SLIDE 2

Definition

A biomarker is a characteristic that is objectively measured as an indicator of:

– Normal biological processes, – Pathogenic processes OR – Pharmacological response to a therapeutic intervention.

Biomarkers Definitions Working Group (2001) Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin Pharmacol Ther;69:89– 95.

slide-3
SLIDE 3

US FDA

  • A VALID biomarker:

– Is measured in an analytical test system with well established performance characteristics – Has a scientific framework or body of evidence as to physiologic, toxicologic, pharmacologic, or clinical significance

  • f the test results

– Is “Fit to purpose”, which is context specific

  • Clinically useful biomarkers:

– Address a specific setting – Are clinically actionable – Reliably estimate effect

http://www.fda.gov/cder/guidance/6400fnl.pdf http://www.fda.gov/Drugs/ScienceResearch/ResearchAreas/Pharmacogenetics/ucm083378.htm Henry, N. L. and D. F. Hayes (2006). "Uses and abuses of tumor markers in the diagnosis, monitoring, and treatment of primary and metastatic breast cancer." Oncologist 11(6): 541-52.

slide-4
SLIDE 4

US FDA

  • A VALID biomarker:

– Is measured in an analytical test system with well established performance characteristics – Has a scientific framework or body of evidence as to physiologic, toxicologic, pharmacologic, or clinical significance

  • f the test results

– Is “Fit to purpose”, which is context specific

  • Clinically useful biomarkers:

– Address a specific setting – Are clinically actionable – Reliably estimate effect

http://www.fda.gov/cder/guidance/6400fnl.pdf http://www.fda.gov/Drugs/ScienceResearch/ResearchAreas/Pharmacogenetics/ucm083378.htm Henry, N. L. and D. F. Hayes (2006). "Uses and abuses of tumor markers in the diagnosis, monitoring, and treatment of primary and metastatic breast cancer." Oncologist 11(6): 541-52.

slide-5
SLIDE 5

US FDA

  • A VALID biomarker:

– Is measured in an analytical test system with well established performance characteristics – Has a scientific framework or body of evidence as to physiologic, toxicologic, pharmacologic, or clinical significance

  • f the test results

– Is “Fit to purpose”, which is context specific

  • Clinically useful biomarkers:

– Address a specific setting – Are clinically actionable – Reliably estimate effect

http://www.fda.gov/cder/guidance/6400fnl.pdf http://www.fda.gov/Drugs/ScienceResearch/ResearchAreas/Pharmacogenetics/ucm083378.htm Henry, N. L. and D. F. Hayes (2006). "Uses and abuses of tumor markers in the diagnosis, monitoring, and treatment of primary and metastatic breast cancer." Oncologist 11(6): 541-52.

slide-6
SLIDE 6

“What is the Purpose?”

  • Risk or susceptibility?

MSI, Fam Hx, BRCA1

  • Diagnosis?

PSA?

  • Prognosis?

Stage, OncotypeDX?

  • Predictive of tx benefit?

ER+,Her2+,KRAS-,BRAF, ALK

  • PD/Dose adjustment?

CYP2D’s, UGT1A1

  • Disease progression?

CA125?, CTC?

  • Surrogate endpoint?

Response?

  • Early readout?

Fdg-PET?

6

Some of these pre-date current rules and are “Known” to be valid biomarkers by virtue of long experience supporting their use.

slide-7
SLIDE 7

If you had this biomarker, how would you use it clinically?

Relapse

Importance of Purpose of Biomarker

Ex: Prognostic vs Predictive

7

Disease Free Everyone got SRG & Systemic Adj. Tx Blue/Green Biomarker

Perfectly Predicts Long-term Outcome

slide-8
SLIDE 8

If you had this biomarker, how would you use it clinically?

Relapse

Importance of Purpose of Biomarker

Ex: Prognostic vs Predictive

8

Disease Free Everyone got SRG & Systemic Adj. Tx Blue/Green Biomarker

Perfectly Predicts Long-term Outcome

Drop adj tx? Switch adj tx?

slide-9
SLIDE 9

Cured by SRG Not Cured by SRG Adj Tx Sensitive Adj Tx Resistant If you had this biomarker, how would you use it clinically?

Treatment Confuses the Issue

9

slide-10
SLIDE 10

Cured by SRG Not Cured by SRG Adj Tx Sensitive Adj Tx Resistant If you had this biomarker, how would you use it clinically?

Don’t need treatment

Treatment Confuses the Issue

10

slide-11
SLIDE 11

Cured by SRG Not Cured by SRG Adj Tx Sensitive Adj Tx Resistant If you had this biomarker, how would you use it clinically?

Don’t need treatment May need tx but tx works

Treatment Confuses the Issue

11

slide-12
SLIDE 12

Cured by SRG Not Cured by SRG Adj Tx Sensitive Adj Tx Resistant

Is tx better than no tx? Or will other tx be better?

If you had this biomarker, how would you use it clinically?

Don’t need treatment May need tx but tx works

Treatment Confuses the Issue

12

slide-13
SLIDE 13

Are these studies helpful?

13

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free Tx, M+

slide-14
SLIDE 14

Are these studies helpful?

14

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free Tx, M+ Tx, M-

slide-15
SLIDE 15

Are these studies helpful?

15

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free Tx, M+ Tx, M- Ex: retrospective study of biomarker in resected, tamoxifen treated cases Might be prognostic, need control.

slide-16
SLIDE 16

Are these studies helpful?

16

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free Tx, M+ Tx, M- Ex: retrospective study of biomarker in resected, tamoxifen treated cases Might be prognostic, need control. 5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Tx,M+ noTx, M+ Ex: prospective study of GFR inhibitor vs placebo in GFR+ cases only Might miss effect in GFR-

slide-17
SLIDE 17

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free

Extreme Possibilities

17

noTx/M+ Tx/M+

slide-18
SLIDE 18

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free Prognostic, but NOT Predictive Treatment Benefits Everyone Equally

Extreme Possibilities

18

noTx/M+ Tx/M+ Tx/M- noTx/M-

slide-19
SLIDE 19

5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Proportion Relapse Free Prognostic, but NOT Predictive Treatment Benefits Everyone Equally 5 10 15 20 0.0 0.2 0.4 0.6 0.8 1.0 Months Predictive, but NOT Prognostic Treatment Benefits only Marker +

Extreme Possibilities

19

noTx/M+ Tx/M+ Tx/M- noTx/M-

slide-20
SLIDE 20

Prognostic vs Predictive Biomarkers

  • Prognostic marker – natural history of disease,

independent of treatment

– Might indicate need for further treatment, but not WHICH treatment

  • Predictive marker – benefit from specific

treatment; helps to select particular treatment over another

  • How good does the marker have to be?

– What is “actionable”?

20

slide-21
SLIDE 21

Ideal Prognostic Biomarker

8 7 6 5 4 3 2 1 0.0 0.2 0.4 0.6 0.8 1.0

Years

Good Bad Proportion DFS

slide-22
SLIDE 22

Good Bad

“Actionable” Prognostic Biomarker?

Statistical vs Clinical Significance

8 7 6 5 4 3 2 1 0.0 0.2 0.4 0.6 0.8 1.0

Years Proportion DFS

slide-23
SLIDE 23

Good Bad

“Actionable” Prognostic Biomarker?

Statistical vs Clinical Significance

8 7 6 5 4 3 2 1 0.0 0.2 0.4 0.6 0.8 1.0

Years Proportion DFS

slide-24
SLIDE 24

How often have you seen this?

  • Pros:

– Cheap and easy – Many tools available to wet lab investigators – Can provide clues for further study

  • Cons:

– Many tools available to wet lab investigators – Statistically significant, BUT is it clinically significant? – Same “flawed” datasets have been re-analyzed 100’s of times – Important sources of confounding

  • ften totally ignored
  • Batch effects in assay
  • Differences in selection or clinical

characteristics (i.e. stage, subtype)

  • Mixtures of treatments, etc

“We analyzed publically available breast cancer data to evaluate the effect of MAP3K3 on outcome. MAP3K3 is an important new prognostic biomarker.”

http://co.bmc.lu.se/gobo/gsa.pl

slide-25
SLIDE 25

How often have you seen this?

Analysis of Publically Available Data: MAP3K3

http://co.bmc.lu.se/gobo/gsa.pl

slide-26
SLIDE 26

How often have you seen this?

Analysis of Publically Available Data: MAP3K3

http://co.bmc.lu.se/gobo/gsa.pl

slide-27
SLIDE 27

Is this really prognostic?

GSE7390(Desmedt) – Node negative breast cancers, no adj tx, dates unknown, ER assay unknown, salvage therapy unknown GSE3494(Miller) – All breast cancers, operated 1987-1989, adj tx?, Sweden, ER by biochem assay, salvage therapy unknown

http://co.bmc.lu.se/gobo/gsa.pl

slide-28
SLIDE 28

Is this really prognostic?

GSE7390(Desmedt) – Node negative breast cancers, no adj tx, dates unknown, ER assay unknown, salvage therapy unknown GSE3494(Miller) – All breast cancers, operated 1987-1989, adj tx?, Sweden, ER by biochem assay, salvage therapy unknown

http://co.bmc.lu.se/gobo/gsa.pl

slide-29
SLIDE 29

29

0.0 0.2 0.4 0.6 0.8 1.0

Score

Probability of Benefit Ideal

100

“Actionable” Predictive Biomarker?

Clinical vs Statistical Significance

slide-30
SLIDE 30

30

0.0 0.2 0.4 0.6 0.8 1.0

Score

Probability of Benefit Ideal Clinically useful ( ex. ER)

100

“Actionable” Predictive Biomarker?

Clinical vs Statistical Significance

slide-31
SLIDE 31

31

0.0 0.2 0.4 0.6 0.8 1.0

Score

Probability of Benefit Ideal Clinically useful ( ex. ER) Not useful ( ex. proliferation)

100

“Actionable” Predictive Biomarker?

Clinical vs Statistical Significance

slide-32
SLIDE 32

A Few of the Many Questions to Ask …

  • What is the role of biomarker in trial?
  • Is there an assay? (discussion for lab)
  • Should we take all comers or select?
  • What is the appropriate endpoint?
  • What is the appropriate design? (more on

this in other talks)

slide-33
SLIDE 33

Phases of Drug Development

Preclinic • Laboratory/animal models; Mechanism and target?

Phase 1

  • Determine dose; Preliminary toxicity; Biomarker?
  • N in low 10’s

Phase 2

  • Evidence of efficacy; Further experience with toxicity; Biomarker?
  • N in high 10’s to 100’s

Phase 3

  • Definitive evidence of efficacy; Toxicity; Validation of biomarker
  • N in 100’s to 1000’s

Phase 4

  • Post-marketing surveillance

Additional issues for co-development with biomarker:

Decide to select or not to select? Show reliability of assay prior to, or with early clinical trials

slide-34
SLIDE 34

Role of Marker in a Study

  • Integral – assessed in order for study to proceed

(i.e. eligibility or stratification); CLIA in USA

  • Integrated – intended to validate assays and

biomarker; trials test hypotheses with prespecified plans

  • Ancillary or exploratory – trial data used to develop

biomarker or assays, understand agent or biology

34

Dancey, J. E., K. K. Dobbin, et al. (2010). "Guidelines for the development and incorporation of biomarker studies in early clinical trials of novel agents." Clin Cancer Res 16(6): 1745-55.

slide-35
SLIDE 35

100% 75% 50% 25% Percent Marker Positive N if Unselected/N if Selected 5 10 15 0.0 Only works in M+ 0.5 1.0 Works same in all Effect in Marker - Relative to Marker+

After Simon and Maitournam. CCR 2004

To Select or Not To Select

35

Relative Efficiency of Unselected vs Selected Designs Depends on:

  • Performance of Assay
  • Distribution of Effect
  • Prevalence of Marker
slide-36
SLIDE 36

100% 75% 50% 25% Percent Marker Positive N if Unselected/N if Selected 5 10 15 0.0 Only works in M+ 0.5 1.0 Works same in all Effect in Marker - Relative to Marker+

After Simon and Maitournam. CCR 2004

To Select or Not To Select

36

N to screen in selected design Relative Efficiency of Unselected vs Selected Designs Depends on:

  • Performance of Assay
  • Distribution of Effect
  • Prevalence of Marker
slide-37
SLIDE 37

100% 75% 50% 25% Percent Marker Positive N if Unselected/N if Selected 5 10 15 0.0 Only works in M+ 0.5 1.0 Works same in all Effect in Marker - Relative to Marker+

After Simon and Maitournam. CCR 2004

To Select or Not To Select

37

N to screen in selected design Relative Efficiency of Unselected vs Selected Designs Depends on:

  • Performance of Assay
  • Distribution of Effect
  • Prevalence of Marker
slide-38
SLIDE 38

100% 75% 50% 25% Percent Marker Positive N if Unselected/N if Selected 5 10 15 0.0 Only works in M+ 0.5 1.0 Works same in all Effect in Marker - Relative to Marker+ Ex: ER/endo tx Ex: Her2/trastuzumab

After Simon and Maitournam. CCR 2004

To Select or Not To Select

38

N to screen in selected design Relative Efficiency of Unselected vs Selected Designs Depends on:

  • Performance of Assay
  • Distribution of Effect
  • Prevalence of Marker
slide-39
SLIDE 39

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met Dth

slide-40
SLIDE 40

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met

Neoadj Adjuvant 1st Line 2nd Line…

Dth

slide-41
SLIDE 41

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met

Neoadj Adjuvant 1st Line 2nd Line…

Early dev trials Mid-dev trials Late trials

Dth

slide-42
SLIDE 42

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met

Neoadj Adjuvant 1st Line 2nd Line…

Early dev trials Mid-dev trials Late trials

Dth

Tissue?

Baseline Biomarker Molecular

slide-43
SLIDE 43

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met

Neoadj Adjuvant 1st Line 2nd Line…

Early dev trials Mid-dev trials Late trials

Dth

Tissue?

Δ in Biomarker Baseline Biomarker Molecular

slide-44
SLIDE 44

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met

Neoadj Adjuvant 1st Line 2nd Line… Response X X … DFS X TTR X PFS X … OS X X …

Early dev trials Mid-dev trials Late trials

Dth

Tissue?

Δ in Biomarker Baseline Biomarker Molecular

slide-45
SLIDE 45

What is an Appropriate Endpoint (Cancer)?

Dx Srg Dth Met Met

Neoadj Adjuvant 1st Line 2nd Line… Response X X … DFS X TTR X PFS X … OS X X …

Early dev trials Mid-dev trials Late trials

Dth

Driven by PROGNOSTIC & PREDICTIVE effects

Tissue?

Δ in Biomarker Baseline Biomarker Molecular Driven by PREDICTIVE effects

slide-46
SLIDE 46

Prognostic and Predictive Markers

  • What’s the difference?

– Prognostic markers relate to natural history of the disease – Predictive (treatment guiding) markers relate to benefit from a specific therapy

  • Why should I care?

– It is easy to be confused – It makes a difference in designing studies and determining how a biomarker should be used

46

slide-47
SLIDE 47

Discussion?