Proprietary and confidential. Do not distribute.
Proprietary and Confidential
DMCs – Behind Closed Doors
David Kerr Director of DMC Services Complex Innovative Trial Design Symposium – 06 November 2019
DMCs Behind Closed Doors David Kerr Director of DMC Services - - PowerPoint PPT Presentation
DMCs Behind Closed Doors David Kerr Director of DMC Services Complex Innovative Trial Design Symposium 06 November 2019 Proprietary and Confidential Proprietary and confidential. Do not distribute. DMC 101 (Overview) Proprietary and
Proprietary and confidential. Do not distribute.
Proprietary and Confidential
DMCs – Behind Closed Doors
David Kerr Director of DMC Services Complex Innovative Trial Design Symposium – 06 November 2019
Proprietary and confidential. Do not distribute.
2
Proprietary and confidential. Do not distribute.
3
Proprietary and confidential. Do not distribute.
4
study(ies)
guidelines.
Proprietary and confidential. Do not distribute.
5
“All clinical trials require safety monitoring, but not all trials require monitoring by a (DMC)… We recommend sponsors consider using a DMC when:”
morbidity (or a seriously sick population even if a lesser endpoint used)
termination of study
that is blinded to the Sponsor (double-blind, or firewalled open-label)
randomized open-label studies where the Sponsor has full access
Proprietary and confidential. Do not distribute.
6
Sponsor Statistical Data Analysis Center (SDAC) DMC Randomization Vendor Regulatory Authorities, IRBs
Open, Closed Reports Closed Minutes
Proprietary and confidential. Do not distribute.
7
Proprietary and confidential. Do not distribute.
8
Organizational Meeting ▪ Review pre-clinical and clinical studies ▪ Review near-final protocol and eCRFs and IB and ICF and SAP ▪ Review near-final DMC Charter (and iSAP or DMC SAP) ▪ Review report ToC and/or mock tables
Proprietary and confidential. Do not distribute.
9
Safety looks ▪ Review safety data (and non-inferential efficacy data???) and recommend whether study is ethical to continue in face of risk/benefit evaluation Formal interim evaluations ▪ Use pre-specified monitoring guidelines to assess efficacy data ▪ Discuss in advance:
combinations of efficacy/futility at different formal interim evaluations)
Proprietary and confidential. Do not distribute.
10
and SDAC and possibly Steering Committee, PI, other vendors)
Proprietary and confidential. Do not distribute.
reasons and proposed solutions)
important prognostic factors – are these the expected patients?
11
Proprietary and confidential. Do not distribute.
All outputs split by treatment -
12
Proprietary and confidential. Do not distribute.
13
DMCs must (should? may?) periodically review the accumulating unmasked safety and efficacy data by treatment group, and advise the trial sponsor on whether to continue, modify, or terminate a trial based on benefit-risk assessment, as specified in the DMC Charter, protocol, and/or statistical analysis plan.
represents how patient feels, functions, survives – rather than if efficacy is a biomarker)
disease progression instead of central review)
showing a promising pattern in efficacy to offset a safety concern
immediate demand
Proprietary and confidential. Do not distribute.
14
Proprietary and confidential. Do not distribute.
15
Proprietary and confidential. Do not distribute.
1. Get all members to the meeting, or at least establish quorum 2. Check for and discuss potential conflicts of interest 3. Review minutes and action items from previous meeting(s) 4. Review and discuss the tables, listings, and figures (TLFs) in the Closed report 5. Discuss and answer any outstanding questions from the Open session 6. Enumerate action items for the Sponsor and the SDAC (including when to meet next) 7. Make a formal recommendation (continue or not)
16
Proprietary and confidential. Do not distribute.
▪ The Chair leads the DMC through the TLFs or ▪ The Chair defers to the independent statistician to lead the DMC through the TLFs or ▪ The Chair solicits items of focus from the DMC, shares her
17
Proprietary and confidential. Do not distribute.
▪ Items of interest or concern are noted, discussed, and documented ▪ Action items are identified and timeline for resolution are agreed upon
▪ Equipoise still maintained?
18
Proprietary and confidential. Do not distribute.
▪ Recommendation to continue the study without modification to the protocol ▪ Recommendation to continue the study with modification to the protocol (e.g. change eligibility criteria) or other change (e.g. halt enrollment or dosing) ▪ Recommendation withheld pending receipt of additional information ▪ Recommendation to stop the study for safety (or for futility and/or efficacy – if formally part of DMC job)
19
Proprietary and confidential. Do not distribute.
▪ There may be a safety signal but the numbers are too small to be certain ▪ There may be a safety signal but the DMC is missing it completely ▪ The DMC wants to alert the sponsor to a potential concern but the risk of unmasking or damaging trial integrity is too great ▪ The study looks futile (but safe), but there is no official futility boundary - a waste of patient and sponsor time and resource?
20
Proprietary and confidential. Do not distribute.
▪ Most studies run to completion
defined in protocol
21
Proprietary and confidential. Do not distribute.
▪ Study is limping along – much lower enrollment than expected and/or few events (in an event-driven trial). Should the DMC recommend a major change? ▪ Study has large number of withdrawal of consent or lost- to-follow-up (perhaps imbalanced by arm). Should the DMC recommend a major change? ▪ Study has large numbers that are enrolled that failed eligibility criteria and there are excessive number of protocol violations. Should the DMC recommend a major change?
22
Proprietary and confidential. Do not distribute.
▪ The hardest decision of the DMC – why there are experts and not just a computer ▪ A naïve p-value < 0.05 on a single safety event (other than death) is not typically sufficient in and of itself to recommend stopping for safety ▪ 2 vs. 0 on PML or Hy’s Law cases might be enough ▪ 60 vs. 20 on neutropenia or pruritus (across all severity) might not be enough
23
Proprietary and confidential. Do not distribute.
▪ Is the signal robust? Consistent across dimensions (AEs and lab results correlate)? ▪ Can we combine similar AEs for more informative analysis (e.g. combine ‘LDL increased’, ‘Lipids increased’, ‘Hyperlipidaemia’, ‘VLDL increased’)? ▪ Is the signal known from preclinical results or as a class effect? Or is the signal novel – and therefore needs to be more compelling in order to be believed? ▪ Is the signal clinically relevant to the patient? ▪ Is the imbalance increasing from meeting to meeting? ▪ Is the safety concern offset by trends for positive efficacy?
24
Proprietary and confidential. Do not distribute.
▪ Are there baseline imbalances that have caused the active arm to be more prone to having these events? ▪ Is there an imbalance on average follow-up which means that safety is biased towards reporting more events on the active arm? ▪ Does the nature of the visit schedule of the (open-label) study have more assessments on the active arm so more chance to have spontaneous events captured? ▪ If program-wide DMC with the same DMC, do the other studies show a similar trend or not? ▪ If there is a different DMC reviewing a similar study, can a communication pathway be established so that the DMC Chairs can discuss whether studies show similar trends?
25
Proprietary and confidential. Do not distribute.
▪ Review efficacy data to see if it counterbalances safety ▪ Reinforce site training to be vigilant of specific safety issue ▪ More frequent DMC reviews ▪ Add different DMC analyses to confirm results are consistent across various dimensions ▪ Mitigation strategies that could be employed before or after the event is seen (tighten eligibility criteria to remove those at higher likelihood of event or enforce dose adjustment strategies if precursor event is seen)? ▪ Halt enrollment, keep treatment going ▪ Halt enrollment and treatment, but keep follow-up going
26
Proprietary and confidential. Do not distribute.
▪ Can be stopped for overwhelming superiority ▪ Can be stopped for statistical futility (not necessarily harm) ▪ Boundaries are prospectively put into place ▪ Greater use of boundaries is encouraged, but for variety of reasons are currently underemployed ▪ These are guidelines, not ‘rules’ ▪ Assess entire context of the data provided ▪ Use only adjudicated events, or supplement with local assessment (for endpoints with adjudication)? ▪ Force cut-off of events at protocol-specified number, or allow for slightly more or less (and accordingly update monitoring boundaries)?
27
Proprietary and confidential. Do not distribute.
28
assess overwhelming superiority and/or statistical futility No difference Trend for harm Trend for benefit
Proprietary and confidential. Do not distribute.
29
benefit with data that is more mature
those still alive without progression), stratified, with hazard ratio < 1 indicating reduction in hazard in favor of experimental arm, overall alpha is 1-sided 0.025
Look Events % Info Futility if HR Futility if 1- sided p-value Benefit if HR Benefit if 1- sided p-value IA #1 300 50% HR>1.00 P>0.50 IA #2 450 75% HR>0.90 P>0.20 HR<0.80 P<0.010 Final 600 100% HR<0.85 P<0.022
Proprietary and confidential. Do not distribute.
▪ Expect a lot of ad hoc discussion (especially if stop for safety) ▪ DMC may be asked to run subgroup/sensitivity analyses
Sponsor ▪ Small or inexperienced Sponsor in particular may be desperate to find some hope rather than stopping for futility or safety
30
Proprietary and confidential. Do not distribute.
31
Proprietary and confidential. Do not distribute.
normal and finish as expected at the end
relatively minor requests for changes in TLFs, or simple recommendations such as re-emphasizing some aspect of the protocol to sites or advocating for data that is cleaner and/or more current
Proprietary and confidential. Do not distribute.
33
Proprietary and confidential. Do not distribute.
patients who were contra-indicated from the drug(!!!)
(25%, 50%, 75%)
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
event data
stop study within a year or so after 1000 events seen – one-half the
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
participants (enrollment completed and the large majority already off treatment)
enough (yet) for outside parties and the millions taking the treatment
quite similar between arms
then
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
cleaning, plus additional time for internal report generation
about this imbalance in a timely way and not wait another half-year for the results be publicly reported
Proprietary and confidential. Do not distribute.
47
Proprietary and confidential. Do not distribute.
combined treatment (Investigational product A + on-market drug B) vs. A alone vs. SOC, in oncology setting
every meeting
Proprietary and confidential. Do not distribute.
more than 1.5 times higher in the combined A+B arm vs. SOC
combined A+B arm vs. SOC in a specified sub-population of interest (>80% of total population)
Proprietary and confidential. Do not distribute.
review and a similar pattern was observed again
Proprietary and confidential. Do not distribute.
A+B over SOC A over SOC
Blue: A+B Red: SOC Green: A
A+B SOC A
Proprietary and confidential. Do not distribute.
to safety concern of early death risk
Proprietary and confidential. Do not distribute.
closed session
stopped the enrollment into the combined A+B arm
minutes to various regulatory agencies using a carefully laid out process
Proprietary and confidential. Do not distribute.
54
Proprietary and confidential. Do not distribute.
treatment vs. placebo, for 1-year time to CV death for patients hospitalized with WHF
statistically significant positive results on primary endpoint of 1-month rehospitalization and suggested benefit in 1-year time to CV death
Proprietary and confidential. Do not distribute.
provided at every meeting (but not CV death)
HR<0.745
Proprietary and confidential. Do not distribute.
placebo using safety population
central adjudication committee assessments, and concordance table between them
Proprietary and confidential. Do not distribute.
placebo using ITT population
(both investigator and CEC)
Proprietary and confidential. Do not distribute.
placebo using ITT population, and CV deaths show similar pattern (both investigator and CEC)
Proprietary and confidential. Do not distribute.
placebo using ITT population, and CV deaths show similar pattern (both investigator and CEC)
Proprietary and confidential. Do not distribute.
CV mortality, however that is not a pre-specified action for the DMC to consider. The formal statistical boundary for declaring benefit has clearly not been crossed. There are no safety concerns compelling enough to recommend any change in study conduct and there is still valuable information being collected by the study. Therefore the DMC agreed unanimously to continue the study and to meet again in approximately six months by teleconference.”
Proprietary and confidential. Do not distribute.
placebo using ITT population, and CV deaths show similar pattern (both investigator and CEC)
Proprietary and confidential. Do not distribute.
for statistical futility, as continuing the trial could potentially create ethical concerns by continuing the study and subjecting newly enrolled patients to treatment where the primary endpoint is unlikely to demonstrate superiority. However, the DMC noted that the DMC Charter only specifies the ability to recommend stopping the trial for certain efficacy or for safety
Proprietary and confidential. Do not distribute.
safety risk to the participants, it was not in their charge to recommend discontinuing. Additionally, a minority view was that valuable information may potentially still emerge through continuing the trial. For these two reasons, the DMC agreed unanimously to recommend continuing the study.”
Proprietary and confidential. Do not distribute.
Proprietary and confidential. Do not distribute.
66
Proprietary and confidential. Do not distribute.
risk patients with Type 2 Diabetes
diabetes outcomes
Proprietary and confidential. Do not distribute.
provided at every meeting (but not efficacy data)
– 1/3 of events – p<0.0005 – 2/3 of events – p<0.005
Proprietary and confidential. Do not distribute.
although DMC maintained masking of “A” vs. “B”
composite endpoint is dominated to some particular (less clinically relevant) component
Proprietary and confidential. Do not distribute.
hyperkalemia, hypotension), with excess on “A”, although DMC maintained masking of “A” vs. “B”
wants to see by arm but nervous if that would count as a “formal look” – will consult sponsor
endpoint by arm, but not the composite itself
Proprietary and confidential. Do not distribute.
pulmonary edema, diarrhea, hyperkalemia, hypotension, dizziness), with excess on “A”
particular concern
Proprietary and confidential. Do not distribute.
events of pulmonary edema, falls, gastroenteritis, chronic renal failure, Vtach/Vfib), with excess on “Active”
efficacy
randomization in advance to ensure outputs will be suitable for DMC needs
Proprietary and confidential. Do not distribute.
“Active” vs. 276 “Placebo” – efficacy boundary obviously not crossed
hyperkalemia and renal failure), with excess on “Active”
renal failure
Proprietary and confidential. Do not distribute.
in the DMC Charter, the DMC can still contemplate the issue. However with a full two-thirds of events left to accrue, it still appears there is a chance for a statistically successful trial if these next two-thirds of events occur with the expected level
Proprietary and confidential. Do not distribute.
hyperkalemia and renal failure), with excess on “Active”
420 vs. 397
serious renal events and serious hyperkalemia – recommendation to continue based on that review
Proprietary and confidential. Do not distribute.
“Active” vs. 542 “Placebo” – boundary for efficacy obviously not crossed – strong trend in harmful direction
hyperkalemia and serious renal failure), with excess on “Active”
Proprietary and confidential. Do not distribute.
in the DMC Charter. Looking at the primary endpoint results is relevant, though, to ensure that safety risks are not counter- balanced by positive efficacy. The DMC Statistician confirmed there was a very low probability that results in the final ~1/3 of the endpoints would cause results to be able to demonstrate
to the end to get additional safety data which could be useful to the current patient population taking study drug and additional proof, potentially, of harm. …”
Proprietary and confidential. Do not distribute.
protection of the patients in the study and the obligation was to recommend termination due to safety concerns, in the context of lack of efficacy. There are still many patients in the study that are being treated and would be at increased risk
The DMC unanimously agreed to recommend early termination of the study. Study participants should discontinue study drug in an orderly fashion, although the study could continue to accrue endpoints to the normal end of the study if desired by the sponsor. ”
Proprietary and confidential. Do not distribute.
numeric imbalances seen, were written up during the meeting.
Executive Committee co-chairs, who were available for in- person discussion.
in senior sponsor leadership for a full discussion where the DMC report was discussed in detail.
recommendation for early termination
Proprietary and confidential. Do not distribute.
80