SLIDE 1 Preprints: What, Why and How
Harlan M. Krumholz, MD Yale School of Medicine @hmkyale
SLIDE 2
Disclosure PCORI Board; United HealthCare and Aetna Advisory Committees; Grant from JNJ to distribute clinical trial data; grant from Medtronic, in collaboration with FDA, to improve device surveillance; contracts with CMS to develop performance measures; contract with Blue Cross for technology assessment; AHRQ and NIH grants; Founder, Hugo personal health information platform.
SLIDE 3 https://www.youtube.com/watch?v=2zMgY8Dx9co
Preprints
SLIDE 4
Preprints
SLIDE 5 Not everyone is a fan…
JAMA September 26, 2017 Volume 318, 1109-10
SLIDE 6 JAMA Vol 318, 1109-10
SLIDE 7 JAMA September 26, 2017 Volume 318, 1109-10
SLIDE 8 JAMA September 26, 2017 Volume 318, 1109-10
SLIDE 9
Dual Nature of Medical Journals
SLIDE 10
SLIDE 11 Please try to keep an open mind
@emmyzen
SLIDE 12
What problem are we trying to solve? How do we easily and rapidly archive and share information with other scientists to accelerate research, enhance collaboration, reduce waste, increase transparency?
SLIDE 13 https://www.youtube.com/watch?v=2zMgY8Dx9co
SLIDE 14
Preprint Servers Complementary to, and not a replacement for, peer review journals.
SLIDE 15
Science for Scientists
SLIDE 16
DOI (Digital Object Identifier)
DOI is unique alphanumeric string assigned by registration agency (International DOI Foundation) to identify content and provide a persistent link to its location on the Internet.
SLIDE 17
Pre-peer review results already released…
Major journals already allow pre-peer review release of information.
SLIDE 18
For example…
Medical meetings Clinicaltrials.gov Press releases
SLIDE 19
But…
Information often incomplete May not be citable May not be searchable
SLIDE 20
And…
No opportunity for community comments/dialogue
SLIDE 21
IMPROVE-IT Trial
Study Results Reported Results First Announced: August 28, 2014 Trial First Presented: November 17, 2014 Paper published: June 3, 2015
SLIDE 22
Lack options for less publishable products…
Protocols/Technical reports Quality innovations White papers
SLIDE 23 Unpublished Trial Data
Many trials are never reported –
SLIDE 24 http://www.who.int/ ictrp/results/jointstat ement/en/
We will work towards a timeframe of 12 months from primary study completion (the last visit of the last subject for collection of data on the primary outcome) as the global norm for summary results disclosure.
SLIDE 25
Jeremy Farrar, Director Wellcome Trust
“Not only will this help ensure that these research findings are more discoverable, but it will also reduce reporting biases, which currently favor publication of trials which have a positive outcome.”
SLIDE 26
Trevor Mundel, Pres GH Gates Foundation
"It's a 21st-century best practice – and an essential part of the social contract that underlies medical research – that clinical trial data should be made publicly available less than one year after a clinical trial's completion."
SLIDE 27 https://s3.amazona ws.com/public- inspection.federalre gister.gov/2016- 22129.pdf
In general, results information must be submitted no later than one year after the completion date
drug clinical trial.
SLIDE 28 BMJ (@bmj_latest)
http://www.bmj.com /content/bmj/352/b mj.i637.full.pdf
Only 29% of completed clinical trials conducted by the faculty at major academic centers were published within two years
13% reported results on ClinicalTrials.gov
SLIDE 29
And then there is speed…
SLIDE 30
Protocol Papers
SLIDE 31 Concern: Fake News
There is already too much fake information
http://www.intellectualtakeout.org/blog/5-reasons-why-fake-news-here-stay
SLIDE 32 Concern: There is already too much information.
https://www.flickr.com/photos/intersectionconsulting/7537238368
SLIDE 33 About volume…
https://hcsmmonitor.com/2015/10/29/information-overload/
SLIDE 34 Concern: Public may act prematurely. Harm may accrue.
https://commons.wikimedia.org/wiki/File:Singapore_Road_Signs_-_Warning_Sign_-_Danger.svg
SLIDE 35
Concern: May undermine Clinicaltrials.gov
SLIDE 36
Risk Mitigation High-level screen IRB-approved or exempted Require posting on clinicaltrials.gov Corresponding author: ORCHID Labeling and watermarks
SLIDE 37
Concern: Publication
Will this jeopardize peer-review publication?
SLIDE 38
Journal Policies
Many journals allow preprints, including BMJ, Science, Nature and others.
SLIDE 39
Journal Policies
SLIDE 40
Journal Policies
SLIDE 41 https://www.youtube.com/watch?v=2zMgY8Dx9co
SLIDE 42
SLIDE 43
SLIDE 44 Growing use in biology: bioRxiv
http://asapbio.org/preprint-info/biology-preprints-over-time
SLIDE 45
Yale Data Open Access (YODA) Project
SLIDE 46
When is the right time?
Yoda.yale.edu
SLIDE 47
When is the right time?
SLIDE 48
Medical Preprint Server
Community resource Stewards not owners Iterative learning
SLIDE 49
Goal Not to establish a server But to improve and accelerate science, promote collaboration, enhance transparency, reduce waste Improve over time
SLIDE 50
Ask… Journals should allow co-existence of pre-print servers and not penalize scientists who use them. Is there really a difference from presenting at a meeting?
SLIDE 51
Tell us what you think…
medarxiv@yale.edu