Preprints: What, Why and How Harlan M. Krumholz, MD Yale School of - - PowerPoint PPT Presentation

preprints what why and how
SMART_READER_LITE
LIVE PREVIEW

Preprints: What, Why and How Harlan M. Krumholz, MD Yale School of - - PowerPoint PPT Presentation

Preprints: What, Why and How Harlan M. Krumholz, MD Yale School of Medicine @hmkyale Disclosure PCORI Board; United HealthCare and Aetna Advisory Committees; Grant from JNJ to distribute clinical trial data; grant from Medtronic, in


slide-1
SLIDE 1

Preprints: What, Why and How

Harlan M. Krumholz, MD Yale School of Medicine @hmkyale

slide-2
SLIDE 2

Disclosure PCORI Board; United HealthCare and Aetna Advisory Committees; Grant from JNJ to distribute clinical trial data; grant from Medtronic, in collaboration with FDA, to improve device surveillance; contracts with CMS to develop performance measures; contract with Blue Cross for technology assessment; AHRQ and NIH grants; Founder, Hugo personal health information platform.

slide-3
SLIDE 3

https://www.youtube.com/watch?v=2zMgY8Dx9co

Preprints

slide-4
SLIDE 4

Preprints

slide-5
SLIDE 5

Not everyone is a fan…

JAMA September 26, 2017 Volume 318, 1109-10

slide-6
SLIDE 6

JAMA Vol 318, 1109-10

slide-7
SLIDE 7

JAMA September 26, 2017 Volume 318, 1109-10

slide-8
SLIDE 8

JAMA September 26, 2017 Volume 318, 1109-10

slide-9
SLIDE 9

Dual Nature of Medical Journals

slide-10
SLIDE 10
slide-11
SLIDE 11

Please try to keep an open mind

@emmyzen

slide-12
SLIDE 12

What problem are we trying to solve? How do we easily and rapidly archive and share information with other scientists to accelerate research, enhance collaboration, reduce waste, increase transparency?

slide-13
SLIDE 13

https://www.youtube.com/watch?v=2zMgY8Dx9co

slide-14
SLIDE 14

Preprint Servers Complementary to, and not a replacement for, peer review journals.

slide-15
SLIDE 15

Science for Scientists

slide-16
SLIDE 16

DOI (Digital Object Identifier)

DOI is unique alphanumeric string assigned by registration agency (International DOI Foundation) to identify content and provide a persistent link to its location on the Internet.

slide-17
SLIDE 17

Pre-peer review results already released…

Major journals already allow pre-peer review release of information.

slide-18
SLIDE 18

For example…

Medical meetings Clinicaltrials.gov Press releases

slide-19
SLIDE 19

But…

Information often incomplete May not be citable May not be searchable

slide-20
SLIDE 20

And…

No opportunity for community comments/dialogue

slide-21
SLIDE 21

IMPROVE-IT Trial

Study Results Reported Results First Announced: August 28, 2014 Trial First Presented: November 17, 2014 Paper published: June 3, 2015

slide-22
SLIDE 22

Lack options for less publishable products…

Protocols/Technical reports Quality innovations White papers

slide-23
SLIDE 23

Unpublished Trial Data

Many trials are never reported –

  • r are delayed by years.
slide-24
SLIDE 24

http://www.who.int/ ictrp/results/jointstat ement/en/

We will work towards a timeframe of 12 months from primary study completion (the last visit of the last subject for collection of data on the primary outcome) as the global norm for summary results disclosure.

slide-25
SLIDE 25

Jeremy Farrar, Director Wellcome Trust

“Not only will this help ensure that these research findings are more discoverable, but it will also reduce reporting biases, which currently favor publication of trials which have a positive outcome.”

slide-26
SLIDE 26

Trevor Mundel, Pres GH Gates Foundation

"It's a 21st-century best practice – and an essential part of the social contract that underlies medical research – that clinical trial data should be made publicly available less than one year after a clinical trial's completion."

slide-27
SLIDE 27

https://s3.amazona ws.com/public- inspection.federalre gister.gov/2016- 22129.pdf

In general, results information must be submitted no later than one year after the completion date

  • f the applicable

drug clinical trial.

slide-28
SLIDE 28

BMJ (@bmj_latest)

http://www.bmj.com /content/bmj/352/b mj.i637.full.pdf

Only 29% of completed clinical trials conducted by the faculty at major academic centers were published within two years

  • f completion and only

13% reported results on ClinicalTrials.gov

slide-29
SLIDE 29

And then there is speed…

slide-30
SLIDE 30

Protocol Papers

slide-31
SLIDE 31

Concern: Fake News

There is already too much fake information

  • ut there.

http://www.intellectualtakeout.org/blog/5-reasons-why-fake-news-here-stay

slide-32
SLIDE 32

Concern: There is already too much information.

https://www.flickr.com/photos/intersectionconsulting/7537238368

slide-33
SLIDE 33

About volume…

https://hcsmmonitor.com/2015/10/29/information-overload/

slide-34
SLIDE 34

Concern: Public may act prematurely. Harm may accrue.

https://commons.wikimedia.org/wiki/File:Singapore_Road_Signs_-_Warning_Sign_-_Danger.svg

slide-35
SLIDE 35

Concern: May undermine Clinicaltrials.gov

slide-36
SLIDE 36

Risk Mitigation High-level screen IRB-approved or exempted Require posting on clinicaltrials.gov Corresponding author: ORCHID Labeling and watermarks

slide-37
SLIDE 37

Concern: Publication

Will this jeopardize peer-review publication?

slide-38
SLIDE 38

Journal Policies

Many journals allow preprints, including BMJ, Science, Nature and others.

slide-39
SLIDE 39

Journal Policies

slide-40
SLIDE 40

Journal Policies

slide-41
SLIDE 41

https://www.youtube.com/watch?v=2zMgY8Dx9co

slide-42
SLIDE 42
slide-43
SLIDE 43
slide-44
SLIDE 44

Growing use in biology: bioRxiv

http://asapbio.org/preprint-info/biology-preprints-over-time

slide-45
SLIDE 45

Yale Data Open Access (YODA) Project

slide-46
SLIDE 46

When is the right time?

Yoda.yale.edu

slide-47
SLIDE 47

When is the right time?

slide-48
SLIDE 48

Medical Preprint Server

Community resource Stewards not owners Iterative learning

slide-49
SLIDE 49

Goal Not to establish a server But to improve and accelerate science, promote collaboration, enhance transparency, reduce waste Improve over time

slide-50
SLIDE 50

Ask… Journals should allow co-existence of pre-print servers and not penalize scientists who use them. Is there really a difference from presenting at a meeting?

slide-51
SLIDE 51

Tell us what you think…

medarxiv@yale.edu