Curation of computational biology models Curation of computational - - PowerPoint PPT Presentation

▶
curation of computational biology models curation of
SMART_READER_LITE
LIVE PREVIEW

Curation of computational biology models Curation of computational - - PowerPoint PPT Presentation

May 28, 2023 19 likes •145 views

Curation of computational biology models Curation of computational biology models Anand Rampadarath & David Nickerson Anand Rampadarath & David Nickerson Auckland Bioengineering Institute, University of Aucklan

slide-1
SLIDE 1

Anand Rampadarath & David Nickerson Anand Rampadarath & David Nickerson Auckland Bioengineering Institute, University of Aucklan Curation of computational biology models Curation of computational biology models

a.rampadarath@auckland.ac.nz a.rampadarath@auckland.ac.nz d. d.nickerson@auckland.ac.nz ickerson@auckland.ac.nz https://reproduciblebiomodels.org/ https://reproduciblebiomodels.org/

slide-2
SLIDE 2

2

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Acknowledgements Acknowledgements

  • Centre director: Herbert Sauro, University of Washington
  • Co-directors:

–

Jonathan Karr, Icahn School of Medicine at Mount Sinai

–

John Gennari, University of Washington

–

Ion Moraru, University of Connecticut Health

  • NIH/NIBIB Biomedical Technology Resource Center grant P41 EB023912
slide-3
SLIDE 3

3

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Model curation service for journals Model curation service for journals

  • Work with journals to improve

reproducibility

  • Help develop common curation

practices

–

Domain specific vs general curation

–

Curation != validation

  • Measuring reproducibility

–

FAIR metrics and associated pitfalls

  • Annotation

–

Non-standard model formats

–

Simulation results

slide-4
SLIDE 4

4

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Initial vision Initial vision

slide-5
SLIDE 5

5

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

PLoS PLoSComp Biol Comp Biol - Pilot Pilot

Selected associate editors Author(s) submit manuscript Suitable manuscripts sent to curation service (as a reviewer) Curation service checks reproducibility and produces reproducibility report Reproducibility report submitted as the “review” Existing submission pipeline Existing submission pipeline

Editorial describing pilot: Editorial describing pilot: https https ://doi.org/10.1371/journal.pcbi. ://doi.org/10.1371/journal.pcbi. 1007881 1007881

slide-6
SLIDE 6

6

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Reproducibility report Reproducibility report

slide-7
SLIDE 7

7

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

PLoS PLoSComp Biol Comp Biol - Pilot Pilot

  • ~70 submissions opt -in to pilot
  • ~40 reports submitted
  • 30% of submissions “reproducible”

–

At least one reported result could be reproduced

  • Common reasons we are unable to determine reproducibility

–

No code submitted or will be made available after acceptance

–

Missing data files

–

Software successfully installed and runs on test data, but no mention of data used in paper

–

Insufficient descriptions of how to use outputs to obtain results

–

Code provided without comments or documentation

slide-8
SLIDE 8

8

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Physiome Physiome

  • https://journal.physiom eproject.org
  • New journal with a focus on

reproducibility

  • Reproducibility report included in

publication

  • https://vph2020.sciencesconf.org/315725
slide-9
SLIDE 9

9

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Reproducibility report Reproducibility report

slide-10
SLIDE 10

10

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Reproducibility report Reproducibility report

slide-11
SLIDE 11

11

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Reproducibility report Reproducibility report

slide-12
SLIDE 12

12

Slides available at https://doi.org/10.17608/k6.auckland.12871082 Slides available at https://doi.org/10.17608/k6.auckland.12871082

Reproducibility report Reproducibility report