a new era of large scale replication and collaboration
play

A new era of large-scale replication and collaboration? - PowerPoint PPT Presentation

Jan 06, 2023 •311 likes •567 views

A new era of large-scale replication and collaboration? http://www.slideshare.net/holcombea Alex.Holcombe@sydney.edu.au @ceptional Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php Where science is not

  1. A new era of large-scale replication and collaboration? http://www.slideshare.net/holcombea Alex.Holcombe@sydney.edu.au @ceptional Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  2. Where science is not self-correcting False positive zones - researcher degrees of freedom high ( p- hacking ) - victory declared whenever null hypothesis is rejected, where size of effect, plausibility considered unimportant. The newer the domain, the more cutting-edge the techn Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  3. #AcademicNoir "This one's Psych Science. 1998. Put your money on ‘will replicate’?” "What, you think I was born yesterday?” "Fine," muttered the bookie. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  4. Well, Mr. Hacker, your luck is about to run out. Down at the journals, they’re running a new game. They call it ‘preregistration’. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  5. https://osf.io/tvyxz/wiki/home/ 5 Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  6. https://osf.io/tvyxz/wiki/home/ 6 Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  7. https://osf.io/tvyxz/wiki/home/ Here’s how you Here, check our can replicate our 100% P-hacking Free numbers. result. 7 Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  8. "This one's Psych Science. 1998. Put your money on ‘will replicate’?” "What, you think I was born yesterday?” "Fine," muttered the bookie. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  9. Reproducibility workshop 26 Nov 9 http://bizlab.unsw.edu.au/website/conference-2015.php

  10. Failed to replicate m y result? Have you considered the unknown m oderators? Reproducibility workshop 26 Nov 10 http://bizlab.unsw.edu.au/website/conference-2015.php

  11. Any one of us alone, he’ll say we messed up. But if we all run the replication together, we can show the big guy we’re right. Reproducibility workshop 26 Nov 11 http://bizlab.unsw.edu.au/website/conference-2015.php

  12. Meta-analysis forest plot Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  13. Meta-analysis forest You m essed plot up! Failed to replicate m y result? Have you considered the unknown m oderators? Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  14. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  15. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  16. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  17. A new era of large-scale replication and collaboration? Preregistration Can we do this bottom-up Large-scale replication Open data Open protocol and code Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  18. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  19. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  20. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  21. s at Perspectives on Psychological Science, open scienc Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  22. “No data, no paper. And make that the raw data, alright? I don’t want a bunch of p-hacked p-values. stinkin’ summaries. ” Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  23. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  24. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  25. How open science wins Tech work at grassroots Cultural change • Altmetrics • Early adopters • Streamlining • Researcher training repositories • Advocacy, lobbying • Software for reproducible research • Journals strengthen sharing policies Research funders ramp up requirement that code, data be posted CC-BY Alex Holcombe Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Large-scale emission from FR I jets Pol Bordas with the collaboration of V. Bosch-Ramon & M.

Large-scale emission from FR I jets Pol Bordas with the collaboration of V. Bosch-Ramon & M.

Large-scale emission from FR I jets Pol Bordas with the collaboration of V. Bosch-Ramon & M. Perucho Barcelona June 2011, mircoles 29 de junio de 2011 Large-scale emission in FR I jets Pol Bordas, HEPRO III OUTLINE The FR I/II

424 views • 27 slides
communication and collaboration models Look at several levels minutiae to large scale

communication and collaboration models Look at several levels minutiae to large scale

CSCW Issues and Theory All com puter system s have group im pact chapter 14 not just groupware Ignoring this leads to the failure of system s communication and collaboration models Look at several levels minutiae to large scale

217 views • 7 slides
FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large

FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large

FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large Scale Solar Lead April 2017 CONTENTS 1. Introduction to CEFC 2. Investment trends 3. The future of large scale solar 4. Pathway to sustainable

664 views • 21 slides
Collaboration at Scale: The Innovation Competency 13-Feb-2019 Collaboration at Scale Designed

Collaboration at Scale: The Innovation Competency 13-Feb-2019 Collaboration at Scale Designed

Collaboration at Scale: The Innovation Competency 13-Feb-2019 Collaboration at Scale Designed for Scrum-centric organizations with more than 10 Scrum teams, the Collaboration at Scale webinar series provides focused, outcome-driven solutions

636 views • 28 slides
Analysis of Large-Scale Scalar Data Using Hixels Joshua A. Levine 2 , in collaboration with D.

Analysis of Large-Scale Scalar Data Using Hixels Joshua A. Levine 2 , in collaboration with D.

LDAV 2011 Analysis of Large-Scale Scalar Data Using Hixels Joshua A. Levine 2 , in collaboration with D. Thompson 1 , J.C. Bennett 1 , P.-T. Bremer 3 , A. Gyulassy 1 , P.P. Pbay 4 , V. Pascucci 1 1 2 3 4 HPC Has Lead to Increases in Both Data

449 views • 32 slides
Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII /

Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII /

31st APAN meeting Feb. 21-25, 2011, Hong Kong Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII / Tohoku University, Japan 1 eduroam JP National eduroam operation and promotion 19 institutions

165 views • 12 slides
Large-Scale Self-Supervised Robotic Learning Chelsea Finn In collaboration with Sergey Levine

Large-Scale Self-Supervised Robotic Learning Chelsea Finn In collaboration with Sergey Levine

Large-Scale Self-Supervised Robotic Learning Chelsea Finn In collaboration with Sergey Levine and Ian Goodfellow Generalization in Reinforcement Learning to object instances to tasks and environments Oh et al. 16 Pinto & Gupta 16

601 views • 25 slides
INCORPORATING LARGE-SCALE CITIZEN INCORPORATING LARGE-SCALE CITIZEN DELIBERATION INTO

INCORPORATING LARGE-SCALE CITIZEN INCORPORATING LARGE-SCALE CITIZEN DELIBERATION INTO

INCORPORATING LARGE-SCALE CITIZEN INCORPORATING LARGE-SCALE CITIZEN DELIBERATION INTO ENVIRONMENTAL CONFLICT RESOLUTION America Speaks presentation to the 2008 ECR Conference Table Introductions Please form groups of 4-5 and give: Your name

848 views • 41 slides
Large-Scale Survey Interviewing Following Large Scale Survey Interviewing Following the 2008

Large-Scale Survey Interviewing Following Large Scale Survey Interviewing Following the 2008

Large-Scale Survey Interviewing Following Large Scale Survey Interviewing Following the 2008 WenChuan Earthquake Zhang Huafeng and Jon Pedersen International Blaise Users Conference (IBUC) Baltimore, USA , 1 Introduction Two household

711 views • 22 slides
On relativistic effects and large scale cosmology In collaboration with Enea Di Dio (INAF,

On relativistic effects and large scale cosmology In collaboration with Enea Di Dio (INAF,

On relativistic effects and large scale cosmology In collaboration with Enea Di Dio (INAF, Trieste) Matteo Viel (SISSA, Trieste) Carlo Baccigalupi (SISSA, Trieste) Ruth Durrer (Universit de Genve) Eleonora Villa (SISSA, Trieste)

681 views • 38 slides
Asynchronous Replication and Bayou Asynchronous Replication and Bayou Asynchronous Replication

Asynchronous Replication and Bayou Asynchronous Replication and Bayou Asynchronous Replication

Asynchronous Replication and Bayou Asynchronous Replication and Bayou Asynchronous Replication Asynchronous Replication Idea: build available/scalable information services with read-any-write-any replication and a weak consistency model. - no

738 views • 48 slides
GDR ADN, 2-4 mai 2012 Replication in eukaryotic genomes Specific features of eukaryotic

GDR ADN, 2-4 mai 2012 Replication in eukaryotic genomes Specific features of eukaryotic

GDR ADN, 2-4 mai 2012 Replication in eukaryotic genomes Specific features of eukaryotic replication: - multiple replication origins - large variability in the timing of activation and in the efficiency of a given origin O1 O2 3 5 3

130 views • 11 slides
Large-scale production of graphene: Introduction Large-scale production of graphene: what is

Large-scale production of graphene: Introduction Large-scale production of graphene: what is

Large-scale production of graphene: Introduction Large-scale production of graphene: what is graphene? Graphene is a truly 2D system made of Carbon atoms arranged in an honeycomb hexagonal lattice Zero-gap semiconductor with a low-energy linear

268 views • 6 slides
Smart Synchronization on Social Collaboration Jason J. Jung ( )

Smart Synchronization on Social Collaboration Jason J. Jung ( )

Smart Synchronization on Social Collaboration Jason J. Jung ( ) http://intelligent.pe.kr/ j2jung@gmail.com ETRI@Korea Jan 15th, 2016 Background Large scale organization (a number of users & a large amount of data)

892 views • 51 slides
in Tashkent CSEP 545 Transaction Processing Sameh Elnikety Replication for Performance

in Tashkent CSEP 545 Transaction Processing Sameh Elnikety Replication for Performance

Database Replication in Tashkent CSEP 545 Transaction Processing Sameh Elnikety Replication for Performance Expensive Limited scalability 2 DB Replication is Challenging Single database system Large, persistent state Transactions

762 views • 73 slides
Ethics in Techniques for large-scale data Graham J.L. Kemp TECHNIQUES FOR LARGE-SCALE DATA

Ethics in Techniques for large-scale data Graham J.L. Kemp TECHNIQUES FOR LARGE-SCALE DATA

Ethics in Techniques for large-scale data Graham J.L. Kemp TECHNIQUES FOR LARGE-SCALE DATA Masters level course: Chalmers MPALG and MPSOF programmes (DAT345) GU Applied Data Science programme (DIT871) Learning outcomes include:

305 views • 18 slides
HR Consolidation Service Modernization Delivery Strategy Update to the Legislative Finance

HR Consolidation Service Modernization Delivery Strategy Update to the Legislative Finance

HR Consolidation Service Modernization Delivery Strategy Update to the Legislative Finance Committee October 26, 2017 Version 1.0 A Need for HR Transformation HR functions are exclusive to agency focusing primarily on transaction

1.04k views • 11 slides
Edge Working Group and Activities The Vision thing - Product goals and objects. The Secret Sauce:

Edge Working Group and Activities The Vision thing - Product goals and objects. The Secret Sauce:

Edge Working Group and Activities The Vision thing - Product goals and objects. The Secret Sauce: Tools and Automation Pain Points and the Ask Confidential and proprietary materials for authorized Verizon personnel and outside agencies only.

557 views • 20 slides
Ashland Economic Opportunities Analysis Grant Project Update Ashland Planning Commission May 8,

Ashland Economic Opportunities Analysis Grant Project Update Ashland Planning Commission May 8,

Ashland Economic Opportunities Analysis Grant Project Update Ashland Planning Commission May 8, 2007 Regular Meeting What is this project about? Big picture: Identify factors that affect Ashlands economy Forecast employment

514 views • 23 slides
Champaign-Urbana Urbanized Area HSTP and C-U Age-Friendly Transportation Subcommittee

Champaign-Urbana Urbanized Area HSTP and C-U Age-Friendly Transportation Subcommittee

Champaign-Urbana Urbanized Area HSTP and C-U Age-Friendly Transportation Subcommittee Stakeholder Working Group Meeting Kristen Gisondi, HSTP Coordinator Champaign County Regional Planning Commission December 5, 2018 FTA Grant Update

649 views • 19 slides
New Hampshire EV Priorities Matthew Mailloux September 27, 2019 Hypertherm, Lebanon, NH 2

New Hampshire EV Priorities Matthew Mailloux September 27, 2019 Hypertherm, Lebanon, NH 2

New Hampshire EV Priorities Matthew Mailloux September 27, 2019 Hypertherm, Lebanon, NH 2 About the Office of Strategic Initiatives The Office of Strategic Initiatives (OSI) provides information, data & guidance to assist

810 views • 9 slides
Planning Board Basics Stephen C. Buckley, Esquire NHMA Legal Services Counsel

Planning Board Basics Stephen C. Buckley, Esquire NHMA Legal Services Counsel

N E W H A M P S H I R E M U N I C I P A L A S S O C I A T I O N Planning Board Basics Stephen C. Buckley, Esquire NHMA Legal Services Counsel nhmainfo@nhmunicipal.org / 800.852.3358 / www.nhmunicipal.org Statutory Duties of

501 views • 28 slides
An Exciting New Gold Discovery in Namibia Investor Presentation January 2020 1 1 Disclaimer

An Exciting New Gold Discovery in Namibia Investor Presentation January 2020 1 1 Disclaimer

An Exciting New Gold Discovery in Namibia Investor Presentation January 2020 1 1 Disclaimer The securities of Osino Resources Corp. ("Osino" or the "Corporation") have not been registered under the U.S. Securities Act of

1.21k views • 25 slides
Office of Superintendent of Insurance FY 2019 Budget Request November 15, 2017 Legislative

Office of Superintendent of Insurance FY 2019 Budget Request November 15, 2017 Legislative

Office of Superintendent of Insurance FY 2019 Budget Request November 15, 2017 Legislative Finance Committee Presented by: Superintendent John G. Franchini Agenda Premium Tax Collection Update Premium Tax Collection Transfer

430 views • 12 slides

More recommend