JBI SUMARI The Joanna Briggs Institute S ystem for the U nified M - PowerPoint PPT Presentation

JBI SUMARI The Joanna Briggs Institute S ystem for the U nified M anagement, A ssessment and R eview of I nformation Research School April 2017

To discuss SUMARI Introduction 1. Demonstration 2. Limitations and future plans 3.

Our challenge The challenge for us was to create a new system, which will allow the user to appraise and synthesise evidence from an even broader spectrum of sources, once again creating a world first in systematic review software.

Features > Incorporate all of the existing functionality plus more > New review types > Address each of steps in the systematic review process

Systematic Review Software Steps Formulate review question 1. Define inclusion and exclusion criteria 2. Finalise and export protocol 3. Locate studies (searching) 4. Collate studies and discard duplicates 5. Screen studies Ti/Ab (independently and review [I&R]) 6. Select based on full text reasons for exclusion [I&R] 7. Assess study quality [I&R] 8. Extract data [I&R] 9. 10. Analysis/summary and synthesis of relevant studies 11. Present results 12. Interpret results/establish confidence in body of evidence (GRADE, ConQual) 13. Finalise and export report

Types of Systematic Reviews ▶ 1. Effectiveness Reviews ▶ 2. Qualitative Reviews ▶ 3. Costs/Economics Reviews ▶ 4. Prevalence or Incidence Reviews ▶ 5. Diagnostic Test Accuracy Reviews ▶ 6. Etiology and Risk Reviews ▶ 7. Textual Synthesis Reviews ▶ 8. Mixed Methods Reviews ▶ 9. Umbrella Reviews ▶ 10. Scoping Reviews

JBI SUMARI > Aims to support the entire review process – Protocol templates – Review team management – 10 review types – Critical Appraisal – Data Extraction – Synthesis

Purpose of this demo > “Warts and all” presentation > Highlight current features and the current limitations > Highlight some future work > Remember – this is the 1 st release (non ‐ commercial) > Regular, rolling updates are planned

SUMARI Sites > https://www.jbisumari.org/

User registration > Features – Forgotten username/password features – Change password – Secure website (https)

Project creation > Features – Can create 10 project types and an additional ‘custom’ project – Can filter projects on dashboard – Can view when the project was last updated – Can ‘jump’ straight to a certain page within a project from the project bar – Can delete a project

Overview and participants page > Features – Can export protocol (note: can do this on the protocol page as well) – Can view review progress – Can modify project title – Can invite as many participants as you wish to the review > Future plans – Notification system (potentially)

Protocol page > Features – Import citations form endnote XML – Add studies manually – Drag and drop studies – Automatic updating of reference order (Vancouver) – Add new sections – Reposition – Proforma administration page enables simple updates and ensures always up to date – Simple formatting – Export RTF document – Allows multiple contributors if permissions are correct – Automatic saving

Protocol page > Future plans – Insert citation into text via other means – Import other citation formats – Include default citations based on review type – No superscript formatting available – Export word document – Ensure references with relevant information in export (if feasible) – Lock out for multiple editing – Initiate version control (if feasible) – Submit to JBISRIR (if feasible) – Add DOIs to citations

Studies > Features – Can import studies via endnote XML – Can create studies manually – Can export results into docx with PRISMA flowchart – Can filter studies – Can do full text study selection > Future plans – Title and abstract screening (if feasible), similar to systems such as Covidence, Rayaan, Clinical Guideline Services etc – Import searches from PubMed +other databases – Import other reference formats – Dual screening – PRISMA for entire process

Critical appraisal > Features – Select from 14 critical appraisal tools – Tools ordered by default project type – Dual screening – Flexible appraisal process (people can log in and begin) – View both comments during final decision making – Export results in a rtf – Filter appraisals > Future plans – Create your own critical appraisal tools – Enable single critical appraisal or 3+ critical appraisal – Export into a docx – Upload PDFs into system and highlight (if feasible)

Data extraction > Features – Default data extraction tool based on study design – Single data extraction – Ability to add multiple groups where necessary – Export into RTF with tables > Limitations – Option to perform dual data extraction – Creation of individualised data extraction forms – Export into docx – Code studies using structured ontologies (throughout system, including MA and recommendations etc)

Qualitative synthesis > Features – Enter findings per study and assign level of credibility – Assign findings to categories – Assign categories to synthesised findings – Streamlined user interface and design > Future plans – Build in ConQual automatically – Highlight findings on uploaded pdf/text docs automatically – Export list of findings into docx – Implement coding system so findings can be tagged and grouped

Meta ‐ analysis > Features: – Head to head comparisons – Choose meta ‐ analysis parameters – Flexible – can add additional citations > Future plans – Improve plot visual output – Additional options – Proportional MA – SROC curves – Economic decision matrix – Export into docx – Subgroup analyses – Funnel plots and publication bias tests

Report builder > Still to come!

What is next? > Short term – Many changes expected from feedback now we are in production – Prioritise updates – Prepare for commercial release – Maintain and continually update the system > Medium Term – Ensure interoperability with similar systems and evidence ecosystem > Long term (all hypothetical at the moment) – SR automation, machine learning, automated RoB, study selection and extraction – Publish living SRs – Integrate SUMARI and JBISRIR

“You can't always get what you want But if you try sometimes well you just might find You get what you need”

Other software > RevMan, particularly for meta ‐ analysis, head to head comparisons > OpenMeta[analyst] > openMetaAnalysis http://openmetaanalysis.github.io/ > SR Toolbox http://systematicreviewtools.com/index.php

Any questions?