SLIDE 1
JBI SUMARI
The Joanna Briggs Institute System for the Unified Management, Assessment and Review
- f Information
JBI SUMARI The Joanna Briggs Institute S ystem for the U nified M - - PowerPoint PPT Presentation
JBI SUMARI The Joanna Briggs Institute S ystem for the U nified M - - PowerPoint PPT Presentation
JBI SUMARI The Joanna Briggs Institute S ystem for the U nified M anagement, A ssessment and R eview of I nformation Research School April 2017 To discuss SUMARI Introduction 1. Demonstration 2. Limitations and future plans 3. Our challenge The
SLIDE 2
SLIDE 3
Our challenge
The challenge for us was to create a new system, which will allow the user to appraise and synthesise evidence from an even broader spectrum of sources, once again creating a world first in systematic review software.
SLIDE 4
Features
> Incorporate all of the existing functionality plus more > New review types > Address each of steps in the systematic review process
SLIDE 5
Systematic Review Software Steps
1.
Formulate review question
2.
Define inclusion and exclusion criteria
3.
Finalise and export protocol
4.
Locate studies (searching)
5.
Collate studies and discard duplicates
6.
Screen studies Ti/Ab (independently and review [I&R])
7.
Select based on full text reasons for exclusion [I&R]
8.
Assess study quality [I&R]
9.
Extract data [I&R]
- 10. Analysis/summary and synthesis of relevant studies
- 11. Present results
- 12. Interpret results/establish confidence in body of
evidence (GRADE, ConQual)
- 13. Finalise and export report
SLIDE 6
Types of Systematic Reviews
▶ 1. Effectiveness Reviews ▶ 2. Qualitative Reviews ▶ 3. Costs/Economics Reviews ▶ 4. Prevalence or Incidence Reviews ▶ 5. Diagnostic Test Accuracy Reviews ▶ 6. Etiology and Risk Reviews ▶ 7. Textual Synthesis Reviews ▶ 8. Mixed Methods Reviews ▶ 9. Umbrella Reviews ▶ 10. Scoping Reviews
SLIDE 7
JBI SUMARI
> Aims to support the entire
review process
– Protocol templates – Review team management – 10 review types – Critical Appraisal – Data Extraction – Synthesis
SLIDE 8
Purpose of this demo
> “Warts and all” presentation > Highlight current features and the current limitations > Highlight some future work > Remember – this is the 1st release (non‐commercial) > Regular, rolling updates are planned
SLIDE 9
SUMARI Sites
> https://www.jbisumari.org/
SLIDE 10
User registration
> Features
– Forgotten username/password features – Change password – Secure website (https)
SLIDE 11
Project creation
> Features
– Can create 10 project types and an additional ‘custom’ project – Can filter projects on dashboard – Can view when the project was last updated – Can ‘jump’ straight to a certain page within a project from the project bar – Can delete a project
SLIDE 12
Overview and participants page
> Features
– Can export protocol (note: can do this on the protocol page as well) – Can view review progress – Can modify project title – Can invite as many participants as you wish to the review
> Future plans
– Notification system (potentially)
SLIDE 13
Protocol page
> Features
– Import citations form endnote XML – Add studies manually – Drag and drop studies – Automatic updating of reference order (Vancouver) – Add new sections – Reposition – Proforma administration page enables simple updates and ensures always up to date – Simple formatting – Export RTF document – Allows multiple contributors if permissions are correct – Automatic saving
SLIDE 14
Protocol page
> Future plans
– Insert citation into text via other means – Import other citation formats – Include default citations based on review type – No superscript formatting available – Export word document – Ensure references with relevant information in export (if feasible) – Lock out for multiple editing – Initiate version control (if feasible) – Submit to JBISRIR (if feasible) – Add DOIs to citations
SLIDE 15
Studies
> Features
– Can import studies via endnote XML – Can create studies manually – Can export results into docx with PRISMA flowchart – Can filter studies – Can do full text study selection
> Future plans
– Title and abstract screening (if feasible), similar to systems such as Covidence, Rayaan, Clinical Guideline Services etc – Import searches from PubMed +other databases – Import other reference formats – Dual screening – PRISMA for entire process
SLIDE 16
Critical appraisal
> Features
– Select from 14 critical appraisal tools – Tools ordered by default project type – Dual screening – Flexible appraisal process (people can log in and begin) – View both comments during final decision making – Export results in a rtf – Filter appraisals
> Future plans
– Create your own critical appraisal tools – Enable single critical appraisal or 3+ critical appraisal – Export into a docx – Upload PDFs into system and highlight (if feasible)
SLIDE 17
Data extraction
> Features
– Default data extraction tool based on study design – Single data extraction – Ability to add multiple groups where necessary – Export into RTF with tables
> Limitations
– Option to perform dual data extraction – Creation of individualised data extraction forms – Export into docx – Code studies using structured ontologies (throughout system, including MA and recommendations etc)
SLIDE 18
Qualitative synthesis
> Features
– Enter findings per study and assign level of credibility – Assign findings to categories – Assign categories to synthesised findings – Streamlined user interface and design
> Future plans
– Build in ConQual automatically – Highlight findings on uploaded pdf/text docs automatically – Export list of findings into docx – Implement coding system so findings can be tagged and grouped
SLIDE 19
Meta‐analysis
> Features:
– Head to head comparisons – Choose meta‐analysis parameters – Flexible – can add additional citations
> Future plans
– Improve plot visual output – Additional options – Proportional MA – SROC curves – Economic decision matrix – Export into docx – Subgroup analyses – Funnel plots and publication bias tests
SLIDE 20
Report builder
> Still to come!
SLIDE 21
What is next?
> Short term
– Many changes expected from feedback now we are in production – Prioritise updates – Prepare for commercial release – Maintain and continually update the system
> Medium Term
– Ensure interoperability with similar systems and evidence ecosystem
> Long term (all hypothetical at the moment)
– SR automation, machine learning, automated RoB, study selection and extraction – Publish living SRs – Integrate SUMARI and JBISRIR
SLIDE 22
“You can't always get what you want But if you try sometimes well you just might find You get what you need”
SLIDE 23
Other software
> RevMan, particularly for meta‐analysis, head to head
comparisons
> OpenMeta[analyst] > openMetaAnalysis http://openmetaanalysis.github.io/ > SR Toolbox http://systematicreviewtools.com/index.php
SLIDE 24