Radiology in the Era of Artificial Intelligence November 11, 2019 - - PowerPoint PPT Presentation

radiology in the era of artificial intelligence
SMART_READER_LITE
LIVE PREVIEW

Radiology in the Era of Artificial Intelligence November 11, 2019 - - PowerPoint PPT Presentation

Radiology in the Era of Artificial Intelligence November 11, 2019 Curtis P. Langlotz, MD, PhD Professor of Radiology and Biomedical Informatics, Stanford University Director, Center for Artificial Intelligence in Medicine & Imaging


slide-1
SLIDE 1

Radiology in the Era of Artificial Intelligence

November 11, 2019

Curtis P. Langlotz, MD, PhD Professor of Radiology and Biomedical Informatics, Stanford University Director, Center for Artificial Intelligence in Medicine & Imaging Associate Chair, Information Systems, Department of Radiology Medical Informatics Director, Stanford Health Care @curtlanglotz

slide-2
SLIDE 2

Disclosures

  • Shareholder and advisor:
  • whiterabbit.ai
  • Nines.ai
  • GalileoCDS, Inc
  • Bunker Hill, Inc
  • Department research support:
  • Philips
  • Siemens Healthineers
  • GE Healthcare
  • School of Medicine research support:
  • Google
  • Board of directors, Radiological Society of North America
slide-3
SLIDE 3

McNitt-Gray MF et al. Computed Tomography Assessment of Response to Therapy: Tumor Volume Change Measurement, Truth Data, and Error. Transl Oncol. 2009 Dec 1; 2(4): 216–222.

Variability in Response Assessment

Schwartz LH et al. Variability in Response Assessment in Solid Tumors: Effect of Number of Lesions Chosen for Measurement. Clin Cancer Res. 2003 Oct 1;9(12):4318-23.

slide-4
SLIDE 4
  • 14 million images
  • 21,841 distinct labels:
  • 856 types of bird
  • 993 types of tree
  • 157 musical instruments
  • Russakovsky O, Deng J, Su H, et al. ImageNet Large Scale Visual Recognition Challenge. Int J Comput Vis. 2015;115(3):211-252.
  • https://www.economist.com/news/special-report/21700756-artificial-intelligence-boom-based-old-idea-modern-twist-not
  • http://karpathy.github.io/2014/09/02/what-i-learned-from-competing-against-a-convnet-on-imagenet/

http://www.image-net.org/

slide-5
SLIDE 5

Dramatic Advances in Accuracy of Deep Learning

5

Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. ImageNet Large Scale Visual Recognition Challenge. Int J Comput Vis. 2015;115: 211–252. 0% 5% 10% 15% 20% 25% 30% 2010 2011 2012 2013 2014 2015 2016 2017

ImageNet Visual Recognition Error Rates Human error rate

slide-6
SLIDE 6

Karpathy, Andrej & Li, Fei Fei. Deep Visual-Semantic Alignments for Generating Image Descriptions, CVPR, 2015 http://www.radiologyassistant.nl/

slide-7
SLIDE 7

Advances in Computation

ASR 33 Teletype, 1976 75 lbs, 110 baud

https://www.pdp8.net/asr33/asr33.shtml

DEC PDP-8, 1965 0.333 MHz, $18,500 Apple A12 Processor, 2019 2.49 GHz x 6, $1000

slide-8
SLIDE 8

Advances in Storage

IBM 5MB HD, 1956 $3200/month lease Seagate 4TB HD, 2019 $99, Amazon.com

slide-9
SLIDE 9

Negative Cases Positive Cases

Neural Network

https://hackernoon.com/challenges-in-deep-learning-57bbf6e73bb

A flexible and powerful form of machine learning. Benign Malignant

slide-10
SLIDE 10

“Deep” Neural Networks: Tens of Millions of Parameters

slide-11
SLIDE 11

Learning Object Recognition

Faces Cars Elephants Chairs

Courtesy of Andrew Ng

slide-12
SLIDE 12

Machine Learning Research in Medical Imaging

Labeled Training Data New Image Recon Methods

CT scan icon by Sergey Demushkin from the Noun Project

Source “Raw” Data New Image Labeling Methods New Machine Learning Explanation Methods Actionable Advice Decision Support Systems New Machine Learning Methods

slide-13
SLIDE 13
  • Federated learning
  • Generative adversarial networks
  • Semi-supervised learning
  • Deep contextualized word representations
  • Multi-task learning
  • Reinforcement learning
  • Explainable AI models
  • Homomorphic encryption
slide-14
SLIDE 14

Foundational AI Research in Radiology: Ingredients for Success

Ingredient for Success AI Startups Established Companies Healthcare Delivery Systems Professional Societies Academic Health Systems

Deep technical knowledge High performance computing Interdisciplinary teams Ongoing source of labeled images Infrastructure for prospective evaluation Market dissemination channel =can acquire =available =difficult to acquire

slide-15
SLIDE 15
  • Anesthesia
  • Bioengineering
  • Biomedical Data Science
  • Cardiothoracic Surgery
  • Computer Science
  • Dermatology
  • Emergency Medicine
  • Genetics
  • Medicine
  • Neurology & Neurological Sciences
  • Neurosurgery
  • Ophthalmology
  • Pathology
  • Pediatrics
  • Psychiatry & Behavioral Sciences
  • Psychology
  • Radiation Oncology
  • Radiology
  • Surgery
  • Urology

Key C Compute ter S Science F Faculty C Collaborators

Andrew Ng, PhD Deep Learning Pioneer Chris Manning, PhD Stanford AI Lab Director Fei Fei Li, PhD Creator of ImageNet

slide-16
SLIDE 16

AIMI Diagnostic Radiology Projects

PE classification Appendicitis Cervical spine fracture 14 chest abnormalities Coronary calcium scoring Fractures Fractures Knee menisci and ligaments Knee cartilage Brain age Brain tumors Renal abnormalities Renal cell carcinoma Deep vein thrombosis Brasfield scoring Bone age Brain abnormalities MR CT US XR Lung cancer Pneumonia Normal/abnormal PT

slide-17
SLIDE 17

AI Throughout The Imaging Life Cycle

17

Image protocoling Image recon- struction and enhancement Imaging sequence

  • ptimization

Image quality control Image triage Computer aided- detection Disease classification

https://aimi.stanford.edu/

Lower radiation dose and imaging time Answer the clinical question Decrease length of stay Prevent/detect disease early among populations Select precise treatment with global reach Enable patient self- scheduling Reduce repeat imaging

slide-18
SLIDE 18

18

Infrastructure for AI in Medical Imaging

Scanner Cohort Management

  • Role-based access
  • Image viewing
  • Image annotation/

labeling

Cohort selection

Algorithm Training & Testing

Machine-learning- ready data set

Research Data Warehouse (STARR)

Data Migration

AI Prospective Evaluation and Deployment Platform

UPSTREAM DOWNSTREAM Containerized Algorithm AI results Clinical images

DICOM Router Clinical EMR, RIS, PACS, Reporting

Clinical images Image labels

Imaging Reporting System

AI results AI results Other clinical data Clinical images for AI processing “Raw” detector data for AI processing

Clinical Practice Laboratory

AI Vendor

slide-19
SLIDE 19

Research Opportunities and Infrastructure Development Requirements for Translation

  • Data sets for training, testing,

and validating AI algorithms

  • Standards for clinical

integration of AI algorithms

  • Software use cases with

common data elements

  • Balanced regulatory framework

to ensure safety and efficacy

https://doi.org/10.1016/j.jacr.2019.04.014

slide-20
SLIDE 20

Publicly-Released Labeled Radiology Datasets

slide-21
SLIDE 21

21

Publicly-Released Labeled Radiology Datasets

https://aimi.stanford.edu/

slide-22
SLIDE 22

Measure = 7 ± 6 Measure = 7 ± 2

QIBA = Reproducibility

Adapted from Kevin O’Donnell and Daniel Sullivan

Variability in:

  • Patient handling
  • Acqisition protocols
  • Image reconstruction
  • Segmentation
  • Image processing

Problem

QIBA Profile specifying:

  • Calibration
  • Patient Preparation
  • Acquisition Parameters
  • Reconstruction Parameters
  • Resolution
  • Processing Parameters
  • Segmentation

Solution

Treat Wait

?

slide-23
SLIDE 23

Engage: @curtlanglotz @StanfordAIMI LinkedIn: aimi-stanford Join the mailing list: https://aimi.stanford.edu/engage/subscribe Apply to become affiliated faculty: https://aimi.stanford.edu/engage/affiliate-faculty

Thank You