GTC 2017 Interactive Virtual Reality Technology Janet Goldenstein - - PowerPoint PPT Presentation

NVIDIA GTC 2017

Improving Patient Care Using EchoPixel's Interactive Virtual Reality Technology

Janet Goldenstein

Lead Developer, EchoPixel, Inc.

NVIDIA GTC - 2017

Medical Imaging

NVIDIA GTC - 2017

2

Years of training required to understand medical images Enormous amount of information is contained in medical images Millions of medical images acquired each year

Surgical Planning in Pediatric Cardiology

3

Information contained in 3D medical image data is not fully utilized for surgical planning

NVIDIA GTC - 2017

Trauma Decision in the ER

4

NVIDIA GTC - 2017

CT Scans to help with Trauma Decisions Image Analysis takes too long

Information is not accessible

5

Information contained in medical images is not accessible by the entire healthcare team

NVIDIA GTC - 2017

Radiology - Surgery Gap

6

Radiologists understand the information Surgeons must act on the information

NVIDIA GTC - 2017

Visualize Anatomy Instead of Images

7

Medical Image Anatomy

+

Next Generation Displays

An immersive, virtual holographic experience

High Performance Computing

A high performance Nvidia GPU computer system with expandability and reliability

Stereoscopic Visualization

Apply advanced stereoscopic rendering to medical image data

+

NVIDIA GTC - 2017

Why 3D Visualization and Interaction

8

NVIDIA GTC - 2017

3D visualization and interaction completes perception

• Based on Memory
• Pattern recognition
• Sensory input based (motion)
• Spatial relationships of objects

Dual “What" and “Where" Multisensory Routes What Where

VR/AR Head Mounted Displays

• Doctors do not like to wear
• Isolating from environment & colleagues
• Can create dizziness
• Can become more obstructive than useful
• Very easy for registration to fail
• Challenges with “blacks” (additive blending)

Limitations

Virtual & Augmented HMD’s have limitations for medical imaging

NVIDIA GTC - 2017

9

Holographic Displays

• Small viewing area
• Limited color & contrast resolution
• Challenges with “blacks”
• Limited interaction

Limitations

Holographic Displays have limitations for medical imaging

NVIDIA GTC - 2017

10

True 3D enables physicians to see and interact with medical images the way they would with real physical objects.

True 3D Solution

True 3D software

11

• Visualize patient specific anatomy
• Reach in and directly grasp, interact,

and size key clinical features.

• Share 3D patient data to any other

clinician

• Diagnosis & Surgical Planning Tools
• FDA 510K cleared / CE Mark

NVIDIA GTC - 2017

True 3D Solution

12

Show demo video here

NVIDIA GTC - 2017

True 3D: Pediatric Cardiology

13

• Dr. Saunders, Texas A&M – “It’s changed the way I think about the heart.”

True 3D has now assisted multiple surgeries and has changed workflow

NVIDIA GTC - 2017

True 3D: Neurology

14

• Dr. Kaminsky, Lahey Clinic – Cannot measure tortuous vessels accurately without True 3D.

NVIDIA GTC - 2017

True 3D: Medical Devices

15

• Dr. Fred St Goar, Mitra Clip – Devices may improve but I can’t deliver their value unless I see the

structure I am treating

• Reduction of number of devices/ implant (2.7  ~1)
• Interpretation time 1-2 mins vs. 30-40 mins
• Improves surgical planning and patient engagement

Ken Merdan, BSC “When you are looking at something complex—and anatomy is complex and hard to understand—it’s easier to grasp in a short time frame.”

NVIDIA GTC - 2017

Conclusion

• Information contained in medical images can be accessed by the entire

healthcare team

• Improvement in clinical efficacy and workflow has had a significant positive

impact on patient care

• Virtual Reality in healthcare is no longer in the future – it is happening now!

16

NVIDIA GTC - 2017

Contact

EchoPixel, Inc.

janet@echopixeltech.com +1 (844) 273-7766

17

NVIDIA GTC - 2017