Pico Lantern & Megalodon Thomas Demarcy, Asclepios Research Team - - PowerPoint PPT Presentation

▶
pico lantern megalodon
SMART_READER_LITE
LIVE PREVIEW

Pico Lantern & Megalodon Thomas Demarcy, Asclepios Research Team - - PowerPoint PPT Presentation

Nov 21, 2022 331 likes •582 views

Pico Lantern & Megalodon Thomas Demarcy, Asclepios Research Team Edgcumbe, P., Pratt, P., Yang, G.: Pico Lantern: A Pick-up Projector for Augmented Reality in Laparoscopic Surgery. MICCAI 432 439 (2014). Introduction Doctors are

slide-1
SLIDE 1

Pico Lantern & Megalodon

Thomas Demarcy, Asclepios Research Team

Edgcumbe, P., Pratt, P., Yang, G.: Pico Lantern: A Pick-up Projector for Augmented Reality in Laparoscopic Surgery. MICCAI 432–439 (2014).

slide-2
SLIDE 2

Introduction

  • Doctors are confronted with more imaging data
  • 2
slide-3
SLIDE 3
  • 3D imaging on 2D screen
  • far away from operating situ

laparoscopic stomach surgery

  • 3
slide-4
SLIDE 4

Augmented Reality in the Operating Rooms

  • 4

Sielhorst, T., Feuerstein, M., Navab, N.: Advanced Medical Displays: A Literature Review of Augmented

  • Reality. J. Disp. Technol. 4, 451–467 (2008).
slide-5
SLIDE 5

Augmented Reality in the Operating Rooms

  • 5

Sielhorst, T., Feuerstein, M., Navab, N.: Advanced Medical Displays: A Literature Review of Augmented

  • Reality. J. Disp. Technol. 4, 451–467 (2008).

arteriovenous malformation

slide-6
SLIDE 6

Augmented Reality in the Operating Rooms

  • 6

Sielhorst, T., Feuerstein, M., Navab, N.: Advanced Medical Displays: A Literature Review of Augmented

  • Reality. J. Disp. Technol. 4, 451–467 (2008).
slide-7
SLIDE 7

Augmented Reality in the Operating Rooms

  • Extra Value From Image Fusion
  • Implicit 3D Interaction
  • 3D Visualization
  • Improved Hand-Eye Coordination
  • 7

Benefits

Sielhorst, T., Feuerstein, M., Navab, N.: Advanced Medical Displays: A Literature Review of Augmented

  • Reality. J. Disp. Technol. 4, 451–467 (2008).
slide-8
SLIDE 8

Augmented Reality in the Operating Rooms

  • Registration, Tracking, and Calibration
  • Time Synchronization
  • Error Estimation
  • Visualization and Depth Perception
  • 8

Issues

Sielhorst, T., Feuerstein, M., Navab, N.: Advanced Medical Displays: A Literature Review of Augmented

  • Reality. J. Disp. Technol. 4, 451–467 (2008).
slide-9
SLIDE 9

Surface Reconstruction

  • Traditional cameras/imaging sensors  2D images
  • Lack the depth information
  • Structured light
  • 9
slide-10
SLIDE 10

Surface Reconstruction

  • Projector + 2D spatially varying intensity pattern
  • Imaging sensor acquires 2D image of the scene

under the structured-light illumination

  • Extraction of 3D surface based on the distortion
  • 10
slide-11
SLIDE 11

Surface Reconstruction

  • 11

Geng, J.: Structured-light 3D surface imaging: a tutorial. Adv. Opt. Photonics. 3, 128 (2011).

Projection Pattern point on the surface of the object point in the projection pattern

slide-12
SLIDE 12

Surface Reconstruction

  • 12

triangulation

slide-13
SLIDE 13

Laparoscopic Surgery

  • surgery technique
  • abdominal or pelvic cavities
  • through small incisions + (monocular) endoscope
  • minimally invasive
  • 13

laparoscopic stomach surgery

slide-14
SLIDE 14

Pico Lantern

  • A new combination of existing technologies
  • recent advances in laser-based pico projectors
  • Ø1.7 mm, fit in the biopsy channel of an endoscope
  • 14
slide-15
SLIDE 15

Pico Lantern - Pattern

  • Projection pattern : checkerboard
  • 15
slide-16
SLIDE 16

Pico Lantern - Reconstruction

  • Method 1 Stereo Endoscope and Untracked Pico Lantern
  • Method 2 Mono endoscope and Tracked Pico Lantern
  • 16
slide-17
SLIDE 17

Pico Lantern - Reconstruction

  • Method 1 Stereo Endoscope and Untracked Pico Lantern
  • Method 2 Mono endoscope and Tracked Pico Lantern
  • Wide baseline = better reconstruction accuracy…
  • … but Pico Lantern in FOV of the endoscope
  • 17
slide-18
SLIDE 18

Pico Lantern - Calibration

  • Projector calibration
  • Zang’s method, as a camera in reverse
  • 18

Bouguet, J.-Y.: Visual Methods for Three-dimensional Modeling, (1999). x, point in the projection pattern X, projected image point ? extrinsic projector parameters

slide-19
SLIDE 19

Pico Lantern - Calibration

  • 19

Bouguet, J.-Y.: Visual Methods for Three-dimensional Modeling, (1999). x, point in the projection pattern X, projected image point ? extrinsic projector parameters

  • X = R*x + T + radial distortion
  • optimization problem
slide-20
SLIDE 20

Pico Lantern – AR application

  • Accurate, low-cost, fast
  • in vivo measure of

pulsatile motion of the carotid artery

  • 20
slide-21
SLIDE 21

Megalodon

  • Pico Lantern = small lantern
  • Megalodon = big tooth
  • 21
slide-22
SLIDE 22

Megalodon

  • 22
slide-23
SLIDE 23

Thank you

  • 23