Fusing Non Fusing Non- -Volumetric, Spatially Volumetric, - - PowerPoint PPT Presentation
Fusing Non Fusing Non- -Volumetric, Spatially Volumetric, Spatially- - Localized Data with Localized Data with V l V l Volumetric Data Volumetric Data i D i D Robert Weersink, Harsimran Braisch, Greg Bootsma David Jaffray Greg
High Resolution Volumetric Anatomic Anatomic
Anatomic
Post-
imaging Analysis
High Resolution Volumetric Anatomic Anatomic
Anatomic
Post-
imaging Analysis
Topography, Texture,
Colour/Contrast
Real-
time
CT & & Optical/endoscopic Optical/endoscopic imaging provide imaging provide complimentary data complimentary data p y p y
Future combined CT/Optical Probes will require “co-
visualization”
Puts molecular info into context of anatomical & functional information
Puts molecular info into context of anatomical & functional information
Diagnosis & margins more Diagnosis & margins more l l id ifi d d d fi d i l l id ifi d d d fi d i Treatment Planning & delivery Treatment Planning & delivery b d 3D D b d 3D D clearly identified and defined in clearly identified and defined in 2D Optical Domain 2D Optical Domain based on 3D Data based on 3D Data
Glottic
Data Fusion 2D 3D
Glottic
2D to 3D
Floor of Mouth
Diagnosis & margins defined in Diagnosis & margins defined in Laparoscopic surgery requires Laparoscopic surgery requires i i f i i f g g g g 3D CT Domain 3D CT Domain accurate registration of scope accurate registration of scope (& image) to CT (& image) to CT Data Fusion 3D to 2D 3D to 2D
While using a magnetic field generator, location of an object can be found using sensor coils that induce a voltage while in the presence of a varying magnetic field. magnetic field.
NDI Aurora System
Northern Digital. 2008
Tip of Endoscope
CT CS
CAMERA CS SENSOR WORLD CS SENSOR CS WORLD CS
Coronal View Simultaneous Video Rendered View with Tracking Tip Axial View
iti ( 50 X 50 X 100 )
R d ibilit A
Reproducibility, Accuracy
Precision: ±0 04 mm 0 04 mm
Positioning Plate Generator
Precision: ±0.04 mm 0.04 mm
Reproducibility: ± ±0.09 mm 0.09 mm
200
Original Measurements Systemic position error Systemic position error Transformed Measurements
200 100 150
y p y p corrected by applying a corrected by applying a polynomial transformation polynomial transformation to measured data to measured data
100 150
m)
50
to measured data to measured data Position Error Position Error
50
ition (mm
Original Original ± ± 8.8 mm 8.8 mm Transformed Transformed ± ± 3.6 mm 3.6 mm
Y Posi
100 200 300 400 500
100 200 300 400 500
Z Position (mm)
C pt r ri Capture a series
Known Targets; Known Targets; Calculate optical parameters
d
(
a b ) n;
y
O Y O
Original images: Corners identified, arrows showing distortion
Y X Y O X Y O X O X O
Corrected images
Addition of Targeted Probes
Combined Fluorescence & CT contrast
Creation of 3D images from multiple 2D images
Surface contouring from scope images overlayed on to CT
Integrating other data: i.e. database of other clinically l t d t l t d t relevant data relevant data
Biopsies, microscope imaging, etc.
Clinical Testing
Clinical Testing
RT planning for H&N; Endoluminal; Lung Surgical Guidance Guidance
Current: Autofluorescence
Future: Fluorescent for disease detection for disease detection molecular contrast agents molecular contrast agents
Prescan Prescan
Targeting HDL nanocarrier to folate receptors: G. Zhang
Round surfaces of tissue may make this difficult
Srikumar Ramalingam Chunxiao Zhou Department of Computer Science Department of Computer Engineering University of California, Santa Cruz
Round surfaces of tissue may make this difficult
Surgery (J. Irish) Radiation Treatment planning (Andrew Hope) Radiation Treatment planning (Andrew Hope)
Radiation Treatment planning (Andrew Hope)
Surgery (A. Pierre)
Likely will be different for each indication
Create Innovate Translate Evaluate