Empirical Studies & Domain Experts Alark Joshi Visualization - - PowerPoint PPT Presentation

Empirical Studies & Domain Experts

Alark Joshi

Visualization and Graphics Lab vgl.cs.usfca.edu

Empirical Studies

} Empirical - originating in or based on observation or

experience

} Share my experience of working with domain experts } Tool adoption by domain users (not necessarily primary

collaborator) is my measure of success

} “That swordsmith is successful whose clients die of old

age” –Frederick P . Brooks Jr,

Brooks Jr, Frederick P. "The computer scientist as toolsmith II." Communications of the ACM 39, no. 3 (1996): 61-68.

Visualizing Hurricanes

Alark Joshi, Jesus Caban, Penny Rheingans, Lynn Sparling, Case Study on Visualizing Hurricanes Using Illustration-Inspired Techniques, IEEE Transactions on Visualization and Computer Graphics, vol 15, no. 5, pp 709-718, Sept/Oct. 2009.

Visualizing Hurricanes

} Evaluation with two domain experts

} Formative evaluations conducted in the form of bi-weekly

interviews for over a year

} Evaluation with six application scientists in the weather

forecasting and modeling domain

} Summative evaluation to understand utility and potential

} “Over-engineering a tool” – Johanna Beyer } Tool was not adopted L

Visualization for Neurosurgery

1.

Visualization of multimodal data for neurosurgery

2.

Light sensitive visualization of neurosurgical structures

3.

Effective visualization of vascular structures

Visualization of Multimodal data

Electrode location visualization using the exploration tool User controlled spherical cropping of MRI data

Augmented Inline Visualization – Summative Evaluation with 8 neurosurgeons and residents Multimodal interaction – Summative evaluation with 2 neurosurgeons 16 participants with medical imaging expertise – students, scientists, surgeons

Tool Adopted J

This image shows a research workstation that can interface with the VVCranial software allowing for experiments involving image processing and visualization techniques. The research system is used for non-invasively obtaining information from the BrainLAB system and using it for prototyping research projects as well as training.

Maintaining Software is expensive! K

} BioImageSuite (http://bioimagesuite.yale.edu/)

“No incentive to go beyond the prototype stage” – Johanna Beyer

Empirical Studies

} Empirical studies should not be an afterthought

} Software testing has evolved to the Agile T

est-Driven Development rather than the waterfall model

} “Need to collaborate with human factors folks” to design

better empirical studies – Laura McNamara

} It should be ok to find results that show that your new

technique is worse than existing techniques in some/all(?) cases – Would we accept such a paper?

Questions?

apjoshi@usfca.edu. alark “If we perceive our role aright, we then see more clearly the proper criterion for success: a toolmaker succeeds as, and only as, the users of his tool succeed with his aid. However shining the blade, however jeweled the hilt, however perfect the heft, a sword is tested

• nly by cutting. That swordsmith is successful whose clients die of old

age.” – Fred Brooks Jr.

Papers on Visualization for Neurosurgery

}

Novel interaction techniques for neurosurgical planning and stereotactic navigation, Alark Joshi, Dustin Scheinost, Kenneth P . Vives, Dennis D. Spencer, Lawrence H. Staib and Xenophon Papademetris, IEEE Transactions on Visualization and Computer Graphics (VIS 2008), vol 14(6), 2008.

}

Unified framework for development, deployment and robust testing of neuroimaging algorithms, Alark Joshi, Dustin Scheinost, Hirohito Okuda, Dominique Belhachemi, Isabella Murphy, Lawrence H. Staib, Xenophon Papademetris, Journal of Neuroinformatics, January 2011.

}

Augmented inline-based navigation for stereotactic image guided neurosurgery, Alark Joshi, Dustin Scheinost, Ronen Globinsky, Kenneth P . Vives, Dennis D. Spencer, Lawrence H. Staib, Xenophon Papademetris, IEEE International Symposium on Biomedical Imaging - ISBI, April 2011.

}

Light-sensitive visualization of multimodal data for neurosurgical applications, Alark Joshi, Alex Papanastassiou, Kenneth P . Vives, Dennis D. Spencer, Lawrence H. Staib, Xenophon Papademetris, IEEE International Symposium on Biomedical Imaging - ISBI, April 2010.

}

Effective visualization of complex vascular structures using a non-parametric vessel detection method, Alark Joshi, Xiaoning Qian, Donald P . Dione, Ketan R. Bulsara, Christopher K. Breuer, Albert J. Sinusas and Xenophon Papademetris, IEEE Transactions on Visualization and Computer Graphics (VIS 2008), vol 14(6), 2008.