VRPS YC: Lab VRPS YC: Lab VRPS YC: Lab VR/ Games to Motivate - PDF document

Virtual Iraq: Virtual Iraq: Virtual Reality Cognitive Performance Assessment Test Virtual Reality Cognitive Performance Assessment Test Thomas D. Parsons, PhD Research Scientist, Neuropsychologist Assistant Research Professor Co-director of VRPSYCH Lab Institute for Creative Technologies University of Southern California tparsons@usc.edu Virtual Iraq Virtual Iraq Virtual Classroom Virtual Classroom Virtual Classroom VR Classroom VR Classroom Funded by Funded by VRPS YC: Lab VRPS YC: Lab VRPS YC: Lab VR/ Games to Motivate Motor Rehabilitation VR/ Games to Motivate Motor Rehabilitation Virtual Patients Virtual Patients Virtual Patients Virtual Reality & S ocial Neuroscience Virtual Reality & S ocial Neuroscience Virtual Reality & S ocial Neuroscience 2

VRPSYCH Lab: Collaborators VRPSYCH Lab: Collaborators  Institute for Creative Technologies – Rizzo, Pair, Gratch, Marsala, Hill, Swartout, Morie – Rizzo, Pair, Gratch, Marsala, Hill, Swartout, Morie  Brain and Creativity Institute – Antonio and Hanna Damasio – Antonio and Hanna Damasio  Child Psychiatry – Pato, Pataki, Sugar  Integrated Media Systems Center – – Sawchuck, Yeh Sawchuck, Yeh  Annenberg School for Communication/Journalism – – McLaughlin McLaughlin  School of Biokinesiology and Physical Therapy – – Winstein, Flynn Winstein, Flynn  Department of Psychology – – Davison, Arbib Davison, Arbib  Children’s Hospital Los Angeles – – Gold, Katz Gold, Katz  School of Gerontology, Neurology – Zilenski, Chui – Zilenski, Chui 3 VRPSYCH Lab: Collaborators VRPSYCH Lab: Collaborators  Center for Study of Human Operator Performance  University of Minnesota  UCSF Dynamic Multimodal Imaging Lab  UCSD & VR Medical Center  Yale University  Kessler Medical Rehab Center Virtually Better  LA Children’s Hospital  St. John’s University  North Carolina A&T State University  Utah Neurodevelopment Center  Columbia University   Emory University 4

ARL Neuroscience STI ARL Neuroscience STI Integrate State-of-the-Art in Neuroscience Advance State-of-the-Art in Neuroscience Other Academia 5 VRPSYCH Lab VRPSYCH Lab Social Neuroscience: Integrated Interdisciplinary Focus Emotion Modelling & Neuroscience methods  Neuropsychological Assessment Regulation  Psychophysiological  Social psychological topics  Neuroimaging  Attitude change  Stereotyping 6

Social Neuroscience: VRPSYCH Lab Projects Emotion Models & Regulation Neuroscience methods •Virtual Standardized Patients •Visuospatial Processes •Justin/Justina •VRClassroom/Office/Apartment •Startle eye-blink and bias •VEGS •Panoramic (Anger Management) •VRCPAT (NP Assess) •VR Exposure Therapy •Psychophys Correlates 7 VRPSYCH Lab VRPSYCH Lab The S tudy of Brain/ Behavior Relationships The S tudy of Brain/ Behavior Relationships 8

Physiology Physiology Multisensory Neuropsyc Multisensory Neuropsyc Assessment Assessment Simulations Assessment Simulations Assessment Scent Bass S Bass S haker haker Scent S S tandard Tests tandard Tests Biopac S Biopac S ystem ystem Platform System System Platform Stimulus Stimulus Trait State Gunpowder Trait State   Cordite Delivery  Body Odor Delivery  Garbage  Burning Rubber  Diesel Fuel Night Vision Night Vision  Iraqi Spices VR Tests VR Tests HMD Rig HMD Rig… … 9 Neuropsychological Assessment Neuropsychological Assessment  Standardized tests used in a neuropsychological evaluation typically assess functioning in the following areas: – Attention - Learning and Memory – Executive functions - Visual-spatial functions – Language functions - Sensory-Perceptual functions – Processing Speed - Motor functions  Academic skill development and emotional functioning are typically assessed as well. 10

Neuropsychological Assessment Neuropsychological Assessment • Advantages: – Cognitive functioning • Broad Spectrum of brain functioning – Standardized procedures • Psychometrically sound • Reliable scoring methods 11 Neuropsychological Assessment Neuropsychological Assessment • Disadvantages: –Outmoded Tests • using methods developed 60-100 years ago! –Ecological Validity • Relevance to real world functioning 12

Neuropsychological Tests (1905) Neuropsychological Tests (1905) Binet (1905) Binet (1905) Drawing a Design from Memory Drawing a Design from Memory 13 Neuropsychological Tests (Now) Neuropsychological Tests (Now) Wechsler Memory Scale: Wechsler Memory Scale: Visual Reproduction Subtest Visual Reproduction Subtest 14

Neuropsychological Tests (1917) Neuropsychological Tests (1917) The Manikin Test: Developed by Pitner- Patterson, 1917 15 Neuropsychological Tests (Now) Neuropsychological Tests (Now) Now the “Object Assembly” Subtest on the WAIS, WISC 16

Neuropsychological Tests (1915) Neuropsychological Tests (1915) Kohs Blocks (1915) 17 Neuropsychological Tests (Now) Neuropsychological Tests (Now) Now the “Block Design” Subtest on the WAIS, WISC, etc. 18

Neuropsychological Tests Neuropsychological Tests Are we st ill limit ed t o using met hods developed 60-100 years ago! 19 Computerized Neuropsych Tests Computerized Neuropsych Tests ANAM Mathematical Manikin Tower Puzzle Processing Test 20

Computerized Neuropsych Tests Computerized Neuropsych Tests Slide on stimulus complexity -SIMPLE = Numbers in middle of screen -COMPLEX = Numbers presented Mathematical Tower Puzzle Manikin Processing Test randomly throughout the screen 21 Computerized Neuropsych Tests Computerized Neuropsych Tests Attention: Simple Presentation Mathematical Manikin Tower Puzzle Processing Test 22

Computerized Neuropsych Tests Computerized Neuropsych Tests Attention: Simple Presentation Mathematical Tower Puzzle Manikin Processing Test 23 Computerized Neuropsych Tests Computerized Neuropsych Tests Attention: Simple Presentation Mathematical Manikin Tower Puzzle Processing Test 24

Computerized Neuropsych Tests Computerized Neuropsych Tests Attention: Complex Presentation Mathematical Tower Puzzle Manikin Processing Test 25 Computerized Neuropsych Tests Computerized Neuropsych Tests Attention: Complex Presentation Mathematical Manikin Tower Puzzle Processing Test 26

Computerized Neuropsych Tests Computerized Neuropsych Tests Attention: Complex Presentation Mathematical Tower Puzzle Manikin Processing Test 27 Neuropsychological Tests Neuropsychological Tests Relevance to Real World Functioning 28

Neuropsychological Tests Neuropsychological Tests Relevance to Real World Functioning 1. Apple 2. Car 3. Pear 4. Banana 29 Virtual Iraq Virtual Iraq

Virtual Iraq: VRET & VRCPAT Virtual Iraq: VRET & VRCPAT The Vision… The Vision… •Re c yc le F SW •Highly c o ntro llable •Co nte xt re le vant •Psyc ho me tric ally so und •Co nstruc t Valid •E c o lo gic ally Valid 31 Full Spectrum VR Exposure Full Spectrum VR Exposure Therapy for Iraq War PTSD Therapy for Iraq War PTSD Funded by Funded by 32

Virtual Reality Cognitive Performance Virtual Reality Cognitive Performance Assessment Test (VRCPAT) (VRCPAT) Assessment Test Military Relevance Military Relevance 34

VRCPAT: Mixed Reality Scenario VRCPAT: Mixed Reality Scenario (currently being developed) (currently being developed) VRCPAT: Mixed Reality VRCPAT: Mixed Reality 36

VRCPAT: Mixed Reality VRCPAT: Mixed Reality FlatWorld based Urban Terrain Module: Ft. Sill Oklahoma 37 VRCPAT: Mixed Reality VRCPAT: Mixed Reality FlatWorld based VRCPAT Executive Executive Attn Attn Functions Functions Reaction Reaction Time Time Memory Memory 38

VRCPAT: Mixed Reality VRCPAT: Mixed Reality FlatWorld based VRCPAT Executive Executive Functions Functions 39 VRCPAT: HMD Scenario VRCPAT: HMD Scenario

Neurocognitive Domains Neurocognitive Domains Currently assessed: • Attention • Learning and Retrieval (Memory) • Information processing speed To be developed: • Language/Verbal Skills • Executive Function • Visuospatial perception 41 Virtual Reality Cognitive Performance Virtual Reality Cognitive Performance Assessment Test (VRCPAT) Assessment Test (VRCPAT) MEMORY MODULE MEMORY MODULE ENCODING ENCODING (getting the information in) (getting the information in) CONSOLIDATION CONSOLIDATION (transferring information into long- -term store) term store) (transferring information into long RETRIEVAL RETRIEVAL (getting the information out) (getting the information out)

Study 1: Memory Module Study 1: Memory Module Parsons, T.D., and Rizzo, A.A. (2008). Initial Validation of a Virtual Environment for Assessment of Memory Functioning: Virtual Reality Cognitive Performance Assessment Test. Cyberpsychology and Behavior, 11, 17-25. 43 Study 1: Memory Module Study 1: Memory Module  Neuropsychological battery – Pencil/paper tests: including Self- reports and Demographics  Virtual Reality (VRCPAT) – Learning Phase: Trials 1–3 (Similar to HVLT & BVMT-R) – VR Acclimation Phase – VRCPAT Immersion Phase  Capture images of 10 items (from Acquisition Phase: Trials 1-3)  2 images at each of the 5 Zones  Time limit = 1 min. for each Zone  Actual immersion is around 15 min. 44