A METHODOLOGICAL FRAMEWORK FOR A METHODOLOGICAL FRAMEWORK FOR - PowerPoint PPT Presentation

A METHODOLOGICAL FRAMEWORK FOR A METHODOLOGICAL FRAMEWORK FOR RESEARCHING THE USABILITY OF THE RESEARCHING THE USABILITY OF THE SPACE - TIME CUBE SPACE - TIME CUBE IRMA KVELADZE, MENNO-JAN KRAAK & CORNÉ VAN ELZAKKER 26 th INTERNATIONAL CARTOGRAPHIC CONFERENCE 26 th INTERNATIONAL CARTOGRAPHIC CONFERENCE August 25 – 30, 2013 | Dresden Germany August 25 – 30, 2013 | Dresden Germany

Background Basics of time geography Framework Phases T T Y Y X X August 25 – 30, 2013 | Dresden Germany

Background So far Framework Phases Kwan (1999, 2004) Kraak (2003) Tominski (2005) Turdukulov (2007) Frank O. Ostermann (2010) Demšar & Virrantaus (2010) Hadlak, et.al (2010) Kraak (2008) Thakur and Hanson (2010) Authir (2011) Orellana, et.al (2012) Tominski, et.al (2012) August 25 – 30, 2013 | Dresden Germany

Background What do we know? Framework Phases Compare 2D map to the 3D STC Kristensson, et al. (2009) Compare the performance of a dot animation, 3D STC, and vessel density Willems, et al.(2011) 2D Evaluated discrete spatio-temporal data on stereoscopic displays 3D Kjellin, et al. (2010) Compare performance on 2D map, 3D STC and animation Kjellin, et al. (2010) Animation August 25 – 30, 2013 | Dresden Germany

Background Conceptual framework Framework Phases Problem Solution Evaluation August 25 – 30, 2013 | Dresden Germany

Problem identification Background Use cases Framework Phases Simple dataset ‘Napoleons Russian Campaign’ Complex annotations Travel log data: Estonia Complex dataset Pedestrian movements in Delft city center Large dataset Passive mobile phone positioning data of commuters, Tallinn August 25 – 30, 2013 | Dresden Germany

Consultation with cartographers Background Visual solution Framework Phases Geo Data Geo Data Design guideline Design guideline Visualization strategy Visualization strategy Object Analyze first Overview •Context └ user def selection •knowledge Functionality └ symbolization Location Attribute Time Zoom/Filter └ user def selection Functionality └ re-symbolization Analyze further •Explore Details Functionality └ re-symbolization Multiple linked views August 25 – 30, 2013 | Dresden Germany

Scenarios for visualization strategies Background Phase 1 Establishing workflows Framework Phases Interview Interview Domain expert Researcher Domain expert Researcher Establish Scenarios Data Data Establish Workflows Design Design Workflows Workflows August 25 – 30, 2013 | Dresden Germany

Multiple design options for the STC content Background Phase 2 Compile design Framework Phases August 25 – 30, 2013 | Dresden Germany

Validation of visualization strategies with domain experts Background Phase 3 Verification of workflow Framework Phases Researcher Researcher Assistance Assistance Interaction Interaction Domain expert Domain expert Workflow Workflow WORKFLOW FOR WORKFLOW FOR SCENARIOS SCENARIOS SCENARIO 3. SCENARIO 3. SCENARIO 2. SCENARIO 2. SCENARIO 1. SCENARIO 1. Overview Zoom/Filter Details Overview Zoom/Filter Details August 25 – 30, 2013 | Dresden Germany

Multiple design options - focus group Background Phase 4 Expert versus users Framework Phases Scenario - Different Design Scenario Workflow - Shneiderman’s Mantra Design 3 Design 1 Design 2 Design 3 Design 2 Design 1 Design Design Experts Experts Overview Overview Overview Overview Workflow Evaluation Evaluation Results Results Zoom/Filter Zoom/Filter Zoom/Filter Zoom/Filter Details Details Details Details August 25 – 30, 2013 | Dresden Germany

individual user test Multiple design options - Background Phase 5 Non expert versus users Framework Phases Methods Scenario - Different Design Scenario Workflow - Shneiderman’s Mantra Design 3 Design 1 Design 2 Design 3 Design 2 Design 1 Design Design • Task execution Participant Participant Overview Overview Overview Overview • Thinking aloud Workflow • Questionnaire Evaluation Evaluation Results Results Zoom/Filter Zoom/Filter Zoom/Filter Zoom/Filter • Eye tracking • Video / audio recording Details • Screen recording Details Details Details • Interview August 25 – 30, 2013 | Dresden Germany

Background Phase 6 STC in GVA environment Framework Phases STC in a STC in a GeoVisual GeoVisual Quantitative Quantitative analytics Qualitative analytics Qualitative Methods Methods Methods Methods environment environment •Task execution •Thinking aloud •Task execution •Thinking aloud •Questionnaire •Observation •Questionnaire •Observation •Eye tracking •Eye tracking •Screen logging •Screen logging •Interview •Interview Evaluation Evaluation Experts Non experts Group 1 Group 2 Group 1 Group 2 a d c b a d c b Results Results Results Results Results Results Results Results Compare Compare Compare Compare Conclusions on: Conclusions on: •Effectiveness •Effectiveness •Efficiency •Efficiency •Satisfaction •Satisfaction August 25 – 30, 2013 | Dresden Germany

Thank you!