Task Model-based Usability Evaluation for Smart Environments Stefan - - PowerPoint PPT Presentation

▶
task model based usability evaluation for smart
SMART_READER_LITE
LIVE PREVIEW

Task Model-based Usability Evaluation for Smart Environments Stefan - - PowerPoint PPT Presentation

Dec 10, 2023 302 likes •585 views

Task Model-based Usability Evaluation for Smart Environments Stefan Propp Software Engineering Group University of Rostock Outline 1. Introduction 2. Usability Evaluation Method 2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase

slide-1
SLIDE 1

Task Model-based Usability Evaluation for Smart Environments

Stefan Propp Software Engineering Group University of Rostock

slide-2
SLIDE 2

28.06.2008 Stefan Propp 2

Outline

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-3
SLIDE 3

28.06.2008 Stefan Propp 3

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-4
SLIDE 4

28.06.2008 Stefan Propp 4

  • 1. Introduction - Smart Environment
  • Smart Environment

– Combines everyday appliances and environments to form an ensemble – Individual features are composed to build more complex features – Example:

slide-5
SLIDE 5

28.06.2008 Stefan Propp 5

  • 1. Introduction - MuSAMA
  • MuSAMA Project (14 PhD Students)
  • Idea:
slide-6
SLIDE 6

28.06.2008 Stefan Propp 6

  • 1. Introduction - Smart Environments
  • Characteristic of Human-Environment Interaction:

[Shirehjini: A Multidimensional Classification Model for the Interaction in Reactive Media Rooms, 2007.]

– Explicit vs. implicit initiative – Function vs. goal-based – Direct vs. dynamic device selection – Macros vs. dynamic strategy planning – Modalities (e.g. speech, gesture, …) – Etc.

  • Problems concerning the Usability Evaluation:

– Users changing location → difficult to observe – Changing context influences the system behavior – Transitions between devices (one task, many devices) (starting a task on one device and finshing it on another devices) – Cooperative work (one task, many users) (accomplishing a task cooperatively)

slide-7
SLIDE 7

28.06.2008 Stefan Propp 8

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-8
SLIDE 8

28.06.2008 Stefan Propp 9

  • 2. Usability Evaluation Method

UserModel Test Case UE-Sim Analysis UE-Sim Test Case Execution

(incl. Task Event Trace)

TaskModel

Modelling

(1)

Test Execution

(3)

Analysis

(4)

Usability Expert

Model Editors Simulation Engine (incl. HTTP Server) Analysis Engine TaskModel (Coordination) TaskModel TaskModel DeviceModel TaskModel TaskModel TaskModel

Developer

Test Planning

(2)

Model Data User Interactions Parameter Results

slide-9
SLIDE 9

28.06.2008 Stefan Propp 10

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-10
SLIDE 10

28.06.2008 Stefan Propp 11

2.1 Modelling - Method

  • Related work

– Task Modelling (different notations: e.g. CTT, HTA, GOMS, …)

[Limbourg, Vanderdonckt: Comparing Task Models for UI Design, 2003.]

– Task Modelling for Smart Environments

  • Composing task model chunks to room task models

[Trapp, Schmettow: Consistency in use through Model based User Interface Development, CHI2006.]

  • Interpreting task models at runtime

[Feuerstack et al.: Prototyping of Multimodal Interactions for Smart Environments based on Task Models, AMI Workshop 2007.]

  • Modelling cooperative behavior with additional constraints

[Wurdel, Propp, Forbrig: HCI-Task Models and Smart Environments, HCIS 2008.]

slide-11
SLIDE 11

28.06.2008 Stefan Propp 12

2.1 Modelling – Tool

slide-12
SLIDE 12

28.06.2008 Stefan Propp 13

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-13
SLIDE 13

28.06.2008 Stefan Propp 14

2.2 Test Planinng - Method

  • „Usability Test Case“

– Test plan with textual information (e.g. purpose, environment description, evaluation measures)

[Rubin, J.: Handbook of usability testing. Wiley technical communication library, 1994.]

– User and device models (in CTT like notation)

slide-14
SLIDE 14

28.06.2008 Stefan Propp 15

2.2 Test Planning - Tool

slide-15
SLIDE 15

28.06.2008 Stefan Propp 16

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-16
SLIDE 16

28.06.2008 Stefan Propp 17

2.3 Test Execution – Method

validate models (in- consistent tasks or relations) Goal interactively walk through the models (inspection, testing) Process models Test Object early st. (Requirements analysis, Design) Stages

  • Related Work: [Klug: Computer Aided Observations of Complex Mobile Situations, CHI 2007.]

discover potential problems, for subsequent detailed analysis of videos etc. automatically: HTTP- connection to environment, manually: annotations of the expert (Testing) running system later stages (Development, Deployment)

slide-17
SLIDE 17

28.06.2008 Stefan Propp 18

2.3 Test Execution - Tool

slide-18
SLIDE 18

28.06.2008 Stefan Propp 19

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Test Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-19
SLIDE 19

28.06.2008 Stefan Propp 20

2.4 Analysis – Method (Pipeline)

Capturing Interaction Traces Merging Filtering Aggregation Trace Trace Trace Trace Trace Trace Normalization Trace

slide-20
SLIDE 20

28.06.2008 Stefan Propp 21

Semantic Lens

slide-21
SLIDE 21

28.06.2008 Stefan Propp 22

2.4 Analysis - Tool

  • Related work:

– [Malý, I., Slavík, P.: Towards Visual Analysis of Usability Test Logs. Tamodia 2006.] – [Paternò, Russino, Santoro: Remote evaluation of Mobile Applications. Tamodia 2007.]

slide-22
SLIDE 22

28.06.2008 Stefan Propp 23

2.4 Analysis - Method

  • Support the process of error discovery and

error decomposition: “

– (1) imprecise sensor values (e.g. wrong location values), – (2) misinterpretations of sensor values (e.g. when applying a faulty user movement model to clean the raw sensor data), – (3) intention recognition errors (e.g. when predicting the wrong user task) and – (4) planning errors (e.g. when delivering the wrong functionality)“

[Wurdel, Propp, Forbrig: HCI-Task Models and Smart Environments, HCIS 2008.]

slide-23
SLIDE 23

28.06.2008 Stefan Propp 24

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-24
SLIDE 24

28.06.2008 Stefan Propp 25

  • 3. User Guidance
  • Idea: interactions already captured, can be

further used for guidance

  • Visualizing the current state of task

fulfillment

– History: captured interactions – Future: (1) task models include temporal relations, (2) further annotations for probabilities

[Giersich M., Forbrig P., Fuchs G., Kirste T., Reichart D., Schumann H.: Towards an integrated approach for task modeling and human behavior recognition. HCII 2007, vol. I, pp. 1109- 1118, 2007.]

  • Goal: visualize progress within the system

transparently to improve user acceptance

slide-25
SLIDE 25

28.06.2008 Stefan Propp 26

  • 1. Introduction
  • 2. Usability Evaluation Method

2.1 Phase 1: Modelling 2.2 Phase 2: Planning 2.2 Phase 3: Test Execution 2.3 Phase 4: Analysis

  • 3. User Guidance
  • 4. Conclusion & Future Work
slide-26
SLIDE 26

28.06.2008 Stefan Propp 27

  • 4. Conclusion & Future Work
  • Usability Evaluation Method

– Task-based approach of Usability Testing – Support of both: early and later development stages (simulation / execution) – Tool support integrates development and usability (conceptual and implementtational)

  • Future Work:

– Incorporation of further Sensor values (Ubisense location detection, device states, …) – Usability Test within our Smart Environment

slide-27
SLIDE 27

28.06.2008 Stefan Propp 28

? | !