Boundary Conditions for Information Visualization with respect to - - PowerPoint PPT Presentation

▶
boundary conditions for information visualization with
SMART_READER_LITE
LIVE PREVIEW

Boundary Conditions for Information Visualization with respect to - - PowerPoint PPT Presentation

Jan 12, 2023 249 likes •504 views

Technische Universitt Mnchen Boundary Conditions for Information Visualization with respect to the Users Gaze Marcus Tnnis, Gudrun Klinker {toennis,klinker}@in.tum.de Tnnis, Klinker - Boundary Conditions for Information

slide-1
SLIDE 1

Technische Universität München

Boundary Conditions for Information Visualization with respect to the User’s Gaze

Marcus Tönnis, Gudrun Klinker {toennis,klinker}@in.tum.de

Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze

slide-2
SLIDE 2

Technische Universität München Fachgebiet Augmented Reality

Motivation

  • Information placed w.r.t. the user’s gaze

– Is always near to the visual attention of the user – Bears the potential for fast information retrieval

  • No need to search for world- or screen-fixed location
  • Known position relative to line of sight
  • Application

– Heart-rate monitoring during surgery – Automotive speed monitoring – Task description in complex and dense lists

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 2

slide-3
SLIDE 3

Technische Universität München Fachgebiet Augmented Reality

General Issue and Concept

  • Information directly at the user’s gaze

– Constantly in foveal field of view – Constantly occludes the world

  • A rigid angular offset to line of sight

– Impossible to capture – Prohibits information access

  • Approach: Information

has angular offset w.r.t. line of sight

– Look around freely – Capture information when necessary

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 3

slide-4
SLIDE 4

Technische Universität München Fachgebiet Augmented Reality

Issues under Investigation

  • Boundary conditions

– Information placement – Alignment of information – Motion behavior of information

  • Information capture

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 4

slide-5
SLIDE 5

Technische Universität München Fachgebiet Augmented Reality

Information Placement

  • Offset direction

– Direction might depend on application – Decision on direction left to application developer

  • Angular distance

– Minimum

  • Outside foveal field of view
  • No peripheral fixation

– Maximum

  • Noticeable at all
  • Not in peripheral field of view (no brightness changes perceived)
  • Comfortably reachable by a glance

– Expert study settled 8 degree

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 5

slide-6
SLIDE 6

Technische Universität München Fachgebiet Augmented Reality

Alignment of Information

  • Alignment of direction

– Two main frames of reference

  • World-mounted
  • Head-mounted

World-mounted Head-mounted

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 6

slide-7
SLIDE 7

Technische Universität München Fachgebiet Augmented Reality

Alignment of Information

  • Alignment of direction

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 7

slide-8
SLIDE 8

Technische Universität München Fachgebiet Augmented Reality

Alignment of Information

  • Alignment of information content

– Two main frames of reference

  • Head-mounted
  • World-mounted

World-mounted Head-mounted

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 8

slide-9
SLIDE 9

Technische Universität München Fachgebiet Augmented Reality

Alignment of Information

  • Alignment of information content

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 9

slide-10
SLIDE 10

Technische Universität München Fachgebiet Augmented Reality

Motion Behavior of Information

  • Relative positioning of information
  • Three alternatives / variants

– Rigid offset – Velocity-based floating

  • Gaze may not surpass information
  • Gaze may surpass information

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 10

slide-11
SLIDE 11

Technische Universität München Fachgebiet Augmented Reality

Information Capture

  • Rigid offset

– Information constantly 8 degree off – Capture by analysis of eye motion history – Three states required for capture

1. Gaze must not have moved for at least 50 ms 2. Saccade must have been performed within 50 ms 3. Target location must have been fixated for 200 ms and lie within 2.8 degrees around location of information

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 11

slide-12
SLIDE 12

Technische Universität München Fachgebiet Augmented Reality

Information Capture

  • Velocity-based floating

– Average angular speed towards and away information is calculated

  • ver last 80 ms

– Delta angle is derived from speed and rendering rate – General push-back mechanism

  • If angular speed below 50 degree per seconds
  • Push back at 5 degree per second

– Capture

  • Collision of gaze with information for 100 ms
  • Common fixation time

– Non-overexceeding variant: Gaze pushes information along – Overexceeding variant: Gaze can surpass information (floats back through line of sight)

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 12

slide-13
SLIDE 13

Technische Universität München Fachgebiet Augmented Reality

Information Capture

  • Velocity-based floating

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 13

slide-14
SLIDE 14

Technische Universität München Fachgebiet Augmented Reality

User Study

  • 12 volunteers (mean age

29.8, SD 4.5)

  • Procedure (1. part)

– Calibration to individual user – Guided interview with questionnaire

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 14

slide-15
SLIDE 15

Technische Universität München Fachgebiet Augmented Reality

User Study

  • Procedure (2. part)

– Performance tests (for all 3 variants)

1. Start-Goal gazing – Assessment of accidental captures 1. Look at start 2. Look at goal 2. Start-Capture – Assessment of time and number of glances to capture information 1. Look at start 2. Capture information

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 15

slide-16
SLIDE 16

Technische Universität München Fachgebiet Augmented Reality

Results – Guided Interview, …

  • Frames of reference

– 91.7 % for world-related directional offset – 75 % for world-related information alignment

  • Visible floating

– 91.7 % for no floating of information – If floating, 75 % for no overexceeding of information

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 16

slide-17
SLIDE 17

Technische Universität München Fachgebiet Augmented Reality

Results – Objective Measurements

  • Start-Goal gazing (assessment of accidental captures)

– No significant results

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 17

slide-18
SLIDE 18

Technische Universität München Fachgebiet Augmented Reality

Results – Objective Measurements

  • Mean number of saccades to information capture

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 18

slide-19
SLIDE 19

Technische Universität München Fachgebiet Augmented Reality

Results – Objective Measurements

  • Number of captures with a single saccade

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 19

slide-20
SLIDE 20

Technische Universität München Fachgebiet Augmented Reality

Results – Objective Measurements

  • Time to information capture (ms)

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 20

slide-21
SLIDE 21

Technische Universität München Fachgebiet Augmented Reality

Results – Objective Measurements

  • Time to information capture with single saccade

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 21

slide-22
SLIDE 22

Technische Universität München Fachgebiet Augmented Reality

Discussion

  • Vast majority in favor for motion history algorithm (rigid
  • ffset)
  • Yet no complete implementation of algorithm, however

already

– 54.8 % capture rate with a single glance – 583ms average capture time

  • Observation

– Comparably slow gaze turn when requested to ,,quickly`` look at information – Transporting the concept in spoken words is not an easy task

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 22

slide-23
SLIDE 23

Technische Universität München Fachgebiet Augmented Reality

Conclusion

  • Placing information with respect to the line of sight

– New means for information visualization and interaction – Bears the potential to keep resuming times for the main task short

  • Boundary conditions first

– World frame of reference – Less animation is preferred

  • Future work

– Ruggedize capture algorithms – Test

  • With specific application tasks
  • Against conventional strategies such as screen- and world-fixed information placement

14.03.2014 Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze 23

slide-24
SLIDE 24

Technische Universität München

Boundary Conditions for Information Visualization with respect to the User’s Gaze

Marcus Tönnis, Gudrun Klinker {toennis,klinker}@in.tum.de

Tönnis, Klinker - Boundary Conditions for Information Visualization with respect to the User’s Gaze