EYE TRACKING IN GEO DATA MANAGEMENT
- Dr. Kristien Ooms; Ghent University
Kristien.Ooms@UGent.be
GEO DATA MANAGEMENT Dr. Kristien Ooms; Ghent University - - PowerPoint PPT Presentation
EYE TRACKING IN GEO DATA MANAGEMENT Dr. Kristien Ooms; Ghent University Kristien.Ooms@UGent.be Time Type Trial L POR X [px] L POR Y [px] 15256356851 SMP 1 589,64 590,82 W HAT IS EYE TRACKING ? 15256365267 SMP 1 586,6 587,1
Kristien.Ooms@UGent.be
2
Eye Tracking for GeoDataManagement - Kristien Ooms
Time Type Trial L POR X [px] L POR Y [px] 15256356851 SMP 1 589,64 590,82 15256365267 SMP 1 586,6 587,1 15256373592 SMP 1 824,04 396,63 15256390210 SMP 1 589,08 584,7 15256398588 SMP 1 592,91 580,93 15256406933 SMP 1 588,32 578,83 15256423568 SMP 1 594,35 580,26 15256431942 SMP 1 594,57 579,7 15256440305 SMP 1 598,26 575,05 15256448557 SMP 1 598,33 571,11 15256456954 SMP 1 597,96 569,4 15256465310 SMP 1 597,92 571,55 15256481930 SMP 1 600,35 570,2 15256490314 SMP 1 601,55 571,8 15256498681 SMP 1 603,14 568,78
4
Eye Tracking for GeoDataManagement - Kristien Ooms
Yarbus (1967)
Source: http://psych.wfu.edu/art_ schirillo/articles/Buswell,%201935.pdf
5
Solving usability problems
Eye Tracking for GeoDataManagement - Kristien Ooms
6
Eye Tracking for GeoDataManagement - Kristien Ooms
7
Eye Tracking for GeoDataManagement - Kristien Ooms
8
DESIGNING AND CONDUCTING USER RESEARCH
9
dispersion = ??? (40px; 0.5° visual angle; …)
minimum duration = ??? (80 – 150 ms)
Eye Tracking for GeoDataManagement - Kristien Ooms
10
Eye Tracking for GeoDataManagement - Kristien Ooms
11
Eye Tracking for GeoDataManagement - Kristien Ooms
“Information processing is guided by higher level mental processes. When we construct our perception drawing on our past experiences and expectations” “The most basic sensation and perception. Entry Level” sensory analysis”
12
∙ Number of fixations, overall ∙ Gaze % (proportion of time) on each of the AOIs ∙ Fixation duration mean, overall ∙ Number of fixations on each of the AOI ∙ Gaze duration mean, on each of the AOI ∙ Fixation rate,overall (fixation/saccades)
Eye Tracking for GeoDataManagement - Kristien Ooms
13
Eye Tracking for GeoDataManagement - Kristien Ooms
14
Eye Tracking for GeoDataManagement - Kristien Ooms
15
Eye Tracking for GeoDataManagement - Kristien Ooms
16
Eye Tracking for GeoDataManagement - Kristien Ooms
LIEN DUPONT ANNELIES INCOUL PEPIJN VIAENE LIESELOT LAPON …
18
Which elements in a landscape catch the attention and in which context are they most eye-catching? Important for the location of new infrastructures Observer Representation Landscape
Observations of landscapes are influenced by…
Eye Tracking for GeoDataManagement - Kristien Ooms Lien Dupont
19
‒ Focal length, horizontal and vertical view angles
‒ Degree of openness ‒ Degree of heterogeneity
‒ Landscape experts versus novices
‒ Degree of urbanisation ‒ Landscape experts versus novices ‒ Predict viewing pattern?
Experiment 1 Experiment 2 Experiment 3
Eye Tracking for GeoDataManagement - Kristien Ooms
20
Focal length Horizontal view angle Vertical view angle a) Panoramic photograph 50mm 70° 20,9° b) Standard photograph 50mm 31° 20,9° c) Zoom 1 70mm 22,4° 15° d) Zoom 2 100mm 15,8° 10,5° e) Wide angle photograph 18mm 75,1° 54,3°
Eye Tracking for GeoDataManagement - Kristien Ooms
21
Open Semi-open Enclosed
Homogeneous Heterogeneous
Eye Tracking for GeoDataManagement - Kristien Ooms
22
Eye Tracking for GeoDataManagement - Kristien Ooms
23
More information extraction
Easier information extraction
Stronger visual exploration
Weaker visual exploration
Weaker visual exploration
Eye Tracking for GeoDataManagement - Kristien Ooms
24 Eye Tracking for GeoDataManagement - Kristien Ooms
Expert Novice
More fixations & saccades Less fixations & saccades Shorter fixations Longer fixations Longer scan path Shorter scan path Larger visual span Smaller visual span Smaller Voronoi cells Larger Vorornoi cells
Scan paths Focus maps Voronoi cells
25
1050 x 1680 matrices
Correlation between focus maps and saliency maps?
Saliency map Focus map
Eye Tracking for GeoDataManagement - Kristien Ooms
26
▪ Research Questions
Eye Tracking for GeoDataManagement - Kristien Ooms Fanny Van Den Haute
27
Eye Tracking for GeoDataManagement - Kristien Ooms
28
Eye Tracking for GeoDataManagement - Kristien Ooms
29
WIND TURBINES HAVE A VISUAL IMPACT EXPERTISE HAS NO INFLUENCE ON VIEWING PATTERN TYPE OF LANDSCAPE HAS INFLUENCE ON VIEWING PATTERN
Eye Tracking for GeoDataManagement - Kristien Ooms
30
Eye Tracking for GeoDataManagement - Kristien Ooms
Pieter Laseure
31
LM TM
25 novice participant; some removed 3 expert participants 8 stimuli & questions for LM 8 stimuli & questions for TM
Similar questions Mixed Alternate
Quantitative analyses
Response time Score Fixation duration Saccadic length
Qualitative analyses
Eye Tracking for GeoDataManagement - Kristien Ooms
32 Students’ response time Students’ nr of fixations per second
GROUP nr
LM
TM PREFERENCE
Students 25 5,48/10 8,3/10 TM (25/25) Experts 3 4,75/10 8/10 TM (3/3) Participants’ preference and score attributed to the models Students’ fixation duration Students’ saccadic length Students’ score Eye Tracking for GeoDataManagement - Kristien Ooms
33 Eye Tracking for GeoDataManagement - Kristien Ooms
34
Part. Gender SCANPAD STRING P01 M MMBACCDEDCCCCDDEEBBBBBCBCDEDDE EDDSWWRSSSSSSSSSSSSSSNSRWSSSSS SSSWWSSMNSSDEEDCCDDDEFDDRSXWS P02 F MLAABBBBCCDDDDDDDEDEEDDDWWXSSR RRSSSSSSSSWCDEEXWSXSSWXSSSSSSS WSSSSSSSNSRDEBDDRSSSSSNNSSSRRM MLRRNSSWXXXXWXDDEWSSSSSSNSNSSS SWNSSSSS P03 M MMHBABBCDDCCDERWSSSSSXXIDEBBBBC CCCDDDEESSSXXRSSSSSSSXDESRRWSSS SNSSSSSSSD P05 F MMLBCCCCDDDDEENXXWSSSSSSSSSSXW RCDDCBCBBRSSSRSWWRMRLLIRRWWR P06 F MMBBABBCDDDEEDEDEWWWWWXSSSSSS SRSSSSSWSSSXXWSSWN
Scanpad String Similarities Eye Tracking for GeoDataManagement - Kristien Ooms
35 Eye Tracking for GeoDataManagement - Kristien Ooms
36
Eye Tracking for GeoDataManagement - Kristien Ooms
Annelies Incoul
37
Eye Tracking for GeoDataManagement - Kristien Ooms
38
Eye Tracking for GeoDataManagement - Kristien Ooms
39
Eye Tracking for GeoDataManagement - Kristien Ooms
40 Eye Tracking for GeoDataManagement - Kristien Ooms
Mean search times (P = 0.956 > 0.05) Fixations per second (P < 0.000)
Digital maps were less difficult to interpret than paper maps
Mean fixation duration (P = 0.210 > 0.05)
Shorter saccades digital maps
1 2 3 4 5 6 paper digital paper digital paper digital paper digital 1 2 3 4 5 6
Fixation count Fixation duration
41
Eye Tracking for GeoDataManagement - Kristien Ooms Rasha Deeb
42
Eye Tracking for GeoDataManagement - Kristien Ooms
43
31 participants 15 experts
16 novices
Eye Tracking for GeoDataManagement - Kristien Ooms
44
Color system Design conditions Display conditions HSV RGB CIE XYZ Color No. H° S% V% R G B L* (D65) a* (D65) b* (D65) X Y Z 1 0, 100 100 255 69.9 95.7 77.5 76.09 40.18 4.617 2 30 100 100 255 128 86.0 48.6 79.7 88.28 67.98 11.92 3 60 100 100 255 255 121.8
101.1 140.21 167.63 34.10 4 90 100 100 128 255 115.3
90.3 81.46 145.01 33.79 5 120 100 100 255 112.3
86.9 65.28 135.30 32.49 6 150 100 100 255 128 111.2
40.6 68.50 131.85 76.55 7 180 100 100 255 255 116.5
98.45 149.03 257.74 8 210 100 100 128 255 70.6 20.4
46.27 41.60 232.25 9 240 100 100 255 45.6 87.8
33.45 14.97 222.16 10 270 100 100 128 255 55.5 94.3
49.45 23.41 223.65 11 300 100 100 255 255 71.7 101.5
83.62 43.21 52.41 12 330 100 100 255 128 79.1 114.9
109.63 55.10 225.46 Black 1.5 0.8
0.2 0.2
Eye Tracking for GeoDataManagement - Kristien Ooms
45
ΔE*ab= {(ΔL*)2+(Δa*)2+(Δb*)2}1/2 where: ΔL*= L foreground* - L background*; Δa*= a foreground* -a background*; Δb*= b foreground* -b background*.
Colour difference vs. average fixation count per second
Eye Tracking for GeoDataManagement - Kristien Ooms
46
ΔY= Y foreground –Y background
calculated from the measured Y-value in the XYZ-system
luminance difference vs. the target fixation duration
Eye Tracking for GeoDataManagement - Kristien Ooms
47
= a wayfinding tool
a location or a direction view-action pair
picture based object recognition, verbal protocols, verbal eye-catcher detection, Wizard of Oz Prototyping, picture based object description ...
» Visual – Semantic – Structural Eye Tracking for GeoDataManagement - Kristien Ooms Pepijn Viaene
48
eye-mind hypothesis saliency = “eye catching”
Eye Tracking for GeoDataManagement - Kristien Ooms
49
Eye Tracking for GeoDataManagement - Kristien Ooms
50
Eye Tracking for GeoDataManagement - Kristien Ooms
51 Eye Tracking for GeoDataManagement - Kristien Ooms
52
41 % Referral to a landmark 59 % No referral to a landmark
Eye Tracking for GeoDataManagement - Kristien Ooms
53
For the identification of (indoor) landmarks eye tracking can provide qualitative and complete data, in addition verbal protocols can clarify specific fixations.
Eye Tracking for GeoDataManagement - Kristien Ooms
54
How do map users information on digital cartographic products?
Read Interpet Store Retrieve
Advice for design (syntax, semiotics)
cartographic products: Guidelines Implement in online tools ...
Eye Tracking for GeoDataManagement - Kristien Ooms Kristien Ooms
55 Eye Tracking for GeoDataManagement - Kristien Ooms
∙ Location ∙ Duration ∙ …in screen-coordinates (px)
∙ Reaction time measurements ∙ Thinking alound ∙ Sketch maps ∙ Questionnaires
∙ …
56 Eye Tracking for GeoDataManagement - Kristien Ooms
border- design total- design
view
57 Eye Tracking for GeoDataManagement - Kristien Ooms
58
Average total fixation duration Average fixation duration per fixation
Eye Tracking for GeoDataManagement - Kristien Ooms
59
Statistical comparison (ANOVA)
Eye Tracking for GeoDataManagement - Kristien Ooms
60
Eye Tracking for GeoDataManagement - Kristien Ooms
61
Based on theme Based on frequency Eye Tracking for GeoDataManagement - Kristien Ooms
62
Level 1: Map Level Orientate – Execute - Evaluate Level 2: Item Level Gather Thougts – Draw – Correct - Evaluate Level 3: Confidence Confident – Neutral – Not Confident Level 4: Actions
Check – Correct – Draw – Erase – Fill Colour – Talk – Take Pencil
Psychological Theories Task Analysis Psychological Model Proposed Codes Coding Scheme Segmented Protocols Transcriptions
(Raw Protocols)
Coded Protocols
T H E O R Y USER DATA
Eye Tracking for GeoDataManagement - Kristien Ooms
63
Eye Tracking for GeoDataManagement - Kristien Ooms
64
changing extent
changing scale & extent
Read Interpet Store Retrieve
Benifical for user? e.g. memory, change blindness, …
Eye Tracking for GeoDataManagement - Kristien Ooms
65
At certain timestamp:
…for each participant Less intrusion on cognitive processes Higher realism
Eye Tracking for GeoDataManagement - Kristien Ooms
66
Panning Zooming
67
Changing point of
Applying map projection formula
Spherical Mercator (inverse) 𝜇 = 𝜇0 + 𝑦 𝑆 𝜒 = 2 𝑢𝑏𝑜−1 𝑓𝑦𝑞 𝑧 𝑆 − 𝜌 2
Eye Tracking for GeoDataManagement - Kristien Ooms
68
Panning
Eye Tracking for GeoDataManagement - Kristien Ooms
69
Panning
Eye Tracking for GeoDataManagement - Kristien Ooms
70
Eye Tracking for GeoDataManagement - Kristien Ooms
71
Start: Fiji Start: Quttinirpaaq NP Canada Eye Tracking for GeoDataManagement - Kristien Ooms
72 Eye Tracking for GeoDataManagement - Kristien Ooms
73
Eye Tracking for GeoDataManagement - Kristien Ooms
74
Eye Tracking for GeoDataManagement - Kristien Ooms
75 Eye Tracking for GeoDataManagement - Kristien Ooms
SpaCoast SpaAarlon Fiji-Belgium Canada-Belgium
mouse key down mouse key up
76
Eye Tracking for GeoDataManagement - Kristien Ooms
77
Eye Tracking for GeoDataManagement - Kristien Ooms
78
Eye Tracking for GeoDataManagement - Kristien Ooms
79
Eye Tracking for GeoDataManagement - Kristien Ooms
80
Eye Tracking for GeoDataManagement - Kristien Ooms
81
Eye Tracking for GeoDataManagement - Kristien Ooms
82
Eye Tracking for GeoDataManagement - Kristien Ooms
Time interval (ms) SMI 60Hz (%) ET 60 Hz (%) 15 0.012265 0.010027 16 0.042248 42.00816 17 99.82965 45.10662 [18-20] 0.014991 8.259242 ]20-30] ]30-40] 0 4.532389 >40 0.100849 0.083562
Recorded time intervals between samples at 60 Hz 60 Hz = once every 16.666…ms dist distX distY M Med SD M Med SD M Med SD ET 274 46 440
343
344 SMI 57 44 69
68 12 11 56 Med-test .280 .594 .000 Mann-Whitney U test .000 .030 .000 Statistical comparison of the registered offset values
83
Eye Tracking for GeoDataManagement - Kristien Ooms
84
Eye Tracking for GeoDataManagement - Kristien Ooms Lieselot Lapon
85
Eye Tracking for GeoDataManagement - Kristien Ooms
86
with the ICC+GIS, Bulgaria
Eye Tracking for GeoDataManagement - Kristien Ooms
Kristien.Ooms@UGent.be