SLIDE 1 Exploring the Design Space for Adaptive Graphical User Interfaces
Krzysztof Gajos Mary Czerwinski Desney Tan Daniel S. Weld (University of Washington) (Microsoft Research) (Microsoft Research) (University of Washington)
SLIDE 2
Scope
Graphical User Interfaces where the system automatically adapts the presentation of the functionality The Split Interface The Moving Interface The Visual Popout Interface
SLIDE 3 Motivation
They disorient the user!
They optimize the UI for the individual!
SLIDE 4 Prior Work
↑ Greenberg and Witten [1985] ↕
Trevellyan and Browne [1987]
↓ Mitchell and Shneiderman [1989] ↑ Sears and Shneiderman [1994] ?
McGrenere, Baecker and Booth [2002]
↓ Findlater and McGrenere [2004] ↔ Tsandilas and shraefel [2005]
SLIDE 5
Commercial Deployments
SLIDE 6
Our Goal
Uncover the factors and relationships that influence users’ satisfaction and actual performance when using adaptive UIs
SLIDE 7
Road Map
Introduce and motivate the problem Video Experiment 1: qualitative results Experiment 2: quantitative results Synthesis Conclusions
SLIDE 8
SLIDE 9 Potential Benefit Potential Disorientation
Medium Low High Medium Low Low
The Split Interface The Moving Interface The Visual Popout Interface
SLIDE 10
Experiment 1
Goal: collect informative subjective data
SLIDE 11 Participants
- 26 volunteers (10 female)
- aged 25 to 55 (mean=46)
- moderate to high experience using computers (as
indicated by a validated screener)
- intermediate to expert users of MS Office (as
indicated by a validated screener)
- participants received software gratuity
SLIDE 12 Tasks
- Three classes of editing tasks:
- Flow chart edits
- Text edits
- Combined text and graphical edits
SLIDE 13 Procedures
Training Start Flow Chart task Quotes task Poster task Questionnaire Done 4 conditions? Change Interface Final Questionnaire End
SLIDE 14
Results: Ranking
Users ranked the Split Interface the highest (p<0.001)
SLIDE 15 1 2 3 4 5 6 7
E a s e
U s e S a t i s f a c t i
Unchanging Split Moving Visual Popout
1 2 3 4 5 6 7
E a s e
U s e S a t i s f a c t i
Unchanging Split Moving Visual Popout
General Satisfaction
1 2 3 4 5 6 7
E a s e
U s e S a t i s f a c t i
Unchanging Split Moving Visual Popout
1 2 3 4 5 6 7
E a s e
U s e S a t i s f a c t i
Unchanging Split Moving Visual Popout
SLIDE 16 1 2 3 4 5 6 7
E a s e
U s e S a t i s f a c t i
Unchanging Split Moving Visual Popout
1 2 3 4 5 6 7
E a s e
U s e S a t i s f a c t i
Unchanging Split Moving Visual Popout
General Satisfaction
SLIDE 17 Usability
1 2 3 4 5 6 7
D i s c
e r a b i l i t y S e n s e
C
t r
P r e d i c t a b i l i t y
a d a p t a t i
Unchanging Split Moving Visual Popout
1 2 3 4 5 6 7
D i s c
e r a b i l i t y S e n s e
C
t r
P r e d i c t a b i l i t y
a d a p t a t i
Unchanging Split Moving Visual Popout
1 2 3 4 5 6 7
D i s c
e r a b i l i t y S e n s e
C
t r
P r e d i c t a b i l i t y
a d a p t a t i
Unchanging Split Moving Visual Popout
SLIDE 18
based on:
- Mental demand
- Physical Demand
- Frustration
- Confusion due to
adaptation
based on:
- Performance
- Efficiency due to
adaptation
Subjective Cost and Benefit
SLIDE 19
based on:
- Mental demand
- Physical Demand
- Frustration
- Confusion due to
adaptation
based on:
- Performance
- Efficiency due to
adaptation
Subjective Cost and Benefit
Subjective cost Subjective benefit
Non-adaptive baseline Visual Popout Interface Split Interface Moving Interface
SLIDE 20 User Comments
Split Interface Moving Interface Visual Popout Interface
grouping
discoverability
- instability
- anti-salience
SLIDE 21
Road Map
Introduce and motivate the problem Video Experiment 1: qualitative results Experiment 2: quantitative results Synthesis Conclusions
SLIDE 22
Experiment 2
Investigate how the accuracy of the adaptive algorithm affects how adaptation is used Collect accurate performance data Goals:
SLIDE 23 Participants
- 8 research colleagues (2 female)
- aged 25 to 58 (mean=36)
- high experience using computers
- expert users of MS Office
- participants received two meal vouchers as
gratuity
SLIDE 24
Tasks
SLIDE 25 Procedures
- Introduction and a brief training on a non-
adaptive version of the interface
- Each participant used each of the three
interfaces (Unchanging, Split and Moving) at two different accuracy levels (30% and 70%)
SLIDE 26 Performance Vs. Adaptation Type
70 75 80 85 90 95 None Split Moving
Completion time (seconds)
SLIDE 27 Performance Vs. Adaptation Type
significantly faster using Split Interface than Non- adaptive baseline (p<0.003)
70 75 80 85 90 95 None Split Moving
Completion time (seconds)
SLIDE 28 Performance Vs. Adaptation Type
significantly faster using Split Interface than Non- adaptive baseline (p<0.003)
marginally faster using Moving Interface than Non-adaptive baseline (p<0.073)
70 75 80 85 90 95 None Split Moving
Completion time (seconds)
SLIDE 29 Performance Vs. Accuracy
interfaces resulted in faster performance at the higher (70%) accuracy level than at the lower (30%) level (p<0.001)
70 75 80 85 90 95 Split Moving 30% 70% 30% 70%
SLIDE 30 Frequency of Use
?
7% 93% 70% accuracy 19% 81% 30% accuracy
SLIDE 31 User Comments
Split Interface Moving Interface
- discoverability
- poor discoverability
- instability
SLIDE 32
Exploring the Design Space for Adaptive Graphical User Interfaces
SLIDE 33
Exploring the Design Space for Adaptive Graphical User Interfaces
SLIDE 34
Putting It All Together
Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
SLIDE 35 Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
Stability
Split Interfaces Moving Interface MS Smart Menus Visual Popout High stability Low stability User satisfaction
SLIDE 36 Locality
- User comments indicate that, especially for
manual tasks, high locality improves discoverability of adaptation.
Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
SLIDE 37 Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
Adaptation Frequency
↑ Sears and Shneiderman [1994] ↓ Findlater and McGrenere [2004]
adaptation once per user/session adaptation once per interaction Two studies of Split Menus:
SLIDE 38 Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
Accuracy
- Participants performed faster at higher accuracy
levels
(also in [ Tsandilas and schraefel CHI’05])
- Participants were more likely to take advantage
- f adaptation at higher accuracy levels
SLIDE 39 Predictability
A study in progress!
Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
SLIDE 40 Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
Interaction Frequency
↑ Greenberg and Witten [1985] ↕ Trevellyan and Browne [1987]
30 interactions per trial 100 interactions per trial:
- - first 30 positive
- - last 30 neutral or negative
Two studies of adaptive deep hierarchical menus:
SLIDE 41 Task Complexity
Split Interface Moving Interface
grouping
discoverability
Split Interface Moving Interface
discoverability
Experiment 1 Experiment 2
Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
SLIDE 42
Conclusions
Moving Interface Split Interface Visual Popout
SLIDE 43
Conclusions
Moving Interface Split Interface Visual Popout Preferred Disliked [Experiment 1]
SLIDE 44
Conclusions
Moving Interface Split Interface Visual Popout Preferred Disliked Faster [Experiment 2]
SLIDE 45
Conclusions
Context interaction frequency task complexity Algorithm Behavior frequency of adaptation accuracy predictability Interaction Mechanics stability locality
SLIDE 46 Acknowledgments
- Andrea Bunt, Leah Findlater and Joanna
McGrenere at UBC
VIBE Group at MSR
- DUB group at University of Washington
SLIDE 47 Contact Information
kgajos@cs.washington.edu
marycz@microsoft.com
desney@microsoft.com
weld@cs.washington.edu