Typing on a touch surface E ff ect of Feedback with Horizontal Touch - - PowerPoint PPT Presentation

▶
typing on a touch surface
SMART_READER_LITE
LIVE PREVIEW

Typing on a touch surface E ff ect of Feedback with Horizontal Touch - - PowerPoint PPT Presentation

Dec 14, 2022 182 likes •692 views

Typing on a touch surface E ff ect of Feedback with Horizontal Touch Keyboard and Vertical Display Setup Sunjun Kim, Geehyuk Lee {kuaa.net, geehyuk}@gmail.com Wednesday, October 10, 12 Touchscreen Wednesday, October 10, 12 Touchscreen

slide-1
SLIDE 1

Typing on a touch surface

Effect of Feedback with Horizontal Touch Keyboard and Vertical Display Setup Sunjun Kim, Geehyuk Lee {kuaa.net, geehyuk}@gmail.com

Wednesday, October 10, 12

slide-2
SLIDE 2

Touchscreen

Wednesday, October 10, 12

slide-3
SLIDE 3

Touchscreen keyboards

Wednesday, October 10, 12

slide-4
SLIDE 4

Touchscreen keyboards

Wednesday, October 10, 12

slide-5
SLIDE 5

Touchscreen keyboards: what if?

Wednesday, October 10, 12

slide-6
SLIDE 6

Touchscreen keyboards: what if?

Wednesday, October 10, 12

slide-7
SLIDE 7

Touchscreen keyboards: what if?

Wednesday, October 10, 12

slide-8
SLIDE 8

Touchscreen keyboards: what if?

Wednesday, October 10, 12

slide-9
SLIDE 9

Apparatus

Apple iPad + laptop (keyboard area is designed to be out of sight) Screen keyboard: identical size to physical keyboard on laptop

Wednesday, October 10, 12

slide-10
SLIDE 10

Feedbacks at physical keyboard

Wednesday, October 10, 12

slide-11
SLIDE 11

Force

Feedbacks at physical keyboard

am

Wednesday, October 10, 12

slide-12
SLIDE 12

Force Sound

Feedbacks at physical keyboard

am

Wednesday, October 10, 12

slide-13
SLIDE 13

Force Sound Surface Texture

Feedbacks at physical keyboard

am

Wednesday, October 10, 12

slide-14
SLIDE 14

Designing feedbacks for touchscreen

Surface Texture Sound

Wednesday, October 10, 12

slide-15
SLIDE 15

Designing feedbacks for touchscreen

F-J Surface Texture Sound

Wednesday, October 10, 12

slide-16
SLIDE 16

Designing feedbacks for touchscreen

F-J Home-row Surface Texture Sound

Wednesday, October 10, 12

slide-17
SLIDE 17

Designing feedbacks for touchscreen

F-J Home-row Full Surface Texture Sound

Wednesday, October 10, 12

slide-18
SLIDE 18

Designing feedbacks for touchscreen

F-J Home-row Full Surface Texture Sound

Wednesday, October 10, 12

slide-19
SLIDE 19

Designing feedbacks for touchscreen

F-J Home-row Full Sound Texture Sound

Wednesday, October 10, 12

slide-20
SLIDE 20

Designing feedbacks for touchscreen

F-J Home-row Full Sound F and J No ASDF JKL; All keys No No No Yes Texture Sound

Wednesday, October 10, 12

slide-21
SLIDE 21

Designing feedbacks for touchscreen

F-J Home-row Full Sound F and J No ASDF JKL; All keys No No No Yes Full+S All keys Yes None No No No Texture Sound

Wednesday, October 10, 12

slide-22
SLIDE 22

16 participants (9 M, 7 F, avg. age 23.5) 1-hour test, within-subject Task: Copy an entire string of characters appearing on the vertical screen Survey (likert scale)

Experiment

Wednesday, October 10, 12

slide-23
SLIDE 23

Result: speed (Word per minutes)

None% Sound% FJ% Home% Full% Full+S% WPM% 24.42% 24.64% 21.81% 20.69% 25.01% 28.73% 0.00% 5.00% 10.00% 15.00% 20.00% 25.00% 30.00% 35.00%

Wednesday, October 10, 12

slide-24
SLIDE 24

Result: speed (Word per minutes)

None% Sound% FJ% Home% Full% Full+S% WPM% 24.42% 24.64% 21.81% 20.69% 25.01% 28.73% 0.00% 5.00% 10.00% 15.00% 20.00% 25.00% 30.00% 35.00%

Wednesday, October 10, 12

slide-25
SLIDE 25

Result: speed (Word per minutes)

None% Sound% FJ% Home% Full% Full+S% WPM% 24.42% 24.64% 21.81% 20.69% 25.01% 28.73% 0.00% 5.00% 10.00% 15.00% 20.00% 25.00% 30.00% 35.00%

Wednesday, October 10, 12

slide-26
SLIDE 26

Result: speed (Word per minutes)

None% Sound% FJ% Home% Full% Full+S% WPM% 24.42% 24.64% 21.81% 20.69% 25.01% 28.73% 0.00% 5.00% 10.00% 15.00% 20.00% 25.00% 30.00% 35.00%

None Sound FJ Home Full Full+S None Sound FJ Home Full Full+S

Wednesday, October 10, 12

slide-27
SLIDE 27

Result: speed (Word per minutes)

None% Sound% FJ% Home% Full% Full+S% WPM% 24.42% 24.64% 21.81% 20.69% 25.01% 28.73% 0.00% 5.00% 10.00% 15.00% 20.00% 25.00% 30.00% 35.00%

None Sound FJ Home Full Full+S None Sound FJ Home Full Full+S

Wednesday, October 10, 12

slide-28
SLIDE 28

Result: errors (keystrokes per character)

None% Sound% FJ% Home% Full% Full+S% KSPC% 1.568%% 1.576%% 1.770%% 1.815%% 1.606%% 1.408%% 1.0% 1.1% 1.2% 1.3% 1.4% 1.5% 1.6% 1.7% 1.8% 1.9% 2.0%

Wednesday, October 10, 12

slide-29
SLIDE 29

Result: errors (keystrokes per character)

None% Sound% FJ% Home% Full% Full+S% KSPC% 1.568%% 1.576%% 1.770%% 1.815%% 1.606%% 1.408%% 1.0% 1.1% 1.2% 1.3% 1.4% 1.5% 1.6% 1.7% 1.8% 1.9% 2.0%

Wednesday, October 10, 12

slide-30
SLIDE 30

Result: errors (keystrokes per character)

None% Sound% FJ% Home% Full% Full+S% KSPC% 1.568%% 1.576%% 1.770%% 1.815%% 1.606%% 1.408%% 1.0% 1.1% 1.2% 1.3% 1.4% 1.5% 1.6% 1.7% 1.8% 1.9% 2.0%

Wednesday, October 10, 12

slide-31
SLIDE 31

None Sound FJ Home Full Full+S None Sound FJ Home Full Full+S

Result: errors (keystrokes per character)

None% Sound% FJ% Home% Full% Full+S% KSPC% 1.568%% 1.576%% 1.770%% 1.815%% 1.606%% 1.408%% 1.0% 1.1% 1.2% 1.3% 1.4% 1.5% 1.6% 1.7% 1.8% 1.9% 2.0%

Wednesday, October 10, 12

slide-32
SLIDE 32

None Sound FJ Home Full Full+S None Sound FJ Home Full Full+S

Result: errors (keystrokes per character)

None% Sound% FJ% Home% Full% Full+S% KSPC% 1.568%% 1.576%% 1.770%% 1.815%% 1.606%% 1.408%% 1.0% 1.1% 1.2% 1.3% 1.4% 1.5% 1.6% 1.7% 1.8% 1.9% 2.0%

Wednesday, October 10, 12

slide-33
SLIDE 33

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Wednesday, October 10, 12

slide-34
SLIDE 34

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you like the keyboard feedback?

Wednesday, October 10, 12

slide-35
SLIDE 35

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you like the keyboard feedback?

Wednesday, October 10, 12

slide-36
SLIDE 36

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Wednesday, October 10, 12

slide-37
SLIDE 37

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you feel any unintended behaviors

  • ccurred, such as a non-committed

keystroke or accidental input?

Wednesday, October 10, 12

slide-38
SLIDE 38

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you feel any unintended behaviors

  • ccurred, such as a non-committed

keystroke or accidental input?

Wednesday, October 10, 12

slide-39
SLIDE 39

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Wednesday, October 10, 12

slide-40
SLIDE 40

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you feel fatigue?

Wednesday, October 10, 12

slide-41
SLIDE 41

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you feel fatigue?

Wednesday, October 10, 12

slide-42
SLIDE 42

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Wednesday, October 10, 12

slide-43
SLIDE 43

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you glance the keyboard screen often?

Wednesday, October 10, 12

slide-44
SLIDE 44

Result: user survey

None% Sound% FJ% Home% Full% Full+S% Likeness% 2.56% 3.44% 2.38% 2.50% 3.00% 4.38% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Fa0gue% 2.63% 2.88% 2.56% 2.63% 3.31% 3.94% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Glance% 2.25% 2.63% 2.44% 2.44% 2.56% 3.13% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% None% Sound% FJ% Home% Full% Full+S% Intend% 2.69% 2.94% 2.31% 2.44% 2.81% 3.56% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00%

Did you glance the keyboard screen often?

Wednesday, October 10, 12

slide-45
SLIDE 45

Summary & Discussion

BEST : Full + Sound (compound) No single feedback takes advantage Partial textures (F-J, Home-row) worsen the performance Sound feedback was preferred in user survey

Wednesday, October 10, 12

slide-46
SLIDE 46

Wednesday, October 10, 12

slide-47
SLIDE 47

Wednesday, October 10, 12

slide-48
SLIDE 48

Tactus techonology, http://www.tactustechnology.com/

Wednesday, October 10, 12

slide-49
SLIDE 49

CC: images http://www.flickr.com/photos/shadowsofthesun/5183309797/ http://www.flickr.com/photos/elsie/6978296916/ http://www.flickr.com/photos/koleksiaplikasi/6350764132/ http://www.flickr.com/photos/michaelsphotos/46636010/ http://www.flickr.com/photos/publicplaces/7269415244/ http://archive.techtree.com/techtree/jsp/article.jsp?article_id=108553&cat_id=893

Wednesday, October 10, 12

slide-50
SLIDE 50

CC: images http://www.flickr.com/photos/shadowsofthesun/5183309797/ http://www.flickr.com/photos/elsie/6978296916/ http://www.flickr.com/photos/koleksiaplikasi/6350764132/ http://www.flickr.com/photos/michaelsphotos/46636010/ http://www.flickr.com/photos/publicplaces/7269415244/ http://archive.techtree.com/techtree/jsp/article.jsp?article_id=108553&cat_id=893

?

Wednesday, October 10, 12