SpareEye: Enhancing the Safety of Inattentionally Blind Smartphone - - PowerPoint PPT Presentation

spareeye enhancing the safety of inattentionally blind
SMART_READER_LITE
LIVE PREVIEW

SpareEye: Enhancing the Safety of Inattentionally Blind Smartphone - - PowerPoint PPT Presentation

SpareEye: Enhancing the Safety of Inattentionally Blind Smartphone Users Klaus-Tycho Foerster, Alex Gross, Nino Hail, Jara Uitto, Roger Wattenhofer ETH Zurich Distributed Computing www.disco.ethz.ch People dont pay attention when using


slide-1
SLIDE 1

ETH Zurich – Distributed Computing – www.disco.ethz.ch

Klaus-Tycho Foerster, Alex Gross, Nino Hail, Jara Uitto, Roger Wattenhofer

SpareEye: Enhancing the Safety of Inattentionally Blind Smartphone Users

slide-2
SLIDE 2

People don’t pay attention when using their phone

slide-3
SLIDE 3

People don’t pay attention when using their phone

slide-4
SLIDE 4

(USA) 2010 Pedestrian injuries due to mobile phone use in public places Nasar and Troyer, Accident Analysis & Prevention 2013

slide-5
SLIDE 5

Campaigns to spread public awareness

slide-6
SLIDE 6

Possible solution?

slide-7
SLIDE 7

Or maybe a guide?

slide-8
SLIDE 8

Maybe there should be signs?

slide-9
SLIDE 9

There actually are!

slide-10
SLIDE 10

Or even dedicated lanes!

slide-11
SLIDE 11

Once you focus, unexpected events are hard to detect

Familiarity with an inattentional-blindness task does not improve the detection of unexpected events Simons, i-Perception 2010

slide-12
SLIDE 12

People do not pay attention (while using their phone)!

Did you see the unicycling clown? Inattentional blindness while walking and talking on a cell phone Hyman et al., Appl. Cognit. Psychol. 2010

slide-13
SLIDE 13

Let’s use technology!

slide-14
SLIDE 14

A Blind Mobility Aid Modeled After Echolocation of Bats Ifukube et al., IEEE Tr. Biomed. Eng. 1991 Use ultrasound to recognize obstacles like bats

slide-15
SLIDE 15

Obstacle Detection and Avoidance System for Visually Impaired People Shin and Lim, HAID 2007 Ultrasound sensors, recommends walking directions

slide-16
SLIDE 16

Ultrasonic Cover Samsung, 2014 Ultrasound sensor, vibrates when detecting obstacle

slide-17
SLIDE 17

Infrared sensor (Kinect), recommends walking directions Obstacle Detection and Avoidance System for Visually Impaired People Bernabei et al., IPIN 2007

slide-18
SLIDE 18

Infrared sensor (Kinect), walking user interface

CrashAlert: Enhancing Peripheral Alertness for Eyes-Busy Mobile Interaction while Walking

Hincapié-Ramos and Irani, CHI 2013

slide-19
SLIDE 19

Why not like this?

slide-20
SLIDE 20

Does not work well in practice!

Just display the camera image?

E.g., Cognitive control in media multitaskers Ophir et al., PNAS 2009

Apple patent, 2014 Type N Walk app, 2010

slide-21
SLIDE 21

Detect cars with the camera while calling

Walksafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads

Wang et al., HotMobile 2012

slide-22
SLIDE 22

ETH Zurich – Distributed Computing – www.disco.ethz.ch

Klaus-Tycho Foerster, Alex Gross, Nino Hail, Jara Uitto, Roger Wattenhofer

Our approach

slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25
slide-26
SLIDE 26

Holding angle ~ 45°

slide-27
SLIDE 27
slide-28
SLIDE 28
slide-29
SLIDE 29
slide-30
SLIDE 30

Background

slide-31
SLIDE 31

Background Back- ground

slide-32
SLIDE 32

~ 2 Meters < 1 Meter

slide-33
SLIDE 33

User

slide-34
SLIDE 34

Collision!

User

slide-35
SLIDE 35

No danger

User

slide-36
SLIDE 36

User

Multiple Obstacles

slide-37
SLIDE 37

? ?

User

Multiple Obstacles

? ?

slide-38
SLIDE 38

User

Multiple Obstacles

slide-39
SLIDE 39

User

Multiple Obstacles

slide-40
SLIDE 40
slide-41
SLIDE 41

? ?

User

? ?

slide-42
SLIDE 42

User

Match! Match!

slide-43
SLIDE 43

Testing scenario: university cafeteria

slide-44
SLIDE 44

Testing scenario: university cafeteria

slide-45
SLIDE 45

Evaluation

  • 21 participants

– 18 male, 3 female (mean age of 29 years) – walks from 26 to 97s (avg = 62.2s, sd = 21.9s, med = 58s)

  • 103 warnings in total

– 87 true positives (avg = 4.1, sd = 1.8, med = 4) – 16 false positives (avg = 0.8, sd = 0.8, med = 1)

  • 6 failures to warn

(avg = 0.3, sd = 0.5, med = 0)

  • Did not warn:

~ 6%

  • False warning:

~ 15%

slide-46
SLIDE 46

Testing scenario: university cafeteria

slide-47
SLIDE 47

Limitations and Future Work

slide-48
SLIDE 48

Limitations and Future Work

slide-49
SLIDE 49

ETH Zurich – Distributed Computing – www.disco.ethz.ch

Klaus-Tycho Foerster, Alex Gross, Nino Hail, Jara Uitto, Roger Wattenhofer

SpareEye: Enhancing the Safety of Inattentionally Blind Smartphone Users