EyePhone Activating Mobile Phones With Your Eyes Felix Nwaobasi - - PowerPoint PPT Presentation

▶
eyephone
SMART_READER_LITE
LIVE PREVIEW

EyePhone Activating Mobile Phones With Your Eyes Felix Nwaobasi - - PowerPoint PPT Presentation

Jan 15, 2023 172 likes •412 views

EyePhone Activating Mobile Phones With Your Eyes Felix Nwaobasi Felix Nwaobasi CS525: Mobile & Ubiquitous Computing Mobile Interactions Mobile Interactions Lots of different ways to measure Lots of different ways to measure user

slide-1
SLIDE 1

EyePhone

Activating Mobile Phones With Your Eyes

Felix Nwaobasi Felix Nwaobasi CS525: Mobile & Ubiquitous Computing

slide-2
SLIDE 2

Mobile Interactions Mobile Interactions

  • Lots of different ways to measure

Lots of different ways to measure user gestures on a phone (accelerometers cameras etc) (accelerometers, cameras, etc)

  • Touchscreen was a major
  • Touchscreen was a major

advancement

  • Can we go further?

2 Worcester Polytechnic Institute 2

slide-3
SLIDE 3

HCI vs HPI HCI vs HPI

3 Worcester Polytechnic Institute 3

slide-4
SLIDE 4

HCI HCI

  • Tends to focus on ideal settings

Tends to focus on ideal settings T k f ll d t f th

  • Takes full advantage of the a

computer’s computational power

  • External sensors used, often

, encouraged

4 Worcester Polytechnic Institute 4

slide-5
SLIDE 5

HPI HPI

  • Deals with users on the move under

Deals with users on the move under different contexts & conditions

  • Huge concern regarding energy

consumption and computational consumption and computational power

  • External sensors frowned upon

5 Worcester Polytechnic Institute 5

slide-6
SLIDE 6

C ti th E Ph Creating the EyePhone

6 Worcester Polytechnic Institute 6

slide-7
SLIDE 7

EyePhone Features EyePhone Features

  • Maps a user’s eye movement to a

Maps a user s eye movement to a position on the display

  • Blinks from the user correspond to a

li k click

  • Hands-free!

7 Worcester Polytechnic Institute 7

slide-8
SLIDE 8

The EyePhone Algorithm The EyePhone Algorithm

  • Eye detection

Eye detection

  • Eye template creation

E t ki

  • Eye tracking
  • Blink detection

8 Worcester Polytechnic Institute 8

slide-9
SLIDE 9

Eye Detection Eye Detection

  • Uses motion analysis operations on

Uses motion analysis operations on consecutive frames

  • Focused on eye contours

9 Worcester Polytechnic Institute 9

slide-10
SLIDE 10

Eye Detection (cont.) Eye Detection (cont.)

10 Worcester Polytechnic Institute 10

slide-11
SLIDE 11

Eye Template Creation Eye Template Creation

  • Used whenever eye gets lost

y g

  • Created first time user uses

Created first time user uses EyePhone

  • Reduces computation time &

preserves battery life p y

  • Not very effective if lighting changes 11

Not very effective if lighting changes

Worcester Polytechnic Institute 11

slide-12
SLIDE 12

Eye Tracking Eye Tracking

  • Based on eye template matching

Based on eye template matching

  • Correlation score between search
  • Correlation score between search

window and open eye template

  • Use correlation coefficient to

improve accuracy improve accuracy

12 Worcester Polytechnic Institute 12

slide-13
SLIDE 13

Eye Tracking (cont.) Eye Tracking (cont.)

  • Correlation coefficient of 4 works

Correlation coefficient of .4 works great for eye template matching

13 Worcester Polytechnic Institute 13

slide-14
SLIDE 14

Blink Detection Blink Detection

  • Uses thresholding

Uses thresholding

  • Created four different thresholds to
  • Created four different thresholds to

account for phone’s bad quality camera camera

  • If correlation coefficients are within
  • If correlation coefficients are within

these thresholds, then eye is closed

14 Worcester Polytechnic Institute 14

slide-15
SLIDE 15

E l ti Evaluation

15 Worcester Polytechnic Institute 15

slide-16
SLIDE 16

Experiments Experiments

  • Daylight Exposure/Stationary Subject

Daylight Exposure/Stationary Subject

  • Artificial Light/Stationary Subject

16 Worcester Polytechnic Institute 16

slide-17
SLIDE 17

Experiments Experiments

  • Daylight Exposure/Person Walking

Daylight Exposure/Person Walking

  • Distance/Tablet correlation

17 Worcester Polytechnic Institute 17

slide-18
SLIDE 18

Experiment Results Experiment Results

18 Worcester Polytechnic Institute 18

slide-19
SLIDE 19

EyePhone & HPI EyePhone & HPI

  • Lightweight application

Lightweight application

  • Camera obtained 15 frames/sec

A li ti l h i

  • Application only runs when user is

looking at display

  • Three hours of battery life if used

continuously

19 Worcester Polytechnic Institute 19

slide-20
SLIDE 20

EyePhone & HPI (cont.) EyePhone & HPI (cont.)

20 Worcester Polytechnic Institute 20

slide-21
SLIDE 21

Possible Applications Possible Applications

EyeMenu EyeMenu

  • Maps eye position

to 1 of 9 buttons

  • Blink to click!
  • Great for people

with disabilities

21 Worcester Polytechnic Institute 21

slide-22
SLIDE 22

Future Work Future Work

  • Increase battery life

Increase battery life

  • Improve eye template creation
  • Improve eye template creation
  • Minimize false positives
  • Minimize false positives

22 Worcester Polytechnic Institute 22

slide-23
SLIDE 23

Q ti ? Questions?

23 Worcester Polytechnic Institute 23