Interacting with Small Devices in Big Ways Chris Harrison 1 Small - - PowerPoint PPT Presentation

interacting with small devices in big ways
SMART_READER_LITE
LIVE PREVIEW

Interacting with Small Devices in Big Ways Chris Harrison 1 Small - - PowerPoint PPT Presentation

Interacting with Small Devices in Big Ways Chris Harrison 1 Small Powerful + 2 Computing Factors Computing power Time 3 Computing Factors Computing power Storage Time 4 Computing Factors Computing power Storage


slide-1
SLIDE 1

Interacting with Small Devices in Big Ways

Chris Harrison

1

slide-2
SLIDE 2

Small Powerful

+

2

slide-3
SLIDE 3

»Computing power

3

Time

Computing Factors

slide-4
SLIDE 4

»Computing power »Storage

4

Time

Computing Factors

slide-5
SLIDE 5

»Computing power »Storage »Bandwidth

5

Time

Computing Factors

slide-6
SLIDE 6

»Computing power »Storage »Bandwidth »Screen Resolution »...

6

Time

Computing Factors

slide-7
SLIDE 7

Human Factors

7

Time

slide-8
SLIDE 8

»Finger size

Human Factors

8

Time

slide-9
SLIDE 9

Human Factors

»Finger size »Visual acuity

9

Time

slide-10
SLIDE 10

»Finger size »Visual acuity »Manual dexterity »…

Time

Human Factors

10

slide-11
SLIDE 11

Time Size

11

Mobile Device Size

slide-12
SLIDE 12

mobile device limited surface area

=

12

slide-13
SLIDE 13

13

slide-14
SLIDE 14

14

slide-15
SLIDE 15

15

slide-16
SLIDE 16

mobile device

limited input richness

16

=

slide-17
SLIDE 17

Scratch Input++

17

slide-18
SLIDE 18

18

Scratch Input

slide-19
SLIDE 19

19

Project Idea

One or more microphones on underside of device 1) Localize taps around the device on an ad hoc surface 2) Listen and classify gestures being performed (non-spatial) Some combination of the two above Possible uses: Laptop, smartphone, kitchen, light switch Reach goal: couple with projector for interactive graphics

Oblique from smartphone From lid of laptop

slide-20
SLIDE 20

On-Body Interfaces

20

slide-21
SLIDE 21

Acoustics on the Body

21

Longitudinal (compression) waves

slide-22
SLIDE 22

Acoustics on the Body

22

Transverse surface distortions (ripples)

slide-23
SLIDE 23

23

slide-24
SLIDE 24

24

Projected Interface Pico-Projector Sensing Armband

slide-25
SLIDE 25

25

slide-26
SLIDE 26

26

slide-27
SLIDE 27

27

Project Idea

1.Skinput++ Entirely passive approach; better signal processing and machine learning 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly) 3.1D (along arm) time of flight. 4.Add active elements to the skin, look at e.g., reflected signal, attenuation of particular frequencies. 5.Phase offset (receiver/transmitter pair on upper arm/wrist)

slide-28
SLIDE 28

28

Warning!

Not for the feignt of heart! These projects need research, not just engineering Self motivated team I can advise project, but will be traveling a lot Expected end result is a publication

slide-29
SLIDE 29

Analyzing Calls for Closeness

29

slide-30
SLIDE 30

30

Project Idea

Large corpus of phone calls Mine calls for acoustic features See if personal closeness of the two individuals can be predicted Example app: bootstrapping sharing/privacy settings on social networking sites

slide-31
SLIDE 31

Thank You

31

Chris Harrison chris.harrison@cs.cmu.edu www.chrisharrison.net