RIO: A Pervasive RFID-based Touch Gesture Interface Swadhin Pradhan - - PowerPoint PPT Presentation

▶
rio a pervasive rfid based touch gesture interface
SMART_READER_LITE
LIVE PREVIEW

RIO: A Pervasive RFID-based Touch Gesture Interface Swadhin Pradhan - - PowerPoint PPT Presentation

Jun 06, 2023 170 likes •1.01k views

RIO: A Pervasive RFID-based Touch Gesture Interface Swadhin Pradhan 1 , Eugene Chai 2 , Karthik Sundaresan 2 , Lili Qiu 1 , Amir Khojastepour 2 , Sampath Rangarajan 2 2 1 1 MobiCom 2017 LOTS of Connected Devices by 2020 2 LOTS of Connected

slide-1
SLIDE 1

RIO: A Pervasive RFID-based Touch Gesture Interface

Swadhin Pradhan1, Eugene Chai2, Karthik Sundaresan2, Lili Qiu1, Amir Khojastepour2, Sampath Rangarajan2

1

1 2

MobiCom 2017

slide-2
SLIDE 2

LOTS of Connected Devices by 2020

2

slide-3
SLIDE 3

LOTS of Connected Devices by 2020

2

~30 Billion*

*Ericsson Research

slide-4
SLIDE 4

Smart Spaces

3

slide-5
SLIDE 5

Smart Spaces

3

Smart Hospitals Smart Offices Smart Retail

slide-6
SLIDE 6

4

slide-7
SLIDE 7

Can we effectively transform everyday

  • bject into a touch Interface ?

4

slide-8
SLIDE 8

5

slide-9
SLIDE 9

5

Wireless Capacitive Vision IMU

slide-10
SLIDE 10

Issues with these modalities

6

slide-11
SLIDE 11

Issues with these modalities

  • Not easy to customize
  • Not low cost
  • Extensive training phase
  • Need to be recharged frequently …

6

slide-12
SLIDE 12

Passive RFID tags as touch interface

7

slide-13
SLIDE 13

Passive RFID tags as touch interface

7

COTS Tags COTS Reader/Antenna Custom Tags

slide-14
SLIDE 14

And that interface …

8

slide-15
SLIDE 15

And that interface …

  • Customizable and less costly
  • Battery-free
  • Supports fine-grained tracking
  • Multi interface support

8

slide-16
SLIDE 16

9

slide-17
SLIDE 17

9

Button

slide-18
SLIDE 18

9

Button Keyboard

slide-19
SLIDE 19

9

Button Keyboard Slider

slide-20
SLIDE 20

9

Button Keyboard Slider Dial

slide-21
SLIDE 21

9

Button Keyboard Slider Dial Multiple Sliders

slide-22
SLIDE 22

9

Button Keyboard Slider Dial Multiple Sliders Shapes

slide-23
SLIDE 23

10

Key Idea and Reasoning Touch and Single Tag Tracking Tracking within Multiple Tags Evaluation

slide-24
SLIDE 24

11

Key Idea and Reasoning Touch and Single Tag Tracking Tracking within Multiple Tags Evaluation

slide-25
SLIDE 25
slide-26
SLIDE 26

Reader Antenna Tag

slide-27
SLIDE 27

Reader Antenna Tag Finger Swipe

  • n Tag

Predictable phase change at reader side

slide-28
SLIDE 28

Why does it happen ?

13

slide-29
SLIDE 29

Why does it happen ?

13

slide-30
SLIDE 30

Why does it happen ?

13

ZChip ZAntenna

slide-31
SLIDE 31

Why does it happen ?

13

ZBody ZChip ZAntenna

slide-32
SLIDE 32

Why does it happen ?

13

ZBody

slide-33
SLIDE 33

Why does it happen ?

13

ZBody Backscattered Electric field and Phase

slide-34
SLIDE 34

VNA based measurements

14

slide-35
SLIDE 35

VNA based measurements

14

slide-36
SLIDE 36

VNA based measurements

15

slide-37
SLIDE 37

VNA based measurements

15

slide-38
SLIDE 38

VNA based measurements

15

slide-39
SLIDE 39

16

Key Idea and Reasoning Touch and Single Tag Tracking Tracking within Multiple Tags Evaluation

slide-40
SLIDE 40

How to detect touch ?

17

slide-41
SLIDE 41

How to detect touch ?

17

slide-42
SLIDE 42

How to detect touch ?

17

Sudden Jump in Phase

slide-43
SLIDE 43

How to detect tracking ?

18

slide-44
SLIDE 44

How to detect tracking ?

18

slide-45
SLIDE 45

How to detect tracking ?

18

Predictable Phase Pattern

slide-46
SLIDE 46

This change is also present in NLoS

19

slide-47
SLIDE 47

This change is also present in NLoS

19

Behind a Wall Behind a Door

slide-48
SLIDE 48

This change is also present in NLoS

19

Behind a Wall Behind a Door Remains Similar

slide-49
SLIDE 49

Single tag tracking algorithm sketch

20

slide-50
SLIDE 50

Single tag tracking algorithm sketch

20

Phase Tag Position

slide-51
SLIDE 51

Single tag tracking algorithm sketch

20

Phase Tag Position

Calibration Phase

slide-52
SLIDE 52

Single tag tracking algorithm sketch

20

Phase

Calibration Phase

Last Known Position

slide-53
SLIDE 53

Single tag tracking algorithm sketch

20

Phase

Calibration Phase

Last Known Position

T-second Swipe Phase

slide-54
SLIDE 54

Single tag tracking algorithm sketch

20

Phase

Calibration Phase

Last Known Position

T-second Swipe Phase

slide-55
SLIDE 55

Single tag tracking algorithm sketch

20

Phase

Calibration Phase

Last Known Position

T-second Swipe Phase DTW Matching

Potential New Position

slide-56
SLIDE 56

21

Key Idea and Reasoning Touch and Single Tag Tracking Tracking within Multiple Tags Evaluation

slide-57
SLIDE 57

Tracking within Multiple Tags

22

slide-58
SLIDE 58

Tracking within Multiple Tags

22

slide-59
SLIDE 59

Mutual coupling phenomenon

23

slide-60
SLIDE 60

Mutual coupling phenomenon

23

Neighboring tags show reverse phase pattern

slide-61
SLIDE 61

Why does it happen ?

24

slide-62
SLIDE 62

Why does it happen ?

24

slide-63
SLIDE 63

Why does it happen ?

24

Coupled mutual impedance has reverse impact in back-scattered phase

slide-64
SLIDE 64

Multi tag tracking algorithm sketch

25

slide-65
SLIDE 65

Multi tag tracking algorithm sketch

25

slide-66
SLIDE 66

Multi tag tracking algorithm sketch

25

Apply joint DTW matching

slide-67
SLIDE 67

26

Key Idea and Reasoning Touch and Single Tag Tracking Tracking within Multiple Tags Evaluation

slide-68
SLIDE 68

Experimental Setup

27

slide-69
SLIDE 69

Experimental Setup

27

Camera RFID Tag Antenna Reader Laptop (Processing)

slide-70
SLIDE 70

Single Tag Tracking Accuracy

28

slide-71
SLIDE 71

Single Tag Tracking Accuracy

28

slide-72
SLIDE 72

Single Tag Tracking Accuracy

28

Error ~10 mm

slide-73
SLIDE 73

Multi Tag Tracking Accuracy

29

slide-74
SLIDE 74

Multi Tag Tracking Accuracy

29

slide-75
SLIDE 75

Multi Tag Tracking Accuracy

29

Error ~18 mm

slide-76
SLIDE 76

Custom Tag Tracking Accuracy

30

slide-77
SLIDE 77

Custom Tag Tracking Accuracy

30

Custom Tags

slide-78
SLIDE 78

Custom Tag Tracking Accuracy

30

Custom Tags

Error ~10 mm

slide-79
SLIDE 79

Related Works

31

slide-80
SLIDE 80

Related Works

  • RFID based gesture recognition – Data-driven learning
  • ShopMiner (SenSys ‘15), FEMO (SenSys ‘15), CBID (ToN ‘16) …
  • RFID tag tracking – Tracks tag movement
  • RF-IDraw (SIGCOMM ‘14), Tagyro (Mobicom ‘16), PolarDraw (CoNext ‘16) …
  • RFID based UI (Closest) – ML on a fixed set of gestures
  • PaperID (CHI 2015), IDSense (CHI 2016) …

31

slide-81
SLIDE 81

Future works

  • Multi-touch tracking
  • General 2D gesture tracking
  • Tracking in different environment scenarios
  • Building customized tags for other use cases

32

slide-82
SLIDE 82

Key takeaways

  • Impedance Tracking based Touch Primitive
  • Mutual coupling can be exploited
  • Custom designed tags may enable different

applications

33

slide-83
SLIDE 83

Thanks! Questions ?

swadhin@cs.utexas.edu

34