The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI Stephan Sigg, Ulf Blanke, Gerhard Troester Computer Networks Group, University of Goettingen Wearable Computing Lab, ETH Zurich PerCom 2014, 27.03.2014
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Activity recognition ... 2 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Activity recognition ... 2 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Is there another way? Impact on RF Related Work The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI AR on a mobile phone Results Scholz, Sigg, Shihskova, von Zengen, Bagshik, Guenther, Beigl, Ji: Conclusion SenseWaves: Radiowaves for context recognition, 3 / 14 in Video Proceedings of Pervasive 2011
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Recent related work . Whole-Home Gesture Recognition Using Wireless Signals, Q. Pu, S. Gupta, S. Gollakota, S. Patel, Mobicom’13 See Through Walls with Wi-Fi!, F Adib, D. Katabi, SIGCOMM’13 4 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Can we do this with standard hardware? RSSI Passive 5 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Measure signal strength on a phone ◮ Approx. 1 sample/sec 6 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Measure signal strength on a phone ◮ How to obtain this data on a phone? ◮ root access ◮ Firmware does not support such access 6 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Measure signal strength on a phone 6 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Measure signal strength on a phone 6 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Measure signal strength on a phone 6 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Measure signal strength on a phone Capturing Post processing Processing orange data raw data multidimensional mining toolkit data points .tab Radio grouped by sender signal Data Point Sender video analysis - timespan .pic Sample video - feature 1 kle - feature 2, ... matplotlib + tcpdump - windowing .pdf interactive .pcap raw data still access- receiver - feature calculation plot ible for visualisation .png ◮ http://www.stephansigg.de/DeviceFree/pcapTools.tar.gz 6 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Sampled RSSI over time RSSI samples over time −86 −87 −88 −89 RSSI [dBm] −90 −91 −92 −93 −94 −95 81.4 81.6 81.8 82 82.2 82.4 82.6 82.8 83 83.2 83.4 Time [seconds] ◮ Only use simple time-domain features ◮ Pre-processing? 7 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Which sample rate can we expect? University (ETH) Train station P a c k e t s / s e c P a c k e t s / s e c ground 3 r d fl . 1 10.45 2 9.18 1 34.06 14.88 3 9.01 2 0.61 5.02 channel 4 21.91 3 4.45 0.19 channel 4 0.10 5 23.70 0.04 6 22.31 5 53.97 192.29 7 21.34 6 0.14 0.04 8 21.58 7 0.28 0.03 0.55 8 0.11 0.07 9 9 10 0.62 26.46 2.88 11 14.51 10 0.06 0.09 11 0.05 0.02 Café in center Dormitory P a c k e t s / s e c P a c k e t s / s e c 1 15.29 2 8.86 1 10.28 3 11.06 2 10.03 channel 4 1.41 3 12.13 channel 5 2.15 4 9.92 6 10.99 5 9.30 7 4.45 6 1.77 8 1.23 7 0.09 9 11.09 8 0.19 10 10.79 9 6.92 11 23.30 10 0.47 11 0.36 Suburban fl at P a c k e t s / s e c 1 0.85 2 0.35 3 0.32 channel 4 0.20 5 0.85 6 3.10 7 2.59 8 11.85 9 4.46 10 2.05 8 / 14 11 9.61 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Classification accuracy 9 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Classification accuracy 9 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Case studies 10 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Another pressing issue we solve ... 11 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Another pressing issue we solve ... 11 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Results 12 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Conclusion ◮ Recognition of Activities and Gestures from passive RSSI ◮ On a standard mobile phone ◮ Implementation: Pcap processing for AR (Python) http://www.stephansigg.de/DeviceFree/pcapTools.tar.gz 13 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Conclusion 13 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Introduction Impact on RF Related Work AR on a mobile phone Results Conclusion Thank you! 14 / 14 The Telepathic Phone: Frictionless Activity Recognition from WiFi RSSI
Recommend
More recommend
