Secure spontaneous device authentication from ambient audio Stephan - - PowerPoint PPT Presentation

▶

Dec 17, 2023 121 likes •613 views

Information Systems Architecture Science Research Division Secure spontaneous device authentication from ambient audio Stephan Sigg 07.02.2013, Westf alische Wilhelms Universit at M unster Motivation Related work Spontaneous

SLIDE 1

Information Systems Architecture Science Research Division

Secure spontaneous device authentication from ambient audio

Stephan Sigg

07.02.2013, Westf¨ alische Wilhelms Universit¨ at M¨ unster

SLIDE 2

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 2

Information Systems Architecture Science Research Division

SLIDE 3

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 2

Information Systems Architecture Science Research Division

SLIDE 4

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 3

Information Systems Architecture Science Research Division

SLIDE 5

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 4

Information Systems Architecture Science Research Division

SLIDE 6

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 5

Information Systems Architecture Science Research Division

SLIDE 7

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 6

Information Systems Architecture Science Research Division

SLIDE 8

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 7

Information Systems Architecture Science Research Division

SLIDE 9

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Stephan Sigg | Spontaneous device authentication from audio | 8

Information Systems Architecture Science Research Division

SLIDE 10

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Motivation

Trust and proximity

We will use audio as a source of common information in proximity

Stephan Sigg | Spontaneous device authentication from audio | 8

Information Systems Architecture Science Research Division

SLIDE 11

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Shake well before usea

aR. Mayrhofer et al., Shake well before use: Authentication based on Accelerometer data,

Pervasive 2007

Accelerometer data Secure key by iterative exchange of hashed key-sub-sequences

RF-based ad-hoc secure device pairinga

aS. Mathur et al., ProxiMate: proximity-based secure pairing using

ambient wireless signals, MobiSys 2011

Utilise error correcting codes Public RF-source

Stephan Sigg | Spontaneous device authentication from audio | 9

Information Systems Architecture Science Research Division

SLIDE 12

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 10

Information Systems Architecture Science Research Division

SLIDE 13

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 10

Information Systems Architecture Science Research Division

SLIDE 14

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 10

Information Systems Architecture Science Research Division

SLIDE 15

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 16

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 17

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

FFT FFT FFT

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 18

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 19

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

E E E E E E E E E

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 20

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

E E E E E E E E E

diff diff diff diff diff diff

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 21

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

diff diff diff diff diff diff

1 0 1 1...

</>? </>? </>? </>?

Stephan Sigg | Spontaneous device authentication from audio | 11

Information Systems Architecture Science Research Division

SLIDE 22

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 23

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 24

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 25

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 26

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 27

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 28

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 29

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 30

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 31

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 32

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 33

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Spontaneous audio-based device pairing

Stephan Sigg | Spontaneous device authentication from audio | 12

Information Systems Architecture Science Research Division

SLIDE 34

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Audio-based ad-hoc secure pairinga

aS. Sigg et al., Secure Communication based on Ambient Audio, IEEE Transactions on Mobile Computing, vol. 12,
no. 2, 2013

Audio as common context source Fuzzy cryptography

Stephan Sigg | Spontaneous device authentication from audio | 13

Information Systems Architecture Science Research Division

SLIDE 35

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Clap Music Snap Speak Whistle 0.5 0.55 0.6 0.65 0.7 0.75 0.8

Hamming distance in created fingerprints (loud audio source in 1.5m and 3m)

Audio sequence class

Median percentage of identical bits in fingerprints Fingerprints created for matching audio samples Fingerprints created for non−matching audio samples 2 4 6 8 10 12 14 16 18 20 0.91 0.93 0.95 0.97 0.99 1.01 Test run Percentage of passed tests

Percentage of tests in one test run that passed at >5% for Kuiper KS p−values

1.01947 (confidence value at α = 0.03) 0.92053 (confidence value at α = 0.03) Only music Only whistle Only snap Only speak Only clap

Stephan Sigg | Spontaneous device authentication from audio | 13

Information Systems Architecture Science Research Division

SLIDE 36

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 14

Information Systems Architecture Science Research Division

SLIDE 37

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Real-time implementation on android mobile phonesa

aStephan Sigg, et al., AdhocPairing: Spontaneous audio-based secure device pairing for Android mobile devices, IWSSI 2012

Hardware noise cancellation on some phones Hardware originated synchronisation offset

Stephan Sigg | Spontaneous device authentication from audio | 14

Information Systems Architecture Science Research Division

SLIDE 38

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

How to synchronise audio without disclosing information?

No data shall be transmitted among devices Hardware-originated synchronisation offset Approximate pattern matching with arbitrary common sequencea

aT. F. Smith and M. S. Waterman.

Identification of common molecular subsequences. Journal of molecular biology, 147(1):195ˆ a197, Mar. 1981 Stephan Sigg | Spontaneous device authentication from audio | 15

Information Systems Architecture Science Research Division

SLIDE 39

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Hardware-originated synchronisation offset Synchronisation in the order of 3ms possible No additional data transmitted among devices1 2

1N. Nguyen, S. Sigg, A. Huynh and Y. Ji: Pattern-based Alignment of Audio Data for Ad-hoc Pairing, ISWC, 2012
2N. Nguyen, S. Sigg, A. Huynh and Y. Ji: Using ambient audio in secure mobile phone communication, PerCom, 2012

Stephan Sigg | Spontaneous device authentication from audio | 16

Information Systems Architecture Science Research Division

SLIDE 40

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

No data transmission

Stephan Sigg | Spontaneous device authentication from audio | 17

Information Systems Architecture Science Research Division

SLIDE 41

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

No data transmission

d d'

Stephan Sigg | Spontaneous device authentication from audio | 17

Information Systems Architecture Science Research Division

SLIDE 42

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 18

Information Systems Architecture Science Research Division

SLIDE 43

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 18

Information Systems Architecture Science Research Division

SLIDE 44

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 18

Information Systems Architecture Science Research Division

SLIDE 45

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 19

Information Systems Architecture Science Research Division

SLIDE 46

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 19

Information Systems Architecture Science Research Division

SLIDE 47

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Security from environmental stimuli

Stephan Sigg | Spontaneous device authentication from audio | 19

Information Systems Architecture Science Research Division

SLIDE 48

Motivation Related work Spontaneous audio-based device pairing Instrumentation in natural environments Conclusion

Conclusion

Stephan Sigg | Spontaneous device authentication from audio | 20

Information Systems Architecture Science Research Division