Security of Deep Learning Nicolas Papernot ~ ngp5056@cse.psu.edu - - PowerPoint PPT Presentation

security of deep learning
SMART_READER_LITE
LIVE PREVIEW

Security of Deep Learning Nicolas Papernot ~ ngp5056@cse.psu.edu - - PowerPoint PPT Presentation

All parts of this talk should not be further distributed without first contacting the author Security of Deep Learning Nicolas Papernot ~ ngp5056@cse.psu.edu PSU CSE - Dr. Patrick McDaniels lab 1 All parts of this talk should not be further


slide-1
SLIDE 1 All parts of this talk should not be further distributed without first contacting the author

Security of Deep Learning

Nicolas Papernot ~ ngp5056@cse.psu.edu PSU CSE - Dr. Patrick McDaniel’s lab 1
slide-2
SLIDE 2

Neuron

  • utput

input input input input

2 All parts of this talk should not be further distributed without first contacting the author
slide-3
SLIDE 3 All parts of this talk should not be further distributed without first contacting the author

Neural Networks

3 All parts of this talk should not be further distributed without first contacting the author
slide-4
SLIDE 4 All parts of this talk should not be further distributed without first contacting the author

Danger!

(Artificial) Neural Networks are far from modeling the brain’s behavior

>

4
slide-5
SLIDE 5 All parts of this talk should not be further distributed without first contacting the author

Deep Neural Networks

5 All parts of this talk should not be further distributed without first contacting the author
slide-6
SLIDE 6 All parts of this talk should not be further distributed without first contacting the author 6

Deep Neural Networks

All parts of this talk should not be further distributed without first contacting the author
slide-7
SLIDE 7 All parts of this talk should not be further distributed without first contacting the author 7

Deep Neural Networks

All parts of this talk should not be further distributed without first contacting the author
slide-8
SLIDE 8 All parts of this talk should not be further distributed without first contacting the author 8

Deep Neural Networks

All parts of this talk should not be further distributed without first contacting the author
slide-9
SLIDE 9 All parts of this talk should not be further distributed without first contacting the author 9

Deep Neural Networks

All parts of this talk should not be further distributed without first contacting the author
slide-10
SLIDE 10 All parts of this talk should not be further distributed without first contacting the author 10
slide-11
SLIDE 11 11 All parts of this talk should not be further distributed without first contacting the author
slide-12
SLIDE 12 All parts of this talk should not be further distributed without first contacting the author 12
slide-13
SLIDE 13 13 All parts of this talk should not be further distributed without first contacting the author
slide-14
SLIDE 14

Speech Recognition as Probabilistic Transduction

Audio Frame State

Phoneme

Word

Sentence Meaning Feature Extraction Acoustic Model Decision Trees Lexicon Language Model NLP Source: Tara N. Sainath @ ICML DL Workshop 2015 14 All parts of this talk should not be further distributed without first contacting the author
slide-15
SLIDE 15 15
slide-16
SLIDE 16 16 0 1 2 3 4 5 6 7 8 9 Output classification 9 8 7 6 5 4 3 2 1 0 Input class

Adversarial Samples

All parts of this talk should not be further distributed without first contacting the author
slide-17
SLIDE 17 17 All parts of this talk should not be further distributed without first contacting the author
slide-18
SLIDE 18 18 All parts of this talk should not be further distributed without first contacting the author
slide-19
SLIDE 19

Neuron

  • utput

input input input input

19 All parts of this talk should not be further distributed without first contacting the author
slide-20
SLIDE 20

Neuron

y = ϕ @

m

X

j=0

wjxj 1 A

20 All parts of this talk should not be further distributed without first contacting the author
slide-21
SLIDE 21 All parts of this talk should not be further distributed without first contacting the author 21 x1 h1 x2

h2

  • w31
w32 w11

w12

w21 w22 All parts of this talk should not be further distributed without first contacting the author
slide-22
SLIDE 22 All parts of this talk should not be further distributed without first contacting the author 22 x1 h1 x2

h2

  • w31
w32 w11

w12

w21 w22 All parts of this talk should not be further distributed without first contacting the author
slide-23
SLIDE 23 23

1

All parts of this talk should not be further distributed without first contacting the author
slide-24
SLIDE 24 24

rF(X)

All parts of this talk should not be further distributed without first contacting the author
slide-25
SLIDE 25 25 x1 h1 x2

h2

  • w31
w32 w11

w12

w21 w22 All parts of this talk should not be further distributed without first contacting the author
slide-26
SLIDE 26 26

X = (1, 0.37) X∗ = (1, 0.43)

All parts of this talk should not be further distributed without first contacting the author
slide-27
SLIDE 27 27

F(X) = 0.11 F(X∗) = 0.95

All parts of this talk should not be further distributed without first contacting the author
slide-28
SLIDE 28 All parts of this talk should not be further distributed without first contacting the author

What about Deep Neural Networks?

28 All parts of this talk should not be further distributed without first contacting the author
slide-29
SLIDE 29 29 All parts of this talk should not be further distributed without first contacting the author
slide-30
SLIDE 30 30

30,000

All parts of this talk should not be further distributed without first contacting the author
slide-31
SLIDE 31 31

270,000

All parts of this talk should not be further distributed without first contacting the author
slide-32
SLIDE 32 32

97.10%

All parts of this talk should not be further distributed without first contacting the author
slide-33
SLIDE 33 33

4.02%

All parts of this talk should not be further distributed without first contacting the author
slide-34
SLIDE 34 34 All parts of this talk should not be further distributed without first contacting the author
slide-35
SLIDE 35 35

Current Research

All parts of this talk should not be further distributed without first contacting the author