SLIDE 1
E9 205 Machine Learning for Signal Processing
08-11-2019
Understanding Deep Networks
Instructor - Sriram Ganapathy (sriramg@iisc.ac.in.in)
E9 205 Machine Learning for Signal Processing Understanding Deep - - PowerPoint PPT Presentation
E9 205 Machine Learning for Signal Processing Understanding Deep - - PowerPoint PPT Presentation
E9 205 Machine Learning for Signal Processing Understanding Deep Networks 08-11-2019 Instructor - Sriram Ganapathy (sriramg@iisc.ac.in.in) Understanding Deep Networks Understanding Deep Networks Understanding Deep Networks SVHN dataset
SLIDE 2
SLIDE 3
Understanding Deep Networks
SLIDE 4
Understanding Deep Networks
SVHN dataset
SLIDE 5
Understanding Deep Networks
CIFAR-10
SLIDE 6
Understanding Deep Networks
tSNE projection
- f MNIST
Images
SLIDE 7
Understanding Deep Networks
tSNE projection
- f last layer
- f the neural network.
SLIDE 8
Understanding Deep Networks
SLIDE 9
SLIDE 10
Understanding Deep Networks
SLIDE 11
Understanding Deep Networks
SLIDE 12
SLIDE 13
Understanding Deep Networks
SLIDE 14
Understanding Deep Networks
SLIDE 15
Understanding Deep Networks
SLIDE 16
Representation Learning in Deep Networks
Pixels Edges Contours Object Parts Object Identity [Zeiler, 2014]
SLIDE 17
SLIDE 18
- Map the features to phone class. Using phone labelled data.
Speech Recognition
/w/ /^/ /n/ |^| Phoneme Classes
- Classical machine learning - train a classifier on speech training data
that maps to the target phoneme class.
SLIDE 19
Back to Speech Recognition
Mapping Speech Features to Phonemes
SLIDE 20
Understanding DNNs for Speech
[Abdel Rahman, 2012] 2-D projection of 1st layer DNN
SLIDE 21
Understanding DNNs for Speech
[Abdel Rahman, 2012] 2-D projection of 2nd layer DNN
SLIDE 22
Understanding DNNs for Speech
[Abdel Rahman, 2012] 2-D projection of final layer DNN
SLIDE 23
Understanding DNNs for Speech
[Nagamine, 2015]