lecture 11 convolutional neural networks 2
play

Lecture 11: Convolutional Neural Networks 2 CS109B Data Science 2 - PowerPoint PPT Presentation

Jun 05, 2023 •1.26k likes •2.21k views

Lecture 11: Convolutional Neural Networks 2 CS109B Data Science 2 Pavlos Protopapas, Mark Glickman and Chris Tanner 1 Outline Review from last lecture 1. Training CNNs 2. BackProp of MaxPooling layer 3. Layers Receptive Field 4.

  1. Lecture 11: Convolutional Neural Networks 2 CS109B Data Science 2 Pavlos Protopapas, Mark Glickman and Chris Tanner 1

  2. Outline Review from last lecture 1. Training CNNs 2. BackProp of MaxPooling layer 3. Layers Receptive Field 4. Saliency maps 5. Transfer Learning 6. A bit of history 7. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 2

  3. Outline Review from last lecture 1. Training CNNs 2. BackProp of MaxPooling layer 3. Layers Receptive Field 4. Saliency maps 5. Transfer Learning 6. A bit of history 7. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 3

  4. From last lecture + ReLU + ReLU CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 4

  5. Lab Lecture Quiz Homework CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 5

  6. Lab Lab Lecture Lecture Quiz Quiz Homework Homework CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 6

  7. Input Output 1 Filter (size=32X32, (size=32X32) (size=3x3X3, channels=3) stride = 1, padding = same) How many parameters does the layer have? n_filter x filter_volume + biases = total number of params 1 x (3 x 3 x 3) + 1 = 28 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER

  8. Examples I have a convolutional layer with 16 3x3 filters that takes an RGB • image as input. How many parameters does the layer have? • 16 x 3 x 3 x 3 + 16 = 448 Biases (one Number of Number of Size of filters per filter) channels of Filters prev layer CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 8

  9. Examples • Let C be a CNN with the following disposition: • Input: 32x32x3 images • Conv1: 8 3x3 filters, stride 1, padding=same Conv2: 16 5x5 filters, stride 2, padding=same • • Flatten layer • Dense1: 512 nodes • Dense2: 4 nodes • How many parameters does this network have? (8 x 3 x 3 x 3 + 8) + (16 x 5 x 5 x 8 + 16) + (16 x 16 x 16 x 512 + 512) + (512 x 4 + 4) Conv1 Conv2 Dense1 Dense2 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 9

  10. Input Output Filter (size=32X32, (size=32X32, 8 x (size=3X3x3, channels=3) stride = 1, channels = 8) padding = same) filter x 1 How many parameters does the layer have if I want to use 8 filters? n_filters x filter_volume + biases = total number of params CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 8 x (3 x 3 x 3) + 8 = 224

  11. Output Input Filter (size=32X32, (size=16X16, 16 x (size=5X5X8, channels=8) channels=16) stride = 2, padding = same) 16 filters How many parameters does the layer have if I want to use 16 filters? n_filters x filter_volume + biases = total number of params 16 x (5 x 5 x 8) + 16 = 3216 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER

  12. Input Fully Connected Fully Connected Flatten (size=16X16, (size= 16X16X16) (n_nodes=512) (n_nodes=4) channels=16) How many parameters … ? input x FC1_nodes + FC2_nodes = total number of params (16x16x16) x 512 + 512 + 512 x 4 + 4 = 2,099,716 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER

  13. Representation Learning Task: classify cars, people, animals and objects … CNN Layer 1 CNN Layer 2 CNN Layer n FCN CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 13

  14. What do CNN layers learn? • Each CNN layer learns filters of increasing complexity. • The first layers learn basic feature detection filters: edges, corners, etc. • The middle layers learn filters that detect parts of objects. For faces, they might learn to respond to eyes, noses, etc. • The last layers have higher representations: they learn to recognize full objects, in different shapes and positions. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 14

  15. 3D visualization of networks in action http://scs.ryerson.ca/~aharley/vis/conv/ https://www.youtube.com/watch?v=3JQ3hYko51Y CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 15

  16. Outline Review from last lecture 1. Training CNNs 2. BackProp of MaxPooling layer 3. Layers Receptive Field 4. Saliency maps 5. Transfer Learning 6. A bit of history 7. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 16

  17. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 17

  18. Outline Review from last lecture 1. Training CNNs 2. BackProp of MaxPooling layer 3. Layers Receptive Field 4. Saliency maps 5. Transfer Learning 6. A bit of history 7. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 18

  19. Backward propagation of Maximum Pooling Layer Forward mode, 3x3 stride 1 Activation of layer L rest of the network rest of the network 2 4 8 3 6 9 3 4 2 5 5 4 6 3 1 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 19

  20. Backward propagation of Maximum Pooling Layer Forward mode, 3x3 stride 1 Activation of layer L rest of the network rest of the network 2 4 8 3 6 9 9 3 4 2 5 5 4 6 3 1 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 20

  21. Backward propagation of Maximum Pooling Layer Forward mode, 3x3 stride 1 Activation of layer L rest of the network rest of the network 2 4 8 3 6 9 8 9 3 4 2 5 5 4 6 3 1 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 21

  22. Backward propagation of Maximum Pooling Layer Forward mode, 3x3 stride 1 Activation of layer L rest of the network rest of the network 2 4 8 3 6 9 8 8 9 3 4 2 5 5 4 6 3 1 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 22

  23. Backward propagation of Maximum Pooling Layer Forward mode, 3x3 stride 1 Activation of layer L rest of the network rest of the network 2 4 8 3 6 9 8 8 9 3 4 2 5 9 6 6 5 4 6 3 1 7 7 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 23

  24. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network rest of the network 2 4 8 3 6 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 24

  25. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network rest of the network 2 4 8 3 6 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 25

  26. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network rest of the network 2 4 8 3 6 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 26

  27. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network rest of the network 2 4 8 3 6 +1 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 27

  28. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network rest of the network 2 4 8 3 6 +1 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 28

  29. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network +3 rest of the network 2 4 8 3 6 +1 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 29

  30. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network +3 rest of the network 2 4 8 3 6 +1 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 30

  31. Backward propagation of Maximum Pooling Layer Backward mode. Large fonts represents the values of the derivatives of the current layer (max-pool) and small font the corresponding value of the previous layer. Activation of layer L rest of the network +4 rest of the network 2 4 8 3 6 +1 1 9 3 8 1 8 9 3 4 2 5 1 9 4 6 2 6 5 4 6 3 1 6 7 2 7 1 7 2 3 1 3 4 2 7 4 5 7 CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 31

  32. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 32

  33. Outline Review from last lecture 1. Training CNNs 2. BackProp of MaxPooling layer 3. Layers Receptive Field, dilated CNNs 4. Saliency maps 5. Transfer Learning 6. A bit of history 7. CS109B, P ROTOPAPAS , G LICKMAN A ND T ANNER 33

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Convolutional Neural Networks in Speech Lecture 20 CS 753 Instructor: Preethi Jyothi

Convolutional Neural Networks in Speech Lecture 20 CS 753 Instructor: Preethi Jyothi

Convolutional Neural Networks in Speech Lecture 20 CS 753 Instructor: Preethi Jyothi Convolutional Neural Networks (CNNs) Fully connected (dense) layers have no awareness of spatial information Key concept behind convolutional layers is

983 views • 41 slides
Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural

Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural

Transfer Learning with Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural Networks A breakthough Convolutional Neural Networks VGG-16 example Layers of Convolutional filters Bottleneck

625 views • 23 slides
Introduction CSCE 970 CSCE 970 Lecture 4: Lecture 4: Convolutional Convolutional Neural

Introduction CSCE 970 CSCE 970 Lecture 4: Lecture 4: Convolutional Convolutional Neural

Introduction CSCE 970 CSCE 970 Lecture 4: Lecture 4: Convolutional Convolutional Neural Neural CSCE 970 Lecture 4: Networks Networks Good for data with a grid-like topology Stephen Scott Convolutional Neural Networks Stephen Scott

355 views • 3 slides
Convolutional Kuan-Ting Lai 2020/3/31 Neural Network Convolutional Neural Networks (CNN)

Convolutional Kuan-Ting Lai 2020/3/31 Neural Network Convolutional Neural Networks (CNN)

Convolutional Kuan-Ting Lai 2020/3/31 Neural Network Convolutional Neural Networks (CNN) A.k.a. CNN or ConvNet Adit Deshpande, A Beginner's Guide To Understanding Convolutional Neural Networks. Digital Images Input array: an images

1.42k views • 72 slides
CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided

CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided

CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided Backpropagation, Deep Dream, Deep Art, Fooling Convolutional Neural Networks Mitesh M. Khapra Department of Computer Science and Engineering Indian Institute

1.07k views • 72 slides
Neural Network Part 3: Convolutional Neural Networks CS 760@UW-Madison Goals for the lecture

Neural Network Part 3: Convolutional Neural Networks CS 760@UW-Madison Goals for the lecture

Neural Network Part 3: Convolutional Neural Networks CS 760@UW-Madison Goals for the lecture you should understand the following concepts convolutional neural networks (CNN) convolution and its advantage pooling and its advantage 2

750 views • 50 slides
Convolutional Neural Nets 4-25-16 Reading Quiz Convolutional neural networks are most commonly

Convolutional Neural Nets 4-25-16 Reading Quiz Convolutional neural networks are most commonly

Convolutional Neural Nets 4-25-16 Reading Quiz Convolutional neural networks are most commonly used for what sort of task? a) Recognizing images b) Transcribing speech c) Translating documents d) Playing games Neural network review

431 views • 13 slides
Lecture 11: Neural Networks (Part 3) March 2nd, 2020 Lecturer: Steven Wu Scribe: Steven Wu 1

Lecture 11: Neural Networks (Part 3) March 2nd, 2020 Lecturer: Steven Wu Scribe: Steven Wu 1

CSCI 5525 Machine Learning Fall 2019 Lecture 11: Neural Networks (Part 3) March 2nd, 2020 Lecturer: Steven Wu Scribe: Steven Wu 1 Convolutional Neural Networks We will now study a special type of neural networks convolutional neural

662 views • 6 slides
Lecture 18: Concluding Convolutional Neural Networks, Graphical Models as Foundation for Recurrent

Lecture 18: Concluding Convolutional Neural Networks, Graphical Models as Foundation for Recurrent

Lecture 18: Concluding Convolutional Neural Networks, Graphical Models as Foundation for Recurrent Neural Networks and Bayesian Networks Reference: We will be referring to sections etc of Deep Learning by Yoshua Bengio, Ian J. Goodfellow

974 views • 54 slides
CONVOLUTIONAL AND RECURRENT NEURAL NETWORKS Neural networks Fully connected networks

CONVOLUTIONAL AND RECURRENT NEURAL NETWORKS Neural networks Fully connected networks

CONVOLUTIONAL AND RECURRENT NEURAL NETWORKS Neural networks Fully connected networks Neuron Non-linearity Softmax layer DNN training Loss function and regularization SGD and backprop Learning rate Overfitting

1.8k views • 86 slides
Convolutional Neural Networks 08, 10 & 17 Nov, 2016 J. Ezequiel Soto S. Image Processing

Convolutional Neural Networks 08, 10 & 17 Nov, 2016 J. Ezequiel Soto S. Image Processing

Convolutional Neural Networks 08, 10 & 17 Nov, 2016 J. Ezequiel Soto S. Image Processing 2016 Prof. Luiz Velho Convolutional Neural Networks 1 Summary & References 08/11 ImageNet Classification with Deep Convolutional Neural Networks

648 views • 26 slides
Lecture 5: Convolution Princeton University COS 495 Instructor: Yingyu Liang Convolutional

Lecture 5: Convolution Princeton University COS 495 Instructor: Yingyu Liang Convolutional

Deep Learning Basics Lecture 5: Convolution Princeton University COS 495 Instructor: Yingyu Liang Convolutional neural networks Strong empirical application performance Convolutional networks: neural networks that use convolution in

997 views • 31 slides
MICROBOONE Taritree Wongjirad DPF 2017 Tufts/MIT Outline Convolutional neural networks

MICROBOONE Taritree Wongjirad DPF 2017 Tufts/MIT Outline Convolutional neural networks

Run 3493 Event 41075, Oct. 23rd, 2015 CONVOLUTIONAL NEURAL NETWORKS IN MICROBOONE Taritree Wongjirad DPF 2017 Tufts/MIT Outline Convolutional neural networks (CNNs) are a type of deep, feed-forward neural networks that have been

831 views • 43 slides
Convolutional Neural Networks (Part III) 08, 10 & 17 Nov, 2016 J. Ezequiel Soto S. Image

Convolutional Neural Networks (Part III) 08, 10 & 17 Nov, 2016 J. Ezequiel Soto S. Image

Convolutional Neural Networks (Part III) 08, 10 & 17 Nov, 2016 J. Ezequiel Soto S. Image Processing 2016 Prof. Luiz Velho Convolutional Neural Networks 1 Summary & References 08/11 ImageNet Classification with Deep Convolutional

444 views • 27 slides
Convolutional Networks Lecture slides for Chapter 9 of Deep Learning Ian Goodfellow 2016-09-12

Convolutional Networks Lecture slides for Chapter 9 of Deep Learning Ian Goodfellow 2016-09-12

Convolutional Networks Lecture slides for Chapter 9 of Deep Learning Ian Goodfellow 2016-09-12 Convolutional Networks Scale up neural networks to process very large images / video sequences Sparse connections Parameter sharing

552 views • 27 slides
Convolutional Neural Networks Rachel Hu and Zhi Zhang Amazon AI d2l.ai Outline GPUs

Convolutional Neural Networks Rachel Hu and Zhi Zhang Amazon AI d2l.ai Outline GPUs

Convolutional Neural Networks Rachel Hu and Zhi Zhang Amazon AI d2l.ai Outline GPUs Convolutions Pooling, Padding and Stride Convolutional Neural Networks (LeNet) Deep ConvNets (AlexNet) Networks using Blocks (VGG)

1.91k views • 89 slides
End- End -to to- -End End QoS QoS Management Management - Reliability User User-based

End- End -to to- -End End QoS QoS Management Management - Reliability User User-based

Purdue MSI Proposal May 5, 1999 NSF CISE/EIA Research Infrastructure PI Workshop MSI : Research I nf rastructure f or I ntegrated Quality of Service (QoS) Management in Multimedia Computing Environments A.K. Elmagarmid, A. Ghafoor, T. Korb,

574 views • 8 slides
2019 ANNUAL STOCKHOLDERS MEETING 1. OUR FINANCIALS 2. UPDATES 3. KEY TAKEAWAYS OUR

2019 ANNUAL STOCKHOLDERS MEETING 1. OUR FINANCIALS 2. UPDATES 3. KEY TAKEAWAYS OUR

2019 Annual Stockholders Meeting 2019 ANNUAL STOCKHOLDERS MEETING 1. OUR FINANCIALS 2. UPDATES 3. KEY TAKEAWAYS OUR FINANCIALS 2018 Financial Highlights Php47.1b Php6.7b 1.6b 28% REVENUES NET INCOME* WHISKY BRANDY CONSOLIDATED

400 views • 25 slides
By: Kriss Debono Marketing Standards Article 113a(1) of EC 1234/2007, states that fruit and

By: Kriss Debono Marketing Standards Article 113a(1) of EC 1234/2007, states that fruit and

By: Kriss Debono Marketing Standards Article 113a(1) of EC 1234/2007, states that fruit and vegetables which are intended to be sold fresh to the consumer, may only be marketed if they are of sound, fair and marketable quality and if the

501 views • 25 slides
1 Competitivity Pole Private structure created in 2006 Industrial spaces :150 ha 3 components :

1 Competitivity Pole Private structure created in 2006 Industrial spaces :150 ha 3 components :

Chamber of Commerce and Industry of the Northeastern Bizerte Governorate of Bizerte Presentation General data Meeting point between Africa and Europe, and between East and West Located in the heart of the Mediterranean on the sea lanes of the

528 views • 6 slides
HEALTHY MIND TOOLKIT PRESENTER Laurie Kovens Laurie R. Kovens, LCSW, is a Licensed Clinical

HEALTHY MIND TOOLKIT PRESENTER Laurie Kovens Laurie R. Kovens, LCSW, is a Licensed Clinical

HEALTHY MIND TOOLKIT PRESENTER Laurie Kovens Laurie R. Kovens, LCSW, is a Licensed Clinical Social Worker in practice since 1993. She has served as a clinician in medical and employee assistance settings. She has worked with clients, families,

455 views • 28 slides
INVESTOR PRESENTATION February, March, and April 2019 FORWARD-LOOKING STATEMENTS AND NON-GAAP

INVESTOR PRESENTATION February, March, and April 2019 FORWARD-LOOKING STATEMENTS AND NON-GAAP

INVESTOR PRESENTATION February, March, and April 2019 FORWARD-LOOKING STATEMENTS AND NON-GAAP FINANCIAL MEASURES Dennys Corporation urges caution in considering its current trends and any outlook on earnings disclosed in this presentatio n.

666 views • 42 slides
How Tortillas Stack Up in the Baking Industry What is a Tortilla? In Mexico, means little

How Tortillas Stack Up in the Baking Industry What is a Tortilla? In Mexico, means little

How Tortillas Stack Up in the Baking Industry What is a Tortilla? In Mexico, means little cake In Spain and Puerto Rico, means omelette In United States, means flatbread Tortillas are Unique

600 views • 21 slides
ALL ABOARD - For Love of Country Mr. Speaker Sir, I stand before you....18 days since the good

ALL ABOARD - For Love of Country Mr. Speaker Sir, I stand before you....18 days since the good

ALL ABOARD - For Love of Country Mr. Speaker Sir, I stand before you....18 days since the good people of Barbados went to the polls and elected my party, the Barbados Labour Party, to office, with an overwhelming, indeed, an unprecedented

724 views • 41 slides

More recommend