PyTorch and Neural Nets Review Session CS285 Instructor: Vitchyr - - PowerPoint PPT Presentation

pytorch and neural nets review session
SMART_READER_LITE
LIVE PREVIEW

PyTorch and Neural Nets Review Session CS285 Instructor: Vitchyr - - PowerPoint PPT Presentation

PyTorch and Neural Nets Review Session CS285 Instructor: Vitchyr Pong Goal of this course Train an agent to perform useful tasks common training paradigm this lecture train model agent data collect data How do we train a model? How do


slide-1
SLIDE 1

PyTorch and Neural Nets Review Session

CS285 Instructor: Vitchyr Pong

slide-2
SLIDE 2

Goal of this course

Train an agent to perform useful tasks

slide-3
SLIDE 3

common training paradigm

data agent train model collect data this lecture

slide-4
SLIDE 4

How do we train a model?

slide-5
SLIDE 5

How do we train a model?

neural network

slide-6
SLIDE 6

How do we train a model?

gradient descent neural network

slide-7
SLIDE 7

How do we train a model?

gradient descent neural network

slide-8
SLIDE 8

What is PyTorch?

Python library for…

  • Defining neural networks
  • Automatically computing gradients

gradient descent neural network

slide-9
SLIDE 9

What is PyTorch?

Python library for…

  • Defining neural networks
  • Automatically computing gradients
  • And more (GPU, optimizers, etc.)

gradient descent neural network

slide-10
SLIDE 10

PyTorch Alternatives

TensorFlow, JAX, Chainer, … Basically all do the same

slide-11
SLIDE 11

How does Pytorch work?

slide-12
SLIDE 12

PyTorch: forward pass

[picture from Stanford’s CS231n]

slide-13
SLIDE 13

PT computes You define

PyTorch: backward pass

[picture from Stanford’s CS231n]

slide-14
SLIDE 14

PyTorch Tutorial (Colab)

https://colab.research.google.com/drive/1r_-Ow0QYPN58cfuNjZDUy4O6HUvPDxyN?usp=sharing