Visual Reinforcement Learning with Imagined Goals Ashvin Nair*, - - PowerPoint PPT Presentation

visual reinforcement learning with imagined goals
SMART_READER_LITE
LIVE PREVIEW

Visual Reinforcement Learning with Imagined Goals Ashvin Nair*, - - PowerPoint PPT Presentation

Visual Reinforcement Learning with Imagined Goals Ashvin Nair*, Vitchyr Pong* , Murtaza Dalal, Shikhar Bahl, Steven Lin, Sergey Levine Autonomous Learning Autonomous Learning Autonomous Learning Reinforcement Learning? Autonomous Learning:


slide-1
SLIDE 1

Visual Reinforcement Learning with Imagined Goals

Ashvin Nair*, Vitchyr Pong*, Murtaza Dalal, Shikhar Bahl, Steven Lin, Sergey Levine

slide-2
SLIDE 2

Autonomous Learning

slide-3
SLIDE 3

Autonomous Learning

slide-4
SLIDE 4

Autonomous Learning

Reinforcement Learning?

slide-5
SLIDE 5

Autonomous Learning: Proof of Concept

slide-6
SLIDE 6

Reinforcement Learning with Imagined Goals (RIG)

slide-7
SLIDE 7

Reinforcement Learning with Imagined Goals (RIG)

Autonomous goal setting

slide-8
SLIDE 8

Reinforcement Learning with Imagined Goals (RIG)

Autonomous goal setting Vision input

slide-9
SLIDE 9

Reinforcement Learning with Imagined Goals (RIG)

Autonomous goal setting Vision input Real-world results

slide-10
SLIDE 10

RIG: Autonomous Learning

slide-11
SLIDE 11

RIG: Autonomous Learning

slide-12
SLIDE 12

RIG: Autonomous Learning

slide-13
SLIDE 13

RIG: Autonomous Learning

slide-14
SLIDE 14

RIG: Test Time

slide-15
SLIDE 15

RIG: Test Time

slide-16
SLIDE 16

Simulation: Autonomous Exploration

slide-17
SLIDE 17

Simulation: Autonomous Exploration

slide-18
SLIDE 18

Simulation: Test Time

slide-19
SLIDE 19

Simulation: Other Environments

Human-specified Goal State

slide-20
SLIDE 20

Real-world Experiments

  • No human supervision
  • Directly from vision
  • 0.5-2.5 Hours

Human-specified Goal State

slide-21
SLIDE 21

Reinforcement Learning with Imagined Goals: Conclusion

Environments: https://github.com/vitchyr/multiworld/ Algorithm: https://github.com/vitchyr/rlkit Website: https://sites.google.com/site/visualrlwithimaginedgoals/ Poster: #141