ISAAC LAB SIMULATING VIRTUAL WORLDS FOR ROBOT INTELLIGENCE Gavriel - PowerPoint PPT Presentation

ISAAC LAB SIMULATING VIRTUAL WORLDS FOR ROBOT INTELLIGENCE Gavriel State | NVIDIA | November 1 st 2017

AI: A NEW ERA OF COMPUTING AI & INTELLIGENT DEVICES MOBILE-CLOUD PC INTERNET 2

AI PROCESSOR FOR AUTONOMOUS MACHINES General CPU Purpose Architectures + Domain CUDA Volta Specific GPU Accelerators DLA Energy Efficiency XAVIER 30 TOPS DL 30W Custom ARM64 CPU 512 Core Volta GPU 10 TOPS DL Accelerator 3

ROBOTS SEE, HEAR, TOUCH LEARN ACT & PLAN 4

REINFORCEMENT LEARNING Robot Environment State + Reward Critic Action Actor 5

REINFORCEMENT LEARNING - EXAMPLE Credit: Yevgen Chebotar, Karol Hausman, Marvin Zhang, Sergey Levine 6

ISAAC ROBOT SIMULATOR SEE, HEAR, TOUCH Robot & Environment Definition ISAAC OpenAI Robot Simulator GYM LEARN ACT & PLAN NVIDIA GPU Computer Virtual Jetson 7

ISAAC HOCKEY 8

ISAAC ROBOT SIMULATOR Train robots in virtual environments to perform tasks in the real world Use state-of-the-art rendering (based on Unreal Engine) and realistic physics (PhysX, FleX) to create virtual learning environments Faster, safer, and cheaper than reinforcement learning with real robots! Leverage the compute power of NVIDIA GPUs to train with multiple episodes and/or agents simultaneously 9

PHYSICS SIMULATION 10

ISAAC SIMULATION MODEL GAME ENGINE VIRTUAL ROBOT Rendering Virtual Sensors Environment Intelligence Physics Virtual Effectors 11

SIMULATION + RL ISAAC RL Environment Robot OpenAI Rendering Virtual Observations Definition Engine Sensors Baselines Gym Interface Physics Virtual Actions Engine Effectors Environment TensorFlow 12

LETS DO THE TIME WARP Speed up training using multiple agents 13

ISAAC GOLF EXAMPLE 14

ISAAC DOMINOES 15

ISAAC DOMINOES IN VR 16

ISAAC DOMINOES DETAILS How all the pieces fit together Four software components: AI server • Vision system • Gameplay • Physical movement Client • Human Interaction 17

VISION – SUPERVISED LEARNING Requires labeled data 18

VISION TRAINING - SYNTHETIC DATA 19

VISION RESULTS – REAL WORLD 20

VISION RESULTS – REAL WORLD 21

REINFORCEMENT LEARNING Continuous Action Space 22

REINFORCEMENT LEARNING Limited Action Space 23

HUMAN / ROBOT INTERACTION 24

NVIDIA POWERING THE AI REVOLUTION NVIDIA GPU CLOUD CSPs NVIDIA GPU in Every Cloud NVIDIA GPU Cloud Tensor Core Xavier DLA TensorRT Open Source Tesla V100 DGX-1 and DGX Station ISAAC 25

Fundamentals NVIDIA DEEP LEARNING INSTITUTE Training available as online self-paced labs and instructor-led workshops Take self-paced labs at www.nvidia.com/dlilabs Find or request an instructor-led workshop at www.nvidia.com/dli Educators: download the Teaching Kit at developer.nvidia.com/teaching-kit and contact nvdli@nvidia.com for info on the University Ambassador Program Autonomous Vehicles Healthcare Media & Entertainment …and more Machine Vision - IVA Finance 26