SLIDE 1
Gavriel State | NVIDIA | November 1st 2017
2
AI: A NEW ERA OF COMPUTING
PC INTERNET AI & INTELLIGENT DEVICES MOBILE-CLOUD
ISAAC LAB SIMULATING VIRTUAL WORLDS FOR ROBOT INTELLIGENCE Gavriel - - PowerPoint PPT Presentation
ISAAC LAB SIMULATING VIRTUAL WORLDS FOR ROBOT INTELLIGENCE Gavriel - - PowerPoint PPT Presentation
ISAAC LAB SIMULATING VIRTUAL WORLDS FOR ROBOT INTELLIGENCE Gavriel State | NVIDIA | November 1 st 2017 AI: A NEW ERA OF COMPUTING AI & INTELLIGENT DEVICES MOBILE-CLOUD PC INTERNET 2 AI PROCESSOR FOR AUTONOMOUS MACHINES General CPU
SLIDE 2
SLIDE 3
3
AI PROCESSOR FOR AUTONOMOUS MACHINES
XAVIER 30 TOPS DL 30W Custom ARM64 CPU 512 Core Volta GPU 10 TOPS DL Accelerator
General Purpose Architectures Domain Specific Accelerators
Energy Efficiency
CPU CUDA GPU DLA Volta
+
SLIDE 4
4
ROBOTS
LEARN & PLAN SEE, HEAR, TOUCH ACT
SLIDE 5
5
REINFORCEMENT LEARNING
Robot Environment
Critic Actor
Action State + Reward
SLIDE 6
6
REINFORCEMENT LEARNING - EXAMPLE
Credit: Yevgen Chebotar, Karol Hausman, Marvin Zhang, Sergey Levine
SLIDE 7
7
ISAAC ROBOT SIMULATOR
NVIDIA GPU Computer ISAAC Robot Simulator OpenAI GYM Robot & Environment Definition Virtual Jetson LEARN & PLAN SEE, HEAR, TOUCH ACT
SLIDE 8
8
ISAAC HOCKEY
SLIDE 9
9
ISAAC ROBOT SIMULATOR
Train robots in virtual environments to perform tasks in the real world Use state-of-the-art rendering (based on Unreal Engine) and realistic physics (PhysX, FleX) to create virtual learning environments Faster, safer, and cheaper than reinforcement learning with real robots! Leverage the compute power of NVIDIA GPUs to train with multiple episodes and/or agents simultaneously
SLIDE 10
10
PHYSICS SIMULATION
SLIDE 11
11
ISAAC SIMULATION MODEL
GAME ENGINE
Rendering Environment Physics
VIRTUAL ROBOT
Virtual Sensors Intelligence Virtual Effectors
SLIDE 12
12
RL Environment
SIMULATION + RL
ISAAC
Rendering Engine
Robot Definition Environment
Gym Interface
Actions Physics Engine Virtual Sensors Virtual Effectors Observations
OpenAI Baselines TensorFlow
SLIDE 13
13
LETS DO THE TIME WARP
Speed up training using multiple agents
SLIDE 14
14
ISAAC GOLF EXAMPLE
SLIDE 15
15
ISAAC DOMINOES
SLIDE 16
16
ISAAC DOMINOES IN VR
SLIDE 17
17
ISAAC DOMINOES DETAILS
Four software components:
- Vision system
- Gameplay
- Physical movement
- Human Interaction
How all the pieces fit together
AI server Client
SLIDE 18
18
VISION – SUPERVISED LEARNING
Requires labeled data
SLIDE 19
19
VISION TRAINING - SYNTHETIC DATA
SLIDE 20
20
VISION RESULTS – REAL WORLD
SLIDE 21
21
VISION RESULTS – REAL WORLD
SLIDE 22
22
REINFORCEMENT LEARNING
Continuous Action Space
SLIDE 23
23
REINFORCEMENT LEARNING
Limited Action Space
SLIDE 24
24
HUMAN / ROBOT INTERACTION
SLIDE 25
25
NVIDIA POWERING THE AI REVOLUTION
NVIDIA GPU Cloud ISAAC NVIDIA GPU in Every Cloud
Xavier DLA Open Source
DGX-1 and DGX Station Tesla V100
TensorRT
Tensor Core
NVIDIA GPU CLOUD CSPs SLIDE 26
26
Fundamentals Autonomous Vehicles Media & Entertainment Finance
NVIDIA DEEP LEARNING INSTITUTE
Training available as online self-paced labs and instructor-led workshops Take self-paced labs at www.nvidia.com/dlilabs Find or request an instructor-led workshop at www.nvidia.com/dli Educators: download the Teaching Kit at developer.nvidia.com/teaching-kit and contact nvdli@nvidia.com for info on the University Ambassador Program
Machine Vision - IVA Healthcare …and more
SLIDE 27