SYNTHETIC DATA / AI Rev Lebaredian - Vice President, Simulation - - PowerPoint PPT Presentation

synthetic data ai
SMART_READER_LITE
LIVE PREVIEW

SYNTHETIC DATA / AI Rev Lebaredian - Vice President, Simulation - - PowerPoint PPT Presentation

SYNTHETIC DATA / AI Rev Lebaredian - Vice President, Simulation Technolgy NEURAL NETWORKS NEED DATA And Labels! Deep Learning is amazing! Require huge amounts of quality data Data needs labeling For some problems, data + labeling is available


slide-1
SLIDE 1

Rev Lebaredian - Vice President, Simulation Technolgy

SYNTHETIC DATA / AI

slide-2
SLIDE 2

2

NEURAL NETWORKS NEED DATA

Deep Learning is amazing! Require huge amounts of quality data Data needs labeling For some problems, data + labeling is available Good data doesn’t exists for most problems

And Labels!

Image-Net (http://www.image-net.org/) example

slide-3
SLIDE 3

3

DOMINOS, ANYONE?

Isaac at SIGGRAPH 2017

slide-4
SLIDE 4

4

NO EXISTING DATASET

slide-5
SLIDE 5

5

Labeled Data

1min per object

slide-6
SLIDE 6

7

SYNTHETIC DATA

Real data is expensive, sometimes dangerous Synthetic labels are automatic and accurate Useful for validation, in addition to training

slide-7
SLIDE 7

8

AV SYNTHETIC DATASETS

Virtual KITTI

Adrien Gaidon, Qiao Wang, Yohann Cabon, Eleonora Vig: Virtual Worlds as Proxy for Multi-Object Tracking Analysis IEEE CVPR 2016

slide-8
SLIDE 8

9

DOMAIN RANDOMIZATION

Explore the gap using random cars, textures, camera, distractors, etc

slide-9
SLIDE 9

10

DOMAIN RANDOMIZATION

Example Scenes

slide-10
SLIDE 10

11

STRUCTURED DOMAIN RANDOMIZATION

Putting it all together

slide-11
SLIDE 11

12

SIMULATE TRAIN MODELS COLLECT DATA DRIVE

NVIDIA DRIVE END-TO-END PLATFORM

Lanes Lights

Path

Signs

Pedestrians Cars

Lanes Lights

Path

Signs

Pedestrians Cars

slide-12
SLIDE 12

13

slide-13
SLIDE 13

14

slide-14
SLIDE 14

15

AlphaZero OpenAI Five OpenAI, 2018 Deepmind, 2018

REINFORCEMENT LEARNING SUCCESSES

slide-15
SLIDE 15

16

APPLICATIONS

Locomotion/Animation

Reinforcement Learning

Liang, Makoviychuk, Handa etc, 2018 NVIDIA

slide-16
SLIDE 16

17

APPLICATIONS

Sim2Real Robotics

Robotics

Chebotar, Handa, Makoviychuk, etc, 2018 NVIDIA

slide-17
SLIDE 17

18

EXAMPLES

Locomotion

slide-18
SLIDE 18

19

EXAMPLES

Locomotion + Physics

slide-19
SLIDE 19

20

EXAMPLES

Locomotion + Physics

slide-20
SLIDE 20

21

ISAAC GYM

Toolkit for Parallel AI Learning Experiments

slide-21
SLIDE 21

22

PHYSICS

PhysX

slide-22
SLIDE 22

23

PHYSICS

FleX

  • Multi-physics
  • Rigid and FEM soft bodies
  • Cloth, ropes
  • Liquids
  • Two-way coupling and force

propagation between different phases

slide-23
SLIDE 23

24

CABLE ROBOT

slide-24
SLIDE 24

25

ROBOTS

LEARN & PLAN SEE, HEAR, TOUCH ACT

slide-25
SLIDE 25

26

slide-26
SLIDE 26

27

slide-27
SLIDE 27

28

BARTENDING ROBOT

Trained in Isaac Gym

slide-28
SLIDE 28

29

ISAAC SIM

slide-29
SLIDE 29

30

slide-30
SLIDE 30

31

slide-31
SLIDE 31

32

slide-32
SLIDE 32

33

Our Reality Virtual Reality Reality Human Artificial Intelligence

slide-33
SLIDE 33