[PPT] - TURING VR Davis Lin , PowerPoint Presentation, free download

SLIDE 1

Davis Lin 林耀南, Dec 19th

TURING 架构、实时光线追踪和人工智能在VR中的技术应用

SLIDE 2

2

三大核心，通力合作

TURING

Tensor Core 核心处理器每秒114兆次浮点运算每秒228兆次八位元整数精度运算每秒455兆次四位元整数精度运算 RT Core 光线追踪核心处理器每秒100亿道光线追踪 Ray Triangle Intersection 射线与三角形相交检测 BVH Traversal 加速光线追踪效能 Turing SM 核心处理器每秒14兆次浮点运算 + 每秒14兆次整数运算可同时执行浮点运算和整数运算可变尺度着色器

SLIDE 3

3

POWERING A NEW ERA OF VR

TURING ｜全新的VR计算平台

全新的VR渲染方式实时光线追踪和新SM架构实时AI 和TENSOR CORE 5G AND CLOUD XR

SLIDE 4

4

实时光线追踪和新SM架构

SLIDE 5

5

TURING RAY TRACING WITH RT CORES

HARDWARE ACCELERATION REPLACES SOFTWARE EMULATION

Turing SM

Return hit Shading Launch Ray Probe

RT Core Shaders

Ray/triangle intersection test Fetch box Decode box Intersection test Sub-box or tris?

Box Intersection Evaluators Triangle Intersection Evaluators

SLIDE 6

6

RAY TRACING 光线追踪运算 FP32 SHADING 浮点运算 DNN PROCESSING

1 TURING FRAME

INT32 SHADING 整数运算

NEW PERFORMANCE STANDARD

深度神经网络运算

SLIDE 7

7

14 FP32 TFLOPS // 100 TFLOPS (10 TFLOPS PER GIGA RAY) 14 FP32 TFLOPS + 14 INT32 TIPS 114 FP16 TENSOR FLOPS

RAY TRACING 光线追踪运算 FP32 SHADING 浮点运算 DNN PROCESSING

1 TURING FRAME

INT32 SHADING 整数运算深度神经网络运算

RT Cores Tensor Cores Turing SM Turing SM Turing SM

NEW PERFORMANCE STANDARD

SLIDE 8

8

BULLET ICON

Body/bullet text WITH a bullet icon option

SLIDE 9

9 9

SLIDE 10

10 10

TURING架构 1.5X

每时脉执行指令数

0.5 1.0 1.5 2.0 Turing Pascal

Shadow

f War

Rise of the Tomb Raider 3DMark VR Mark Deus Ex Sniper Elite 4 Ashes of the Singularity Example Shader 每时脉执行指令数（倍数）

SLIDE 11

11 11

SLIDE 12

12

实时AI 和TENSOR CORE

SLIDE 13

13

TENSOR CORE

ACCELERATING COMPUTATION OF MATRIX MULTIPLES

SLIDE 14

14

TENSOR CORE

ACCELERATING COMPUTATION OF MATRIX MULTIPLES

SLIDE 15

15

Up to

32X

SLIDE 16

16

InnoReal Photo-Realistic 3D Reconstruction system is a total solution for high precision 3D capture and rendering , it contains 5 modules:

Robotic Arm & Rail system for mobilize camera at 6

degree of freedom, cover subject in every angle.

High fidelity RGB & Depth camera system, capture

RBG in 6k resolution ,and depth precision in 2 mm.

3D reconstruction and surface BRDF reconstruction

software system based on CNN & GAN Neural Network

Texture and BRDF compression software based on

Neural Network

Realtime Rendering & streaming SDK compatible for

iOS, Android, Windows, Linux and HTML5

PHOTO REALISTIC 3D RECONSTRUCTION

Powered by Galasports

SLIDE 17

17

InnoReal system not only reconstruct accurate geometry, but also reconstruct accurate surface reflection parameters according to PBR BRDF model

SLIDE 18

18

Diffuse Surface BRDF Neural Network Reconstructed Surface BRDF

SLIDE 19

19

InnoReal Trained a GAN model through 40k synthesized materials, the GAN network could predict BRDF parameters at each surface pixel according to input reflection samples

f that surface pixel at multiple angle.

The BRDF parameters are stored in a latent texture space, which could dramatically decrease texture data size. The frontend renderer decompress texture through a trained autoencoder and then render the texture and geometry by OpenGL

SLIDE 20

20

SLIDE 21

21

全新的VR渲染方式

SLIDE 22

22

Foveated Rendering Content Adaptive Shading Lens Optimized Shading VRS Wrapper APIs (VRS Helper and Gaze Handler) are available as a part of NVIDIA VRWorks Graphics 3.3 SDK. With the launch of the VIVE Pro Eye, HTC has created a Unity plugin, which has the VRS Wrapper NVAPIs integrated.

VARIABLE RATE SHADING