with VRWorks Ryan Prescott COME DO YOUR LIFES WORK JOIN NVIDIA We - - PowerPoint PPT Presentation

▶
with vrworks
SMART_READER_LITE
LIVE PREVIEW

with VRWorks Ryan Prescott COME DO YOUR LIFES WORK JOIN NVIDIA We - - PowerPoint PPT Presentation

Mar 05, 2023 33 likes •313 views

Rendering Faster and Better with VRWorks Ryan Prescott COME DO YOUR LIFES WORK JOIN NVIDIA We are looking for great people at all levels to help us accelerate the next wave of AI-driven computing in Research, Engineering, and Sales and

slide-1
SLIDE 1

Ryan Prescott

Rendering Faster and Better with VRWorks

slide-2
SLIDE 2

2 gameworks.nvidia.com

COME DO YOUR LIFE’S WORK

JOIN NVIDIA

We are looking for great people at all levels to help us accelerate the next wave of AI-driven computing in Research, Engineering, and Sales and Marketing. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions like artificial intelligence and autonomous cars. Check out our career opportunities:

  • www.nvidia.com/careers
  • Reach out to your NVIDIA social network or NVIDIA recruiter at

DeepLearningRecruiting@nvidia.com

slide-3
SLIDE 3

3 gameworks.nvidia.com

Talk Overview

VRWorks Features

Context Priority, VR SLI Multi-Res Shading, Lens Matched Shading, Single Pass Stereo

UnrealEngine 4 Integration

slide-4
SLIDE 4

4 gameworks.nvidia.com

NVIDIA VRWorks

COMPREHENSIVE SDK FOR VR DEVELOPERS

GRAPHICS HICS HEADSE SET PROFESSIO FESSIONAL NAL AUDIO TOUCH H & PHYSI SICS CS

slide-5
SLIDE 5

5 gameworks.nvidia.com

How is VR rendering different?

slide-6
SLIDE 6

6 gameworks.nvidia.com

How is VR rendering different?

High framerate, low latency High FPS, low latency Stereo Rendering Lens Distortion

slide-7
SLIDE 7

7 gameworks.nvidia.com

Improving Async Timewarp

slide-8
SLIDE 8

8 gameworks.nvidia.com

Context priority for asynchronous time warp

Reduces latency from head rotation

Frame (Left) Frame (Right) Head Tracking (t) Warped Frame Head Tracking (t+1)

slide-9
SLIDE 9

9 gameworks.nvidia.com

TRIANGLES COMMAND PUSHBUFFER PIXELS

PREEMPT MPT

Pascal Graphics Preemption

Improves responsiveness

slide-10
SLIDE 10

19 gameworks.nvidia.com

VR SLI

slide-11
SLIDE 11

20 gameworks.nvidia.com

VR SLI

Two eyes...two GPUs!

slide-12
SLIDE 12

23 gameworks.nvidia.com

VR SLI

GPU affinity masking: full control

Shadow maps, GPU physics, etc. Left eye rendering Right eye rendering

UINT SetGPUMask( [in] UINT GPUMask );

slide-13
SLIDE 13

24 gameworks.nvidia.com

VR SLI

Broadcasting reduces CPU overhead R L

Render scene

  • nce
slide-14
SLIDE 14

29 gameworks.nvidia.com

Multi-Resolution Shading

slide-15
SLIDE 15

30 gameworks.nvidia.com

VR headset optics

Distortion and counter-distortion

slide-16
SLIDE 16

31 gameworks.nvidia.com

VR headset optics

Distortion and counter-distortion

User’s view Image Displayed Optics

slide-17
SLIDE 17

32 gameworks.nvidia.com

Distorted rendering

Render normally, then resample

Rendered image Distorted image

slide-18
SLIDE 18

33 gameworks.nvidia.com

Distorted rendering

Over-rendering the outskirts

Rendered image Distorted image

slide-19
SLIDE 19

34 gameworks.nvidia.com

Multi-resolution shading

Subdivide the image, and shrink the outskirts

slide-20
SLIDE 20

35 gameworks.nvidia.com

Multi-resolution shading

Fast viewport broadcast on NVIDIA Maxwell and beyond GPUs

Viewport 1 Viewport 2 Viewport N

...

Geometry Pipeline

slide-21
SLIDE 21

36 gameworks.nvidia.com

UE4 Multi-resolution shading performance

UE4 Infiltrator demo: +30% to +40% FPS

@ approximate VR render res

Everest VR seeing up to +40% Best when pixel-bound

We’ve seen ~50% perf boosts

Performance

slide-22
SLIDE 22

37 gameworks.nvidia.com

Lens Matched Shading

RENDERS TO A LENS CORRECTED SURFACE

slide-23
SLIDE 23

38 gameworks.nvidia.com

LMS Image Original Image

Lens Matched Shading

RENDERS TO A LENS CORRECTED SURFACE

slide-24
SLIDE 24

39 gameworks.nvidia.com

TRADITIONAL STEREO RENDERING

REQUIRES 2 GEOMETRY PASSES

Left Eye (Pass 1) Right Eye (Pass 2)

slide-25
SLIDE 25

40 gameworks.nvidia.com

SINGLE PASS STEREO

RENDERS LEFT & RIGHT EYE IN ONE GEOMETRY PASS

Left Eye Right Eye

slide-26
SLIDE 26

42 gameworks.nvidia.com

Multi-Res in UnrealEngine 4

slide-27
SLIDE 27

43 gameworks.nvidia.com

Multi-resolution shading

We’ve integrated multi-res in UE 4.10, 4.11, and 4.12 Currently limited support for post effects with multi-res Available on GitHub

https://github.com/NvPhysX/UnrealEngine/tree/MultiRes-4.10 https://github.com/NvPhysX/UnrealEngine/tree/MultiRes-4.11 https://github.com/NvPhysX/UnrealEngine/tree/MultiRes-4.12 Pascal features coming soon

Unreal Engine integration

slide-28
SLIDE 28

Questions? rprescott@nvidia.com http://developer.nvidia.com/vrworks