The Future of #GPU Rendering #GTC17 #Octane OTOY Inc. May 2017 - - PowerPoint PPT Presentation

the future of gpu rendering gtc17 octane
SMART_READER_LITE
LIVE PREVIEW

The Future of #GPU Rendering #GTC17 #Octane OTOY Inc. May 2017 - - PowerPoint PPT Presentation

The Future of #GPU Rendering #GTC17 #Octane OTOY Inc. May 2017 OTOYs Mission: Practical digital holographic* content creation and publishing for everyone *(Digital Hologram: 8D light field volume + depth + reflectance) The future of


slide-1
SLIDE 1

The Future of #GPU Rendering #GTC17 #Octane

OTOY Inc.

May 2017

slide-2
SLIDE 2

OTOY’s Mission:

  • Practical digital holographic* content creation and publishing for everyone

*(Digital Hologram: 8D light field volume + depth + reflectance)

slide-3
SLIDE 3

The future of Rendering…

slide-4
SLIDE 4

Rendering in 2020’s may feel a lot like ‘magic’:

  • Photorealism for billions: Cinematic VFX built

into all devices - for free

  • Real-time game engines used even for linear

media (~UE4 in Rogue One)

  • Intuitive spatial UX (~Tilt Brush) powers most

media creation/consumption

slide-5
SLIDE 5

0..1..2..3..4..?

2010 … 2012 … 2014 … 2016 … 2018… 2020

1.0 Images 2.0 Animations 3.0 Cinematic VFX 4.0 Real Time ….. (TBD – but AI important)

A decade of GPU rendering phases in ~2 year increments:

slide-6
SLIDE 6

2016/17 Recap

slide-7
SLIDE 7
  • Launch of Octane 3.0 + ORC test drive in May ‘16
  • Subscriptions w/ plugin for < $20/month since Q1
  • Major Octane partnerships – Unity and Facebook 
  • About to release 3.07… ~70% done with 3.x roadmap
  • Octane 3.10 alpha SDK looking good 
slide-8
SLIDE 8

3

slide-9
SLIDE 9
slide-10
SLIDE 10
slide-11
SLIDE 11

+

  • Physically correct path tracing in the free version of Unity 2017+
  • Octane GPU rendering shipping to ~7 million artists and creators 
  • Light Field baking and real-time path tracing on 2017 Roadmap  
slide-12
SLIDE 12

ORBX F RBX Faceb ebook k 6DOF V Video C Camer era S System em

slide-13
SLIDE 13

OTOY an and F Fac aceboo

  • ok 6DO

6DOF O Octane e ecos

  • syste

tem

slide-14
SLIDE 14

3.07

New features:

  • ORBX proxy import/editing
  • Full standalone UX now works from plug-ins
  • Full Operator nodes – textures, logic, math, vectors
  • Time, Frequency transform control
  • New baking system for real time viewport
slide-15
SLIDE 15

3.07

New features:

  • Native C API – imager, geometry, compute, UX nodes
  • Render Target->Texture for biased/baked rendering
  • Render Jobs can work across both ORC/local
  • Export and Import FBX and glTF (1.0)
  • Fake (but fast) volumetric spot lights (i.e. Unity)
slide-16
SLIDE 16

3.07

ORBX import and proxy inspector in plug-in API:

slide-17
SLIDE 17

3.07

Full standalone UX can be used in plug-in API:

slide-18
SLIDE 18

3.07

Native bone and skinning system + FBX and glTF:

slide-19
SLIDE 19

3.07

Transform gizmos in live Octane Viewport (including bone/joints):

slide-20
SLIDE 20

3.07

Render To Texture - baking, displacement & biased compositing:

slide-21
SLIDE 21

Modules

Native C/C++ API for procedural geometry, asset, compute nodes:

slide-22
SLIDE 22

Module Examples

Experimental Vector Displacement Module:

slide-23
SLIDE 23

Module Examples

Native 3rd party module API can expand 3.x for a very long time:

  • UDIM (currently only in MODO 3.06 plug-in)
  • PTEX (w/ face primID support in core)
  • OpenFX C wrapper (Foundry/Nuke) – e.g. NeatVideo
  • Physics, dynamics, IK modules - e.g. bullet, flex, CL 1.2
  • New script node language VMs – e.g. C#, JS, Python
slide-24
SLIDE 24

Module Examples

Native 3rd party module API can expand 3.x for a very long time:

  • Custom mesh attribute mapping at runtime
  • 3rd party scene I/O – e.g. USD, glTF 2.0
  • 3rd party material I/O - MaterialX, MDL, OCIO
  • Ext. C++ asset editors: Substance, Houdini, Unity, LLVM
  • Viewport adaptive asset loading / filters
slide-25
SLIDE 25

Cross Compiler

Cross compiler:

  • Mac OS (AMD GPU) – top priority
  • CPU (x86) fallback (Linux/Mac/Win)
slide-26
SLIDE 26

Cross Compiler

GPU (Intel) = 4x speed on same x86 CPU (Windows 10)

slide-27
SLIDE 27

3.1

OSL Textures, Materials, Shaders and Environments:

slide-28
SLIDE 28

3.1

Copy & paste OSL texture right from Arnold 5 web page 

slide-29
SLIDE 29

3.1

V-Ray Flakes OSL texture map:

slide-30
SLIDE 30

3.1

OSL Textures , Materials, Volumes and Environments:

slide-31
SLIDE 31

3.1

slide-32
SLIDE 32

3.1

OSL MetaData integration in ORBX node graph:

string label Provides a name displayed on the GUI for the variable string help Provides a description for the pin when you hover your mouse over the pin string page Allows you to group different pins under the group name you have specified string widget By default, Octane will decide what kind of widget you use for your pin through your variable type. However, in special cases you can specify the type of widget to use. We have implemented "boolean", "checkBox", for int type so you can use a checkbox instead of a slider for the integer value. Alternatively, you can specify an int variable to use "mapper" for selecting enumerations. float min, max Allows you to specify the range for a float type variable int min, max Allows you to specify the range for a int type variable float/ int sensitivity Allows you to specify the steps for a float/int type variable int slidermin Allows you to specify the minimum slider value (this is different to min), it's for the GUI minimum. int slidermax Allows you to specify the minimum slider value (this is different to min), it's for the GUI maximum. float slidermin Same as slidermin for int. float slidermax Same as slidermax for int.
slide-33
SLIDE 33

ORC

slide-34
SLIDE 34

ORC

ORC is coming out of test drive after 3.06 OctaneBench:

  • ORC subscription is sold just like any other OR plug-in
  • Includes BYO license for custom 3rd party cloud

workflows (e.g. Deadline)

  • $5 buckets = 400 OctaneBench/Hour (e.g. per frame)

– local -> cloud value is much simpler to estimate

  • Set job ETA >24h or set max $/frame to reduce costs
  • 3rd party render farms can bid on $5 buckets via ORC

SDK (similar to Octane plug-in SDK) – if offer is better than 400 OB/Hr (and reliable) it’s a win 

slide-35
SLIDE 35

ORC

slide-36
SLIDE 36

OctaneEngine

WebSocket API + HTML5 UX via ORC:

slide-37
SLIDE 37

Basic subscription:

  • $19.99/month (max 2 GPUs)
  • Real time suite includes: Unity, UE4, Adobe After

Effects / CC , Nuke, ADSK Fusion 360 (more coming)

  • + Additional plug-in of your choice (i.e. C4D, ORC,

Maya, Katana, etc.)

Subscriptions

slide-38
SLIDE 38

Pro subscription:

  • Access to all Octane plug-ins 
  • Up to 20 GPUs  (node count TBD)
  • Imager/Engine cloud jobs (e.g. Facebook 6DOF)
  • Price ~= full Adobe CC monthly subscription

Subscriptions

slide-39
SLIDE 39

Preview of Autodesk Fusion 360 Octane plug-in:

Subscriptions

slide-40
SLIDE 40

OctaneImager

slide-41
SLIDE 41

OctaneImager

Compositing and post processing framework

  • Independent filter, custom LUT and imaging SDK
  • NPR effects
  • Multi-light
  • Light Field and 6DOF media
  • New: Direct Lighting, GI, AO, glossy ray-tracing
  • Experimental: Real Time denoising 
slide-42
SLIDE 42

OctaneImager

Ho Holographic na navigable e XYZ XYZT m T med edia s str trea eam:

slide-43
SLIDE 43

OctaneImager

slide-44
SLIDE 44

OctaneImager

slide-45
SLIDE 45

OctaneImager

Noise se f free ( (but b biase sed) A AO/GI/ GI/gl gloss ssy r ray t traci cing: g:

slide-46
SLIDE 46

4

Real Time

slide-47
SLIDE 47
slide-48
SLIDE 48
slide-49
SLIDE 49

4

  • Octane 4 integrates all of Brigade’s features to date
  • Game engine API – working with Unity to optimize by ’18
  • Much faster IES lights, point lights. Etc.
  • Out of Core geometry on GPU (alt. to NV Link)
  • Support for Ray Tracing hardware (tested on PVR)
slide-50
SLIDE 50

What’s next?

slide-51
SLIDE 51

AI

slide-52
SLIDE 52

Octane AI - Deep Learning/NN ORBX imager nodes

  • Super Resolution & denoising (real time on GTX 1080)

AI

slide-53
SLIDE 53

Octane AI - Deep Learning/NN ORBX nodes

  • Super Resolution & denoising (real time on GTX 1080)

AI

slide-54
SLIDE 54

AI

slide-55
SLIDE 55

SR x2 Cubic x2

SR Cubic Ground Truth

AI

slide-56
SLIDE 56

SR x4 Cubic x4

SR Cubic Ground Truth

AI

slide-57
SLIDE 57

AI is going to play a big part in the creative process:

  • Image/video capture-> ORBX BRDF scene + objects
  • Auto-Human IK body and face tracking in real time
  • Can be tested on FB 6DOF and LightStage data
  • Auto-vegetation/terrain scattering from video/images
  • language / predictive input-> ORBX scene, material

node graph

AI

slide-58
SLIDE 58

HAIR / FUR

Thank you!

slide-59
SLIDE 59

The Future of Rendering #GTC17 #OTOY #OctaneRender

OTOY Inc.

May 2017