Related Problems to Rendering Sung-Eui Yoon ( ) Course URL: - - PowerPoint PPT Presentation

▶
related problems to rendering
SMART_READER_LITE
LIVE PREVIEW

Related Problems to Rendering Sung-Eui Yoon ( ) Course URL: - - PowerPoint PPT Presentation

Nov 13, 2023 251 likes •450 views

CS580: Related Problems to Rendering Sung-Eui Yoon ( ) Course URL: http://sglab.kaist.ac.kr/~sungeui/GCG Applications of Rendering Virtual and augmented reality Artistic controls 2 Augmented Reality (AR) and Virtual Reality

slide-1
SLIDE 1

CS580:

Related Problems to Rendering

Sung-Eui Yoon (윤성의)

Course URL: http://sglab.kaist.ac.kr/~sungeui/GCG

slide-2
SLIDE 2

2

Applications of Rendering

  • Virtual and augmented reality
  • Artistic controls
slide-3
SLIDE 3

3

Augmented Reality (AR) and Virtual Reality (VR)

  • Head-Mounted Display (HMD) for VR
  • HoloLens for Augmented Reality (AR) and

Mixed Reality (AR)

MS

slide-4
SLIDE 4

4

Rendering Synthetic Objects into Real Scenes

Franke et al., ISMAR 14

Soft shadows, diffuse indirect bounce, and glossy reflection

slide-5
SLIDE 5

5

Rendering Synthetic Objects into Real Scenes

  • Overall process
  • Acquire geometric and

light information: use depth/ RGB sensors with metallic balls

  • Acquire material

information: specialized sensors or iterative method

  • Track the camera: a

marker based approach

  • Apply differential

rendering Rendering with an environment mapping [Debevec]

slide-6
SLIDE 6

6

Differential Rendering

  • Use global

illumination two times

  • One with the

estimated real scene

  • Measure its error
  • Apply the error to the

global illumination with real and virtual

  • bjects
slide-7
SLIDE 7

7

Iterative Approach

  • Rely upon global illumination
  • Start with approximate values for materials
  • f real objects
  • Measure their errors with the ground-truth

(the captured scene image)

  • Adjust the values until their error is small
slide-8
SLIDE 8

8

Shadow Manipulation: Freeform Shadow Boundary Editing

From EG14 slides

slide-9
SLIDE 9

9

Artistic Controls for Various Scene Designs

  • Require various controls for content

creation [STAR, Schmidt, EG14]

  • Scene setting (object locations)
  • Light setting (light direction)
  • Material setting (reflectance), etc.
  • Technically, a search problem for right

parameters

Tangled, Disney, 2010

slide-10
SLIDE 10

10

Another Example

  • Path-Space Manipulation of Physically-

Based Light Transport [Schmidt, SI G 13]

  • Allows light paths for artistic controls within

global illumination

slide-11
SLIDE 11

11

Key Components

  • I nteraction (UI )
  • Lighting design
  • Material design
slide-12
SLIDE 12

12

Key Components

  • I nteraction (UI )
  • Direct, indirect, and goal-based

Direct Indirect [EG 14] Artistic design process: refine sketch before the final rendering [Nowrouzezahrai, SIG 11]

slide-13
SLIDE 13

13

Key Components

  • Lighting design
  • Directly or indirectly controlled lighting

Light linking

Find various rendering parameters related to volumetric effects given sketchy Tangled, Disney, 2010

Path space manipulation [Schmidt, SIG 13

slide-14
SLIDE 14

14

Path Space Manipulation

From EG14 slides

slide-15
SLIDE 15

15

Key Components

  • Material design
  • Much less studied, mainly because different

material representations have been proposed steadily

slide-16
SLIDE 16

16

Editing Subsurface Scattering

  • SubEdit [STPP09]
  • decouple BSSRDFs into product of per-point

scattering profile

  • can then apply all ideas of editing BRDFs

From EG14 slides

slide-17
SLIDE 17

17

Editing Subsurface Scattering

[STPP09]

From EG14 slides

slide-18
SLIDE 18

18

Different Perspective

  • Performance
  • Reducing running time of rendering algorithms
  • Productivity
  • Look at work process!
  • Better performance
  • Flexible controls
  • I ntuitive feedback and informative

visualization