Rendering Mirage Team 3 Seo Hansol, Lim Mingi CS482 Fall 2018 - - PowerPoint PPT Presentation

rendering mirage
SMART_READER_LITE
LIVE PREVIEW

Rendering Mirage Team 3 Seo Hansol, Lim Mingi CS482 Fall 2018 - - PowerPoint PPT Presentation

Rendering Mirage Team 3 Seo Hansol, Lim Mingi CS482 Fall 2018 Midterm Presentation 1 Contents Introduction Background Previous Works Our Ideas 2 Introduction 3 Mirage inferior mirage superior mirage By Conjecture


slide-1
SLIDE 1

Rendering Mirage

Team 3 Seo Hansol, Lim Mingi CS482 Fall 2018 Midterm Presentation

1

slide-2
SLIDE 2

Contents

  • Introduction
  • Background
  • Previous Works
  • Our Ideas

2

slide-3
SLIDE 3

Introduction

3

slide-4
SLIDE 4

Mirage

4

inferior mirage superior mirage

By Conjecture Corporation By Shawn Stockman-Malone

slide-5
SLIDE 5

Mirage

5

inferior mirage

Both by Ludovica Lorenzelli

superior mirage

slide-6
SLIDE 6

Our Goal

We want to render realistic, artistic mirages.

6

By Shawn Stockman-Malone From [ABW14]

slide-7
SLIDE 7

Background

7

slide-8
SLIDE 8

Mirage Image: The Physics

8

By Ludovica Lorenzelli

slide-9
SLIDE 9

Mirage Image: The Physics

9

High T → Low ρ → High v → Low n Low T → High ρ → Low v → High n

By Ludovica Lorenzelli

slide-10
SLIDE 10

Mirage Image: The Physics

10

High T → Low ρ → High v → Low n Low T → High ρ → Low v → High n

By Ludovica Lorenzelli

slide-11
SLIDE 11

Mirage Image: The Physics

11

By Ludovica Lorenzelli

High T → Low ρ → High v → Low n Low T → High ρ → Low v → High n

slide-12
SLIDE 12

Mirage Image: The Physics

12

inferior mirage superior mirage

slide-13
SLIDE 13

Previous Works

13

slide-14
SLIDE 14

Previous Works

  • Modeling refractive index of atmosphere
  • Rendering through refractive index model
  • Artistic editing by user

14

slide-15
SLIDE 15

Refractive Index Modeling Of Atmosphere

  • Simulation of atmospheric phenomena [GSM*06]
  • Atmospheric Profile Manager (APM)
  • Simplified model of temperature, refractive index similar

to real atmosphere

15

slide-16
SLIDE 16

Refractive Index Modeling Of Atmosphere

16

From [GSM*06] From [GSM*06] From slides of [Choi 17]

Background Inversion Layer Hot Spot Standardized De-standardization

slide-17
SLIDE 17

Rendering Through Refractive Index Model

  • Refractive radiative transfer equation [ABW14]
  • Applies Hamiltonian optics to the rendering equation

17

Image from [ABW14]

slide-18
SLIDE 18

Artistic Editing

  • Interactive reflection editing [ROT*09]
  • User controllable reflection, defying physics
  • Intuitive UI

18

Image from [ROT*09]

slide-19
SLIDE 19

Artistic Editing

  • State of the art in artistic editing of appearance, lighting

and material [SPN*14]

  • User controlled lighting, BRDF, etc.
  • Goal based interaction; user defines goal, system solves.

19

Images from [ABW14]

slide-20
SLIDE 20

Previous Approaches To Mirage Rendering

  • Visual simulation of heat shimmering and mirage

[ZHF*07]

  • Build refractive index from object heat map, renders with

ray marching

20

Image from [ZHF*07]

slide-21
SLIDE 21

Artistic Editing For Mirage Image

21

slide-22
SLIDE 22

Artistic Editing For Mirage Image [Choi 2017]

[Demo video]

22

slide-23
SLIDE 23

Overview

  • Source-to-Destination Point Pair

○ The user specifies constraints, defined as a set of

  • riginal position (source) + mirage image

position (destination)

  • Perform physically correct light path calculation
  • Use parametric optimization to calculate

○ With an appropriate refractive index distribution model for the optimization

23 This slide is copied from slides of [Choi 17]

slide-24
SLIDE 24

Source-to-Destination Point Pair

24 This slide is copied from slides of [Choi 17]

slide-25
SLIDE 25

Source-to-Destination Point Pair

25 This slide is copied from slides of [Choi 17]

slide-26
SLIDE 26

Source-to-Destination Point Pair

26 This slide is copied from slides of [Choi 17]

slide-27
SLIDE 27

Adapt APM[GSM*06] as a spatial encoding

Refractive Index Distribution Model

27 This slide is copied from slides of [Choi 17]

slide-28
SLIDE 28

Refractive Index Distribution Model

28 This slide is copied from slides of [Choi 17]

Plot of APM vs. New Formulation

slide-29
SLIDE 29

New formulation suggested for the refractive index distribution: Logistic Approximation

Refractive Index Distribution Model

29

slide-30
SLIDE 30

Spatial Encoding and Optimization

  • Let the m-dimensional spatial encoding of n(x)

be L

  • And let the parameter vector for L be

30

slide-31
SLIDE 31

Spatial Encoding and Optimization

  • Distance Function

○ Define distance per point pair, as the shortest distance between the Source Point and the light path

31 This slide is copied from slides of [Choi 17]

slide-32
SLIDE 32

Spatial Encoding and Optimization

  • Distance Function

○ For i-th pair, spatial encoding L, and parameter vector k

32 This slide is copied from slides of [Choi 17]

slide-33
SLIDE 33

Spatial Encoding and Optimization

  • Cost Function

○ For i-th pair, spatial encoding L, and parameter vector k ○ solve by Regression

33 This slide is copied from slides of [Choi 17]

slide-34
SLIDE 34

Rendering method

  • Ray-marching algorithm

34 Image from https://computergraphics.stackexchange.com/questions/161/what-is-ray-marching-is-sphere-tracing-the-

same-thing

slide-35
SLIDE 35

Rendering method

  • Ray-marching algorithm

35 [ABW14]

https://github.com/yoonlab/refracti ve-index- editor/blob/master/shaders/compo site.frag

slide-36
SLIDE 36

Limitations

  • This system is focused on creating static scenes

○ This formulation does not consider the spatial location of the hot spot and the inversion layer ○ When you move the camera, you’ll see a different scene than you intended

  • No illumination model
  • Poor, unintuitive UI

⇒ Unrealistic mirage scenes

36

slide-37
SLIDE 37

Our Ideas

37

slide-38
SLIDE 38

Areal Hot Spot

  • Hot spot is no longer depends on only height
  • Hot spot has xy-position and size, defined by user
  • Optimize additional parameters using the existing
  • ptimizer
  • By changing the formula to take into account the area
  • f the hot spot, we can see a more realistic scene

even if we move the camera

38

slide-39
SLIDE 39

Areal Hot Spot

39

Hot Spot

slide-40
SLIDE 40

Atmospheric Noise

  • Temperature variance is not smooth in real
  • Air turbulences result in noises in real image
  • We can add some noises to the scene for more realistic

image ○ Temperature noise to model ○ Geometric noise to ray

40

slide-41
SLIDE 41

Local Illumination Model: Phong Illumination

  • Phong Illumination
  • Complex global illumination is overkill in large outdoor

scene with bright sunlight

  • Phong illumination is simple and plausible enough

41

slide-42
SLIDE 42

Texture Filtering

  • Mip-mapping
  • Anisotropic filtering
  • Ray differential

42

slide-43
SLIDE 43

Better UI

  • Point positioning
  • Camera positioning
  • More interactive point addition and rendering; user

should be able to see result of point addition more frequently

  • Point importance

43

slide-44
SLIDE 44

Better UI: Point Importance

  • User defines optimization rate (intensity) for each point
  • Optimizer has larger margins for less important points

44

0.2 0.6 0.2

slide-45
SLIDE 45

Members & Roles

  • Seo Hansol : Setting up the environment, Presentation,

Coding

  • Lim Mingi : Presentation, Coding

45

slide-46
SLIDE 46

Q & A

46