of Light Perception in Virtual Reality ISMAR 2020 Laura R. Luidolt - - PowerPoint PPT Presentation

▶
of light perception
SMART_READER_LITE
LIVE PREVIEW

of Light Perception in Virtual Reality ISMAR 2020 Laura R. Luidolt - - PowerPoint PPT Presentation

Aug 17, 2022 593 likes •884 views

Gaze-Dependent Simulation of Light Perception in Virtual Reality ISMAR 2020 Laura R. Luidolt 1 Michael Wimmer 1 Katharina Krsl 2 1 2 1 TU Wien , 2 VRVis Forschungs-GmbH Research Division of Computer Graphics Institute of Visual Computing

slide-1
SLIDE 1

Gaze-Dependent Simulation

  • f Light Perception

in Virtual Reality

Research Division of Computer Graphics Institute of Visual Computing & Human-Centered Technology TU Wien, Austria

ISMAR 2020 Laura R. Luidolt1 Michael Wimmer1 Katharina Krösl2

1TU Wien, 2VRVis Forschungs-GmbH 1 2

slide-2
SLIDE 2

Motivation ▪ Overview ▫ Methodology ▫ Evaluation ▫ Conclusion ▫

Introduction

  • L. R. Luidolt

2

<

brightness range tone mapping

slide-3
SLIDE 3

Motivation ▪ Overview ▫ Methodology ▫ Evaluation ▫ Conclusion ▫

Introduction

  • L. R. Luidolt

3

slide-4
SLIDE 4

Motivation ▪ Overview ▫ Methodology ▫ Evaluation ▫ Conclusion ▫

Introduction

▪ → Perceptual algorithms necessary! ▪ Medically based ▪ Account for viewing direction, pupil size

  • L. R. Luidolt

4

slide-5
SLIDE 5

Motivation ▪ Overview ▫ Methodology ▫ Evaluation ▫ Conclusion ▫

Contribution

▪ Post-processing workflow ▪ Accurate simulation of light perception in VR/AR ▪ Medically-based, perceptual effects ▪ In real-time VR/AR ▪ Following optometrist advice ▪ Eye tracking for measuring light incidence ▪ Pilot user study, comparison of ▪ Real-world low-light situation ▪ And VR simulation

  • L. R. Luidolt

5

slide-6
SLIDE 6

Motivation ▫ Overview ▪ Methodology ▫ Evaluation ▫ Conclusion ▫

  • L. R. Luidolt

6

Visual adjustment to bright and dark Adaptation of rods and cones over time

Temporal Eye Adaptation

Colorful patterns when viewing bright light sources Scattering of light in the eye

Perceptual Glare

Blurred details in low light scenes Rods not present in fovea (point of sharpest vision)

Visual Acuity Reduction

Color shift towards blue in low light scenes Rods more sensitive to longer wavelength light than cones

Scotopic Color Vision

Based on Krawczyk et al., 2005 and Ritschel et al., 2009

slide-7
SLIDE 7
slide-8
SLIDE 8

Motivation ▫ Overview ▪ Methodology ▫ Evaluation ▫ Conclusion ▫

  • L. R. Luidolt0

2 1,.4

  • 0.02

0.15 2.2 2.9 8

Visual adjustment to bright and dark Adaptation of rods and cones over time

Temporal Eye Adaptation

Colorful patterns when viewing bright light sources Scattering of light in the eye

Perceptual Glare

Blurred details in low light scenes Rods not present in fovea (point of sharpest vision)

Visual Acuity Reduction

Color shift towards blue in low light scenes Rods more sensitive to longer wavelength light than cones

Scotopic Color Vision

Based on Krawczyk et al., 2005 and Ritschel et al., 2009

slide-9
SLIDE 9
slide-10
SLIDE 10

Motivation ▫ Overview ▪ Methodology ▫ Evaluation ▫ Conclusion ▫

  • L. R. Luidolt

10

Visual adjustment to bright and dark Adaptation of rods and cones over time

Temporal Eye Adaptation

Colorful patterns when viewing bright light sources Scattering of light in the eye

Perceptual Glare

Blurred details in low light scenes Rods not present in fovea (point of sharpest vision)

Visual Acuity Reduction

Color shift towards blue in low light scenes Rods more sensitive to longer wavelength light than cones

Scotopic Color Vision

Based on Krawczyk et al., 2005 and Ritschel et al., 2009

slide-11
SLIDE 11
slide-12
SLIDE 12

Motivation ▫ Overview ▪ Methodology ▫ Evaluation ▫ Conclusion ▫

  • L. R. Luidolt

12

Visual adjustment to bright and dark Adaptation of rods and cones over time

Temporal Eye Adaptation

Colorful patterns when viewing bright light sources Scattering of light in the eye

Perceptual Glare

Blurred details in low light scenes Rods not present in fovea (point of sharpest vision)

Visual Acuity Reduction

Color shift towards blue in low light scenes Rods more sensitive to longer wavelength light than cones

Scotopic Color Vision

Based on Krawczyk et al., 2005 and Ritschel et al., 2009

slide-13
SLIDE 13
slide-14
SLIDE 14

Motivation ▫ Overview ▪ Methodology ▫ Evaluation ▫ Conclusion ▫

  • L. R. Luidolt

14

Visual adjustment to bright and dark Adaptation of rods and cones over time

Temporal Eye Adaptation

Colorful patterns when viewing bright light sources Scattering of light in the eye

Perceptual Glare

Blurred details in low light scenes Rods not present in fovea (point of sharpest vision)

Visual Acuity Reduction

Color shift towards blue in low light scenes Rods more sensitive to longer wavelength light than cones

Scotopic Color Vision

Based on Krawczyk et al., 2005 and Ritschel et al., 2009

slide-15
SLIDE 15

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▪ Glare ▫ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

Temporal Eye Adaptation

  • L. R. Luidolt

15

▪ 𝑀𝑗 = 𝑀𝑗−1 + (𝑍 − 𝑀𝑗−1) ∙ 1 − 𝑓−

ൗ

ft 𝜐(𝑍) ▪ Target luminance Y ▪ Temporally filtered luminance Li of frame i ▪ Photoreceptor adaptation times τ

slide-16
SLIDE 16
  • L. R. Luidolt

16

Image adapted from commons.wikimedia.org/wiki/File:Eyesection.svg Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

Perceptual Glare

slide-17
SLIDE 17
  • L. R. Luidolt

17

Image adapted from commons.wikimedia.org/wiki/File:Eyesection.svg Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

Perceptual Glare

slide-18
SLIDE 18
  • L. R. Luidolt

18

Image adapted from commons.wikimedia.org/wiki/File:Eyesection.svg Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

Perceptual Glare

𝑁 𝑦, 𝑧 = 1 𝜇𝑒 2 1 𝑂 ∙ ℱ 𝑄(𝑦, 𝑧) ∙ 𝑓i 𝜌

𝜇𝑒 𝑦2+𝑧2 2

After Ritschel et al., 2009

slide-19
SLIDE 19

Diffraction on the retina of a single wavelength light source

Monochromatic PSF

Combination of multiple wavelengths to simulate spectral light

Spectral PSF

  • L. R. Luidolt

19

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

Perceptual Glare

slide-20
SLIDE 20

Diffraction on the retina of a single wavelength light source

Monochromatic PSF

Combination of multiple wavelengths to simulate spectral light

Spectral PSF

  • L. R. Luidolt

20

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

Perceptual Glare

slide-21
SLIDE 21

Perceptual Glare

  • L. R. Luidolt

21

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

· (1 - ) + · =

slide-22
SLIDE 22

Perceptual Glare

  • L. R. Luidolt

22

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▪ VA reduction ▫ Color shift ▫ Evaluation ▫ Conclusion ▫

slide-23
SLIDE 23

Visual Acuity Reduction

  • L. R. Luidolt

23

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▫ VA reduction ▪ Color shift ▫ Evaluation ▫ Conclusion ▫

▪ 𝜏 𝑀 = max(1 − 𝑀, 0) ▪ Gaussian variance 𝜏 ▪ Pixel’s lightness L

slide-24
SLIDE 24

Scotopic Color Vision

  • L. R. Luidolt

24

On Off

Motivation ▫ Overview ▫ Methodology ▼ Adaptation ▫ Glare ▫ VA reduction ▫ Color shift ▪ Evaluation ▫ Conclusion ▫

slide-25
SLIDE 25

Evaluation

Qualitative user study with 5 participants

Motivation ▫ Overview ▫ Methodology ▫ Evaluation ▪ Conclusion ▫

  • L. R. Luidolt

25

slide-26
SLIDE 26

Real-time VR/AR post-processing workflow Using eye tracking Based on medical research Pilot user study

Conclusion

Motivation ▫ Overview ▫ Methodology ▫ Evaluation ▫ Conclusion ▪

  • L. R. Luidolt

26

▪ temporal eye adaptation ▪ perceptual glare ▪ visual acuity reduction ▪ scotopic color vision

Related article: “CatARact: Simulating Cataracts in Augmented Reality”, Krösl et al., 2020

slide-27
SLIDE 27

Laura R. Luidolt, luidolt@cg.tuwien.ac.at Michael Wimmer, wimmer@cg.tuwien.ac.at Katharina Krösl, kroesl@vrvis.at

Gaze-Dependent Simulation of Light Perception in Virtual Reality

Thank you for your attention!