SLIDE 1 Combining Point and Line Samples for Direct Illumination
Katherine Salesin Wojciech Jarosz Points only Points + Lines
SLIDE 2 Motivation
Combining point and line samples for direct illumination
SLIDE 3 Motivation
Combining point and line samples for direct illumination
SLIDE 4 Motivation
Combining point and line samples for direct illumination
Direct lighting:
SLIDE 5 Motivation
Combining point and line samples for direct illumination
Direct lighting: point sampling
SLIDE 6 Motivation
Combining point and line samples for direct illumination
Direct lighting: point sampling and line sampling
SLIDE 7
Theory: Direct lighting + Monte Carlo sampling
SLIDE 8 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 9 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 10 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 11 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 12 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 13 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 14 Theory
Combining point and line samples for direct illumination
Direct lighting
SLIDE 15 Theory
Combining point and line samples for direct illumination
Direct lighting
Lo Le
SLIDE 16 Theory
Combining point and line samples for direct illumination
Direct lighting
Lo Le
SLIDE 17 Theory
Combining point and line samples for direct illumination
Direct lighting
Lo Le
SLIDE 18 Theory
Combining point and line samples for direct illumination
Direct lighting
Lo Le
SLIDE 19 Theory
Combining point and line samples for direct illumination
Direct lighting
Lo Le
SLIDE 20 Theory
Combining point and line samples for direct illumination
Direct lighting
u v Lo Le
SLIDE 21 Theory
Combining point and line samples for direct illumination
Direct lighting
u v Lo Le
SLIDE 22 Theory
Combining point and line samples for direct illumination
Direct lighting
u v Lo Le
SLIDE 23 Theory
Combining point and line samples for direct illumination
Direct lighting
u v
SLIDE 24 Theory
Combining point and line samples for direct illumination
Direct lighting
u v
SLIDE 25 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 26 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 27 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 28 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 29 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 30 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
✗
SLIDE 31 Theory
Combining point and line samples for direct illumination
Line sampling [BD16]
u v
SLIDE 32 Theory
Combining point and line samples for direct illumination
u v
Line sampling [BD16]
SLIDE 33 Theory
Combining point and line samples for direct illumination
u v
Line sampling [BD16]
SLIDE 34 Theory
Combining point and line samples for direct illumination
u v
Line sampling [BD16]
SLIDE 35 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 36 Theory
Combining point and line samples for direct illumination
Monte Carlo sampling
u v
SLIDE 37 Prior work: line sampling
Combining point and line samples for direct illumination
SLIDE 38 Prior work: line sampling
- Direct illumination [BD16]
- 16
Combining point and line samples for direct illumination
[BD16]
SLIDE 39 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- 16
Combining point and line samples for direct illumination
[BD16]
SLIDE 40 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- Transmittance [BJ17]
- 16
Combining point and line samples for direct illumination
[BJ17] [BD16]
SLIDE 41 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- Transmittance [BJ17]
- Motion blur [GDA10]
- 16
Combining point and line samples for direct illumination
[BJ17] [BD16]
SLIDE 42 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- Transmittance [BJ17]
- Motion blur [GDA10]
- Depth of field [TPD*12]
- 16
Combining point and line samples for direct illumination
[BJ17] [BD16]
SLIDE 43 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- Transmittance [BJ17]
- Motion blur [GDA10]
- Depth of field [TPD*12]
- Environment lights [NBMJ14]
- 16
Combining point and line samples for direct illumination
[BJ17] [BD16]
SLIDE 44 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- Transmittance [BJ17]
- Motion blur [GDA10]
- Depth of field [TPD*12]
- Environment lights [NBMJ14]
- Hair [BGA12]
- 16
Combining point and line samples for direct illumination
[BJ17] [BD16]
SLIDE 45 Prior work: line sampling
- Direct illumination [BD16]
- Transient light transport [MGJ*19]
- Transmittance [BJ17]
- Motion blur [GDA10]
- Depth of field [TPD*12]
- Environment lights [NBMJ14]
- Hair [BGA12]
- and more…
- 16
Combining point and line samples for direct illumination
[BJ17] [BD16]
SLIDE 46 Line sampling: pros and cons
Combining point and line samples for direct illumination
SLIDE 47 Line sampling: pros and cons
✓ Less error per sample than points
Combining point and line samples for direct illumination
SLIDE 48 Line sampling: pros and cons
✓ Less error per sample than points ✓ Better convergence rate than points (if stratified)
Combining point and line samples for direct illumination
SLIDE 49 Line sampling: pros and cons
✓ Less error per sample than points ✓ Better convergence rate than points (if stratified)
- BUT convergence rate may depend on line orientation [SMJ17]
- 17
Combining point and line samples for direct illumination
SLIDE 50 Line sampling: pros and cons
✓ Less error per sample than points ✓ Better convergence rate than points (if stratified)
- BUT convergence rate may depend on line orientation [SMJ17]
✗ Hard to analytically integrate one dimension
Combining point and line samples for direct illumination
SLIDE 51 Line sampling: pros and cons
✓ Less error per sample than points ✓ Better convergence rate than points (if stratified)
- BUT convergence rate may depend on line orientation [SMJ17]
✗ Hard to analytically integrate one dimension
- [BD16] derived solution only for diffuse and Phong materials
- 17
Combining point and line samples for direct illumination
SLIDE 52 Line sampling: pros and cons
✓ Less error per sample than points ✓ Better convergence rate than points (if stratified)
- BUT convergence rate may depend on line orientation [SMJ17]
✗ Hard to analytically integrate one dimension
- [BD16] derived solution only for diffuse and Phong materials
✗ Slow to evaluate samples
Combining point and line samples for direct illumination
SLIDE 53 Line sampling: pros and cons
✓ Less error per sample than points ✓ Better convergence rate than points (if stratified)
- BUT convergence rate may depend on line orientation [SMJ17]
✗ Hard to analytically integrate one dimension
- [BD16] derived solution only for diffuse and Phong materials
✗ Slow to evaluate samples
- Expensive line sample-scene intersection
- 17
Combining point and line samples for direct illumination
SLIDE 54
MIS Points + Points
Motivation
SLIDE 55 MIS Points + Points
Motivation
- Make line samples play nicely with any point-based strategy
SLIDE 56 MIS Points + Points
Motivation
- Make line samples play nicely with any point-based strategy
- Mitigate orientation-based performance issues
SLIDE 57
MIS Points + Points
SLIDE 58
(Ours) MIS Points + Lines
SLIDE 59 Roadmap
Combining point and line samples for direct illumination
SLIDE 60 Roadmap
- Reframe line samples as point samples that
importance sample visibility
Combining point and line samples for direct illumination
SLIDE 61 Roadmap
- Reframe line samples as point samples that
importance sample visibility
- Show how to multiple importance sample between
lines and points, and lines of different orientations
Combining point and line samples for direct illumination
SLIDE 62 Roadmap
- Reframe line samples as point samples that
importance sample visibility
- Show how to multiple importance sample between
lines and points, and lines of different orientations
- Propose novel MIS weighting scheme to improve
convergence rate
Combining point and line samples for direct illumination
SLIDE 63 Main idea
Combining point and line samples for direct illumination
u v
u v
Line sampling Point sampling
SLIDE 64 Line sampling Point sampling
Main idea
Combining point and line samples for direct illumination
SLIDE 65 Line sampling Point sampling
Main idea
Combining point and line samples for direct illumination
constant
SLIDE 66 Line sampling Point sampling
Main idea
Combining point and line samples for direct illumination
constant zero
SLIDE 67 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 68 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 69 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 70 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 71 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 72 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 73 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 74 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 75 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 76 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 77 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 78 Main idea
Combining point and line samples for direct illumination
Line sampling Point sampling
SLIDE 79 Main idea
Combining point and line samples for direct illumination
SLIDE 80
- But a perfect conditional pdf would be hard to find for
the full direct lighting integral
Main idea
Combining point and line samples for direct illumination
SLIDE 81
- But a perfect conditional pdf would be hard to find for
the full direct lighting integral
- Instead, we use simpler conditional pdfs that work well in practice
Main idea
Combining point and line samples for direct illumination
SLIDE 82
- But a perfect conditional pdf would be hard to find for
the full direct lighting integral
- Instead, we use simpler conditional pdfs that work well in practice
- Effectively importance sampling visibility
Main idea
Combining point and line samples for direct illumination
SLIDE 83 Main idea
We propose two options:
Combining point and line samples for direct illumination
Conditional point pdfs
SLIDE 84 Main idea
We propose two options:
Combining point and line samples for direct illumination
Conditional point pdfs
Surface-area-based sampling (uniform over surface area)
SLIDE 85 Main idea
We propose two options:
Combining point and line samples for direct illumination
Conditional point pdfs
Surface-area-based sampling (uniform over surface area) Solid-angle-based sampling (uniform over solid angle) from [UFK13]
SLIDE 86 Summary
Combining point and line samples for direct illumination
SLIDE 87 Summary
- We have reframed line sampling as point sampling
that importance samples visibility
Combining point and line samples for direct illumination
SLIDE 88 Summary
- We have reframed line sampling as point sampling
that importance samples visibility
- We can now use line sampling with any BRDF
- 31
Combining point and line samples for direct illumination
SLIDE 89 Summary
- We have reframed line sampling as point sampling
that importance samples visibility
- We can now use line sampling with any BRDF
- But line samples are still bad at importance sampling
some terms – can we do better?
Combining point and line samples for direct illumination
SLIDE 90 Theory
Combining point and line samples for direct illumination
SLIDE 91
- We can use multiple importance sampling (MIS) to
combine the strengths of different strategies
Theory
Combining point and line samples for direct illumination
SLIDE 92
- We can use multiple importance sampling (MIS) to
combine the strengths of different strategies
- MIS uses a set of weights to favor each strategy where
it is strongest (i.e. where a strategy’s pdf is largest relative to other strategies’ pdfs)
Theory
Combining point and line samples for direct illumination
SLIDE 93 Summary
Combining point and line samples for direct illumination
SLIDE 94 Summary
- We can now MIS lines with lines of other orientations
- 33
Combining point and line samples for direct illumination
SLIDE 95
MIS between lines: Equal time comparison
SLIDE 96
SLIDE 97
SLIDE 98
SLIDE 99 Relative MSE
Full image Green Purple Lines (average) [BD16] 2.6 x 10–1 1.2 x 10–2 1.5 x 100 Equal time comparison
SLIDE 100 Relative MSE
Full image Green Purple Lines (average) [BD16] 2.6 x 10–1 1.2 x 10–2 1.5 x 100 Solid-angle points [UFK13] 2.0 x 10–1 1.4 x 10–3 1.9 x 100 Equal time comparison
SLIDE 101 Full image Green Purple Lines (average) [BD16] 2.6 x 10–1 1.2 x 10–2 1.5 x 100 Solid-angle points [UFK13] 2.0 x 10–1 1.4 x 10–3 1.9 x 100 MIS lines [Ours] 1.0 x 10–1 2.6 x 10–3 3.3 x 10-1
Relative MSE
Equal time comparison
SLIDE 102 Summary
- We can now MIS lines with lines of other orientations
- 39
Combining point and line samples for direct illumination
SLIDE 103 Summary
- We can now MIS lines with lines of other orientations
- We can now MIS lines with points that importance
sample other distributions (like BRDFs)
Combining point and line samples for direct illumination
SLIDE 104
MIS between points and lines: Equal time comparisons
SLIDE 105
SLIDE 106
SLIDE 107 Full image BSDF 5.5 x 101
Relative MSE
SLIDE 108 Full image BSDF 5.5 x 101
Relative MSE
Equal time comparison
SLIDE 109 Full image BSDF 5.5 x 101 Solid-angle points [UFK13] 4.5 x 10–1
Relative MSE
Equal time comparison
SLIDE 110 Full image BSDF 5.5 x 101 Solid-angle points [UFK13] 4.5 x 10–1 MIS BSDF + SA points 2.0 x 10-1
Relative MSE
Equal time comparison
SLIDE 111 Full image BSDF 5.5 x 101 Solid-angle points [UFK13] 4.5 x 10–1 MIS BSDF + SA points 2.0 x 10-1 Solid-angle lines [Ours]
4.2 x 10–1
Relative MSE
Equal time comparison
SLIDE 112 Full image BSDF 5.5 x 101 Solid-angle points [UFK13] 4.5 x 10–1 MIS BSDF + SA points 2.0 x 10-1 Solid-angle lines [Ours]
4.2 x 10–1
MIS BSDF + SA lines
6.8 x 10–2
Relative MSE
Equal time comparison
SLIDE 113
SLIDE 114
SLIDE 115 Full image Green Purple 4 points : 0 lines 4.0 x 10–1 5.7 x 10–2 4.4 x 10–1
Relative MSE
SLIDE 116 Full image Green Purple 4 points : 0 lines 4.0 x 10–1 5.7 x 10–2 4.4 x 10–1
Relative MSE
Equal time comparison
SLIDE 117 Full image Green Purple 4 points : 0 lines 4.0 x 10–1 5.7 x 10–2 4.4 x 10–1 3 points : 1 line 1.0 x 100 1.1 x 10–1 1.1 x 10–1
Relative MSE
Equal time comparison
SLIDE 118 Full image Green Purple 4 points : 0 lines 4.0 x 10–1 5.7 x 10–2 4.4 x 10–1 3 points : 1 line 1.0 x 100 1.1 x 10–1 1.1 x 10–1 2 points : 2 lines 1.0 x 101 5.2 x 10–1 9.8 x 10–2
Relative MSE
Equal time comparison
SLIDE 119 Full image Green Purple 4 points : 0 lines 4.0 x 10–1 5.7 x 10–2 4.4 x 10–1 3 points : 1 line 1.0 x 100 1.1 x 10–1 1.1 x 10–1 2 points : 2 lines 1.0 x 101 5.2 x 10–1 9.8 x 10–2 1 point : 3 lines
2.8 x 10–1
5.5 x 10–1 1.3 x 10–1
Relative MSE
Equal time comparison
SLIDE 120 Full image Green Purple 4 points : 0 lines 4.0 x 10–1 5.7 x 10–2 4.4 x 10–1 3 points : 1 line 1.0 x 100 1.1 x 10–1 1.1 x 10–1 2 points : 2 lines 1.0 x 101 5.2 x 10–1 9.8 x 10–2 1 point : 3 lines
2.8 x 10–1
5.5 x 10–1 1.3 x 10–1 0 points : 4 lines
5.3 x 10–1
1.9 x 101 1.1 x 10–1
Relative MSE
Equal time comparison
SLIDE 121 Summary
- We can now MIS lines with lines of other orientations
- We can now MIS lines with points that importance
sample other distributions (like BRDFs)
Combining point and line samples for direct illumination
SLIDE 122 Summary
- We can now MIS lines with lines of other orientations
- We can now MIS lines with points that importance
sample other distributions (like BRDFs)
- But MIS inherits the worst convergence rate of its
strategies – can we do better?
Combining point and line samples for direct illumination
SLIDE 123 Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
SLIDE 124
- We know convergence rate improves when
discontinuities in effective integrand are smoothed
Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
SLIDE 125
- We know convergence rate improves when
discontinuities in effective integrand are smoothed
Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
SLIDE 126
- We know convergence rate improves when
discontinuities in effective integrand are smoothed
Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
for S strategies
SLIDE 127
- We know convergence rate improves when
discontinuities in effective integrand are smoothed
Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
for S strategies
effective integrand
SLIDE 128
- We know convergence rate improves when
discontinuities in effective integrand are smoothed
Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
for S strategies
effective integrand [SSC*19]
SLIDE 129
- We know convergence rate improves when
discontinuities in effective integrand are smoothed
Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
for S strategies
effective integrand [Ours]
SLIDE 130 Discontinuity-smoothing MIS
Combining point and line samples for direct illumination
Let us MIS:
- 1. BRDF point samples
- 2. Vertical line samples
- 3. Horizontal line samples
SLIDE 131
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 132
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 133
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 134
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 135
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 136
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 137
Effective integrand for the BRDF strategy without smoothing light
Discontinuity-smoothing MIS
SLIDE 138
light
Discontinuity-smoothing MIS
Effective integrand for the BRDF strategy with smoothing
SLIDE 139
Smoothing MIS: Convergence tests
SLIDE 140 Convergence tests
Combining point and line samples for direct illumination
SLIDE 141 Convergence tests
Combining point and line samples for direct illumination
A
SLIDE 142 Convergence tests
Combining point and line samples for direct illumination
Number of Light Samples V a r i a n c e
Pixel A
A
(multijittered)
SLIDE 143 Convergence tests
Combining point and line samples for direct illumination
Number of Light Samples V a r i a n c e
Pixel A
A
BSDF (N–1.38)
(multijittered)
SLIDE 144 Convergence tests
Combining point and line samples for direct illumination
Number of Light Samples V a r i a n c e
Pixel A
A
BSDF (N–1.38)
(multijittered)
SLIDE 145 Convergence tests
Combining point and line samples for direct illumination
Number of Light Samples V a r i a n c e
Pixel A
A
BSDF (N–1.38)
- Horiz. lines (N–2.13)
- Vert. lines (N–2.14)
(multijittered)
SLIDE 146 Convergence tests
Combining point and line samples for direct illumination
Number of Light Samples V a r i a n c e
Pixel A
A
BSDF (N–1.38)
- Horiz. lines (N–2.13)
- Vert. lines (N–2.14)
MIS BSDF + Lines (N–1.40)
(multijittered)
SLIDE 147 Convergence tests
Combining point and line samples for direct illumination
Number of Light Samples V a r i a n c e
Pixel A
A
BSDF (N–1.38)
- Horiz. lines (N–2.13)
- Vert. lines (N–2.14)
MIS BSDF + Lines (N–1.40) MIS BSDF + Lines with smoothing (N–2.04)
(multijittered)
SLIDE 148 Convergence tests
Combining point and line samples for direct illumination
SLIDE 149 Convergence tests
Combining point and line samples for direct illumination
B
SLIDE 150 Convergence tests
Combining point and line samples for direct illumination
B
Number of Light Samples V a r i a n c e
Pixel B
(multijittered)
SLIDE 151 Convergence tests
Combining point and line samples for direct illumination
B
BSDF (N–1.48)
Number of Light Samples V a r i a n c e
Pixel B
(multijittered)
SLIDE 152 Convergence tests
Combining point and line samples for direct illumination
B
BSDF (N–1.48)
Number of Light Samples V a r i a n c e
Pixel B
(multijittered)
SLIDE 153 Convergence tests
Combining point and line samples for direct illumination
B
BSDF (N–1.48)
- Horiz. lines (N–2.57)
- Vert. lines (N–1.61)
Number of Light Samples V a r i a n c e
Pixel B
(multijittered)
SLIDE 154 Convergence tests
Combining point and line samples for direct illumination
B
BSDF (N–1.48)
- Horiz. lines (N–2.57)
- Vert. lines (N–1.61)
MIS BSDF + Lines (N–1.53)
Number of Light Samples V a r i a n c e
Pixel B
(multijittered)
SLIDE 155 Convergence tests
Combining point and line samples for direct illumination
B
BSDF (N–1.48)
- Horiz. lines (N–2.57)
- Vert. lines (N–1.61)
MIS BSDF + Lines (N–1.53) MIS BSDF + Lines with smoothing (N–1.68)
Number of Light Samples V a r i a n c e
Pixel B
(multijittered)
SLIDE 156
Wrapping things up:
What’s Next?
SLIDE 157 Future work
Combining point and line samples for direct illumination
SLIDE 158 Future work
- Optimize the line sample-scene intersection
- 64
Combining point and line samples for direct illumination
SLIDE 159 Future work
- Optimize the line sample-scene intersection
- Line sample-scene intersection 1.2x – 55x slower than shadow ray
- 64
Combining point and line samples for direct illumination
SLIDE 160 Future work
- Optimize the line sample-scene intersection
- Line sample-scene intersection 1.2x – 55x slower than shadow ray
- Support arbitrarily-shaped light sources and all line
directions (for solid-angle lines)
Combining point and line samples for direct illumination
SLIDE 161 Future work
- Optimize the line sample-scene intersection
- Line sample-scene intersection 1.2x – 55x slower than shadow ray
- Support arbitrarily-shaped light sources and all line
directions (for solid-angle lines)
- Improve smoothing MIS heuristic to be more robust to
all scenarios
Combining point and line samples for direct illumination
SLIDE 162 Future work
- Optimize the line sample-scene intersection
- Line sample-scene intersection 1.2x – 55x slower than shadow ray
- Support arbitrarily-shaped light sources and all line
directions (for solid-angle lines)
- Improve smoothing MIS heuristic to be more robust to
all scenarios
- Apply novel concepts to other line sampling (or even
higher-dimensional) applications
Combining point and line samples for direct illumination
SLIDE 163 Thank you!
Please visit dartgo.org/pointsandlines for the full paper, supplemental document, and interactive image viewer.
katherine.a.salesin.gr@dartmouth.edu wojciech.k.jarosz@dartmouth.edu
Katherine Salesin Wojciech Jarosz
Scan Me!
SLIDE 164 Thank you!
Please visit dartgo.org/pointsandlines for the full paper, supplemental document, and interactive image viewer.
katherine.a.salesin.gr@dartmouth.edu wojciech.k.jarosz@dartmouth.edu
Katherine Salesin Wojciech Jarosz
Scan Me!