Light Field Depth Estimation Challenge LF4CV@CVPR2017 Katrin - - PowerPoint PPT Presentation

▶
light field depth estimation challenge
SMART_READER_LITE
LIVE PREVIEW

Light Field Depth Estimation Challenge LF4CV@CVPR2017 Katrin - - PowerPoint PPT Presentation

Nov 04, 2023 247 likes •479 views

Light Field Depth Estimation Challenge LF4CV@CVPR2017 Katrin Honauer, Ole Johannsen, Bastian Goldluecke July 26, 2017 4D Light Fields 2D grid of 2D views all cameras are parallel and identical (except shift: negative disparity) [Figure:

slide-1
SLIDE 1

Light Field Depth Estimation Challenge

LF4CV@CVPR2017 Katrin Honauer, Ole Johannsen, Bastian Goldluecke

July 26, 2017

slide-2
SLIDE 2

4D Light Fields

2D grid of 2D views all cameras are parallel and identical (except shift: negative disparity)

[Figure: Johannsen and Honauer 2017]

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

2 / 21 Light Field Depth Estimation Challenge

slide-3
SLIDE 3

Benchmark

Data

12 scenes in 3 categories: stratified + photorealistic (test and training) 9x9x512x512x3 input images + config files with camera settings and disparity ranges ground truth of test scenes is hidden 16 additional scenes for algorithm development

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

3 / 21 Light Field Depth Estimation Challenge

slide-4
SLIDE 4

Benchmark

Metrics

metrics quantify different aspects of disparity map quality general: BadPix(0.07), MSE per region: discontinuities, fine structures, smoothness of planar/continuous surfaces novel: high accuracy, surface normals

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

4 / 21 Light Field Depth Estimation Challenge

slide-5
SLIDE 5

Benchmark

Statistics

28 submissions, 324 downloads, 200 visitors/week (since October 2016)

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

5 / 21 Light Field Depth Estimation Challenge

slide-6
SLIDE 6

Benchmark

Tools

https://github.com/lightfield-analysis Blender addon Matlab tools Python evaluation toolkit interactive online visualizations access to raw evaluation scores Planned: Blender scenes submitted disparity maps extended FAQ

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

6 / 21 Light Field Depth Estimation Challenge

slide-7
SLIDE 7

Challenge

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

7 / 21 Light Field Depth Estimation Challenge

slide-8
SLIDE 8

Challenge

Rules

novel and existing methods

  • ne set of parameters for all scenes

submit 512x512 disparity map for each of the 12 scenes + runtimes

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

8 / 21 Light Field Depth Estimation Challenge

slide-9
SLIDE 9

Challenge

Participants

7 challenge participants Challenge report: A Taxonomy and Evaluation of Dense Light Field Depth Estimation Algorithms

Ole Johannsen*, Katrin Honauer*, Bastian Goldluecke, Anna Alperovich, Federica Battisti, Yunsu Bok, Michele Brizzi, Marco Carli, Gyeongmin Choe, Maximilian Diebold, Marcel Gutsche, Hae-Gon Jeon, In So Kweon, Jaesik Park, Jinsun Park, Hendrik Schilling, Hao Sheng, Lipeng Si, Michael Strecke, Antonin Sulc, Yu-Wing Tai, Qing Wang, Ting-Chun Wang, Sven Wanner, Zhang Xiong, Jingyi Yu, Shuo Zhang, and Hao Zhu. (*equal contribution)

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

9 / 21 Light Field Depth Estimation Challenge

slide-10
SLIDE 10

Results

Training

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

10 / 21 Light Field Depth Estimation Challenge

slide-11
SLIDE 11

Results

Stratified

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

11 / 21 Light Field Depth Estimation Challenge

slide-12
SLIDE 12

Results

Discontinuities

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

12 / 21 Light Field Depth Estimation Challenge

slide-13
SLIDE 13

Results

High Accuracy

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

13 / 21 Light Field Depth Estimation Challenge

slide-14
SLIDE 14

Results

High Accuracy

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

14 / 21 Light Field Depth Estimation Challenge

slide-15
SLIDE 15

Results

Normals

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

15 / 21 Light Field Depth Estimation Challenge

slide-16
SLIDE 16

Results

Questions?

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

16 / 21 Light Field Depth Estimation Challenge

slide-17
SLIDE 17

Challenge

Winners

and the winner is:

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

17 / 21 Light Field Depth Estimation Challenge

slide-18
SLIDE 18

Challenge

Winners

and the winner is: no one... sorry :( different algorithms, different strengths, no overall best algorithm

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

17 / 21 Light Field Depth Estimation Challenge

slide-19
SLIDE 19

Challenge

Outstanding Participants

OBER Accuracy Champion Hendrik Schilling and Maximilian Diebold PS_RF Robustness Champion Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, In So Kweon RM3DE Jack of all trades Federica Battisti, Michele Brizzi, Marco Carli, and Alessandro Neri SPO Discontinuities Champion Shuo Zhang, Hao Sheng, and Zhang Xiong

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

18 / 21 Light Field Depth Estimation Challenge

slide-20
SLIDE 20

Results

Current Leaderboard

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

19 / 21 Light Field Depth Estimation Challenge

slide-21
SLIDE 21

Results

Current Leaderboard

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

20 / 21 Light Field Depth Estimation Challenge

slide-22
SLIDE 22

Results

Current Leaderboard

  • Katrin Honauer, Ole Johannsen, Bastian Goldluecke

21 / 21 Light Field Depth Estimation Challenge