Illumination-invariant Robust Multiview 3D Human Motion Capture - - PowerPoint PPT Presentation

▶

Mar 17, 2023 239 likes •335 views

Illumination-invariant Robust Multiview 3D Human Motion Capture Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt MPI for Informatics, Intel VCI, Saarbruecken, Germany nroberti@mpi-inf.mpg.de Nadia Robertini Goal Input

SLIDE 1

Nadia Robertini

Illumination-invariant Robust Multiview 3D Human Motion Capture

Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt

MPI for Informatics, Intel VCI, Saarbruecken, Germany nroberti@mpi-inf.mpg.de

SLIDE 2

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Goal

…

Input Output

SLIDE 3

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Related Work

▪ Color-based:

– Calibrated Light – Controlled Studio

▪ Data-driven (e.g. CNN)

– More robust to illumination – Sparse information – Temporally unstable time 2D Joints Detections

SLIDE 4

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Our Approach

time

2D Joints Detections Pre-segmented Frames

SLIDE 5

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Output

Our Approach: Material Segmentation

Graph-cut Appearance Costs Skin Pose Costs SkinSkin Input

SLIDE 6

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Results: Illumination Robustness

Global Soft Shadows Global Harsh Shadows

SLIDE 7

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Results: Initialization Robustness

SLIDE 8

Nadia Robertini

http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/

Comparisons

Color-based Data-driven Combined Ours

SLIDE 9

Nadia Robertini

Thank you!

Illumination-invariant Robust Multiview 3D Human Motion Capture (479, 13B)

Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt nroberti@mpi-inf.mpg.de http://gvv.mpi-inf.mpg.de/projects/IntrinsicMoCap/ Data Available!