Illumination-invariant Robust Multiview 3D Human Motion Capture - PowerPoint PPT Presentation

Mar 17, 2023 •239 likes •331 views

Illumination-invariant Robust Multiview 3D Human Motion Capture Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt MPI for Informatics, Intel VCI, Saarbruecken, Germany nroberti@mpi-inf.mpg.de Nadia Robertini Goal Input

Illumination-invariant Robust Multiview 3D Human Motion Capture Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt MPI for Informatics, Intel VCI, Saarbruecken, Germany nroberti@mpi-inf.mpg.de Nadia Robertini
Goal … Input Output http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Related Work ▪ Color-based: – Calibrated Light – Controlled Studio time ▪ Data-driven (e.g. CNN ) – More robust to illumination – Sparse information – Temporally unstable 2D Joints Detections http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Our Approach 2D Joints Detections time Pre-segmented Frames http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Our Approach: Material Segmentation Graph-cut Skin SkinSkin Output Pose Appearance Input Costs Costs http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Results: Illumination Robustness Global Soft Shadows Global Harsh Shadows http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Results: Initialization Robustness http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Comparisons Ours Data-driven Combined Color-based http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini
Thank you! Illumination-invariant Robust Multiview 3D Human Motion Capture (479, 13B) Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt Data Available! nroberti@mpi-inf.mpg.de http://gvv.mpi-inf.mpg.de/projects/ IntrinsicMoCap / Nadia Robertini

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

1 Algorithm for Identifying Loop Invariant Code Algorithm for Identifying Loop Invariant Code

Loop Invariant Code Motion Loop Invariant Code Motion Background: ud- and du-chains Last Time ud-Chains Control flow analysis A ud-chain connects a use of a variable to all defs of a variable that might reach it (a sparse representation

355 views • 6 slides

Loop-invariant code motion Example Two steps: analysis & transformation x := 3 Step 1: find

Loop-invariant code motion Example Two steps: analysis & transformation x := 3 Step 1: find invariant computations in loop y := 4 y := 5 invariant: computes same result each time evaluated z := x * y Step 2: move them outside loop

355 views • 4 slides

Motion Aftereffects Without Motion: Engaging the Human Motion Perception System With Still

Motion Aftereffects Without Motion: Engaging the Human Motion Perception System With Still Photographs Jonathan Winawer Stanford University None of these images contain motion Yet, some images have more motion than others 1 Were the two

579 views • 15 slides

Robust Face Recognition under Varying Illumination and Occlusion Considering Structured Sparsity

Robust Face Recognition under Varying Illumination and Occlusion Considering Structured Sparsity Xingjie Wei, Chang-Tsun Li and Yongjian Hu Department of Computer Science, University of Warwick x.wei@warwick.ac.uk http://warwick.ac.uk/xwei

1.08k views • 24 slides

Motion capture Captures the subtlety of human motion Keyframing difficult and not as

Motion capture Captures the subtlety of human motion Keyframing difficult and not as successful Cons: We can use only prerecorded material (with certain adaptations)-limiting Data valid only for same scale avatar-need for

772 views • 56 slides

Loop Invariant Code Motion Last Time Uses of SSA: reaching constants, dead-code elimination,

Loop Invariant Code Motion Last Time Uses of SSA: reaching constants, dead-code elimination, induction variable identification Today Finish up induction variable identification Loop invariant code motion Next Time Reuse

778 views • 10 slides

Define Illumination? Explain the laws of illumination? Illumination- The luminous flux falling per

Define Illumination? Explain the laws of illumination? Illumination- The luminous flux falling per unit area of a surface. Laws of Illumination: 1) Inverse square law- According to this law, the illumination of a surface is inversely

448 views • 32 slides

Structure from Motion Structure from Motion For now, static scene and moving camera

Structure from Motion Structure from Motion For now, static scene and moving camera Equivalently, rigidly moving scene and static camera Limiting case of stereo with many cameras Limiting case of multiview camera calibration with

839 views • 31 slides

Illumination with large data sets Updating the Lanscape of Human Engineering and Perceived

Real Time Global Illumination with large data sets Updating the Lanscape of Human Engineering and Perceived Quality Dennis Malone Human Engineering Nissan Technical Center - North America Opening Intro Nissan began a global initiative to

505 views • 22 slides

Motion and Human Motion and Human Actions Actions Ivan Laptev ivan.laptev@ens.fr Equipe projet

Object recognition and computer vision 2009/2010 Lecture 11 December 15 Lecture 11, December 15 Motion and Human Motion and Human Actions Actions Ivan Laptev ivan.laptev@ens.fr Equipe projet WILLOW ENS/INRIA/CNRS UMR 8548 Equipe-projet

536 views • 52 slides

Motion Capture Specialized Motion Capture N. Alberto Borghese Laboratory of Human Motion

Motion Capture Specialized Motion Capture N. Alberto Borghese Laboratory of Human Motion Analysis and Virtual Reality (MAVR) Department of Computer Science University of Milano Laboratory of Motion Analysis & Virtual Reality, MAVR

393 views • 25 slides

1 Scale invariant feature selection Affine transforms why? Harris-Laplace (HL) detector:

Why Local Features? Scale and Affine Invariant Interest Point Robust to noise, occlusion and clutter. Detectors Distinctive and repeatable. No explicit segmentation required represent Krystian Mikolajczyk and Cordelia Schm id

213 views • 6 slides

Human-Robot Interaction Elective in Artificial Intelligence Lecture 9 Motion control for HRI

Human-Robot Interaction Elective in Artificial Intelligence Lecture 9 Motion control for HRI Luca Iocchi DIAG, Sapienza University of Rome, Italy Outline Robot motion: main feature characterizing HRI from HCI Human-robot distance

437 views • 21 slides

Global illumination Anastasia Bolotnikova Global illumination a.k.a. GI a.k.a. indirect

Global illumination Anastasia Bolotnikova Global illumination a.k.a. GI a.k.a. indirect illumination What? - bunch of algorithms, a process of simulating indirect light Why? - add more realistic lighting to 3D scenes (direct+indirect) Some issues:

298 views • 19 slides

1 Reflection Equation Reflection Equation i i r r x x Sum over all light

Illumination Models Foundations of Computer Graphics So far considered mainly local illumination (Spring 2012) Light directly from light sources to surface CS 184, Lecture 22: Global Illumination Global Illumination: multiple bounces

232 views • 5 slides

Illumination Models Illumination Models So far considered mainly local illumination Computer

Illumination Models Illumination Models So far considered mainly local illumination Computer Graphics (Fall 2004) Computer Graphics (Fall 2004) Light directly from light sources to surface COMS 4160, Lecture 22: Global Illumination Global

379 views • 5 slides

Byte-Aligned Codes Indexing, session 6 CS6200: Information Retrieval Slides by: Jesse Anderton

Byte-Aligned Codes Indexing, session 6 CS6200: Information Retrieval Slides by: Jesse Anderton Byte-Aligned Codes Weve looked at ways to encode integers with bit-aligned codes. These are very compact, but somewhat inconvenient. Processors

300 views • 7 slides

Total Dose Dependence of Oxide Charge, Interstrip Capacitance and Breakdown Behavior of sLHC

Total Dose Dependence of Oxide Charge, Interstrip Capacitance and Breakdown Behavior of sLHC Prototype Silicon Strip Detectors and Test Structures of the SMART Collaboration H. F.-W. Sadrozinski, C. Betancourt, R. Heffern, I. Henderson, J.

827 views • 14 slides

CMOS Analog VLSI Design Course Code: EE618 Department: Electrical Engineering Semester: Autumn

CMOS Analog VLSI Design Course Code: EE618 Department: Electrical Engineering Semester: Autumn 2015 Date: July 21, 2015 Instructor: M. Shojaei Baghini E-Mail ID: mshojaei@ee.iitb.ac.in 1 4 Basic Definitions Related to Energy Band Diagram

294 views • 10 slides

Khataman Nabiyyeen Define terminology Sayings of the Promised Messiah ( on whom be peace) The

The Concept of Khataman Nabiyyeen Define terminology Sayings of the Promised Messiah ( on whom be peace) The main concept Evidence from the Holy Qur'an Evidence from Ahadith Evidence from religious scholars Define terminology Sayings of

997 views • 53 slides

Animating real-time virtual humans thanks to motion capture Franck Multon Laboratoire de

Animating real-time virtual humans thanks to motion capture Franck Multon Laboratoire de Physiologie et de lExercice SIAMES project Musculaire IRISA / INRIA Rennes Universit de Rennes 2 FRANCE FRANCE Introduction Motion re-use

565 views • 20 slides

Lecture 21: Motion and tracking Thursday, Nov 29 Prof. Kristen Grauman Prof. Kristen Grauman

Lecture 21: Motion and tracking Thursday, Nov 29 Prof. Kristen Grauman Prof. Kristen Grauman Detection vs tracking Detection vs. tracking Tracking with dynamics : We use image Tracking with dynamics : We use image measurements to

919 views • 72 slides

CGDD 4113 3D Modeling and Animation Rongkai Guo Course Meeting Days and Times Class time:

CGDD 4113 3D Modeling and Animation Rongkai Guo Course Meeting Days and Times Class time: Mon, Wed and Fri, 10:00AM 10:50AM Fridays are usually the lab lecture day. No Lab time Objectives Describe the mathematics of 3D

810 views • 9 slides

TD extended with iotschema.org Darko Anicic, Michael Koster WoT F2F Meeting Burlingame, USA

Web of Things TD extended with iotschema.org Darko Anicic, Michael Koster WoT F2F Meeting Burlingame, USA Motivation: Thing Discovery TD Directory Need AirConditioner Problem Statement Discovery of Things suitable for a WoT

616 views • 26 slides