SLIDE 1
Real-time Performance-Based Facial Animation
Mark Pauly
Eurographics 2012, Cagliari, Italy
Introduction
2
Real-time Performance-Based Facial Animation Mark Pauly - - PowerPoint PPT Presentation
Real-time Performance-Based Facial Animation Mark Pauly - - PowerPoint PPT Presentation
Real-time Performance-Based Facial Animation Mark Pauly Eurographics 2012, Cagliari, Italy Introduction 2 Eurographics 2012, Cagliari, Italy Overview Facial Tracking using Blendshape Model rigid transformation + blendshape weights per
SLIDE 2
SLIDE 3
Eurographics 2012, Cagliari, Italy
Overview
Facial Tracking using Blendshape Model
- rigid transformation + blendshape weights per frame
Personalized Blendshape Model
- static face capture
- example based facial rigging
Tracking
- rigid & nonrigid registration
- animation prior
3
SLIDE 4
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
Animation Pipeline
SLIDE 5
Eurographics 2012, Cagliari, Italy
Facial Expression Model
Static Face Capture
[Weise et al, 2009] 5
SLIDE 6
Eurographics 2012, Cagliari, Italy
Facial Expression Model
Face Fitting
[Li et al, 2009] 6
SLIDE 7
Eurographics 2012, Cagliari, Italy
Facial Expression Model
Texture Reconstruction
Poisson Image Editing [Pérez et al, 2003] 7
SLIDE 8
Eurographics 2012, Cagliari, Italy
Facial Expression Model
Example-based Facial Rigging
8 [Li et al, 2010]
generic template personalized expression model
SLIDE 9
Eurographics 2012, Cagliari, Italy
Rigid Tracking
9
SLIDE 10
Estimate blendshape weights
- similar to scans & color image
- plausible animation
MAP estimation
- non-rigid registration based on geometry & texture
- animation prior from existing animation sequences
Eurographics 2012, Cagliari, Italy
Non-rigid Tracking
10
SLIDE 11
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
N-Dim Expression Space
SLIDE 12
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
N-Dim Expression Space
SLIDE 13
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
N-Dim Expression Space
SLIDE 14
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
Animation Manifold
SLIDE 15
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
Probabilistic Expression Prior
SLIDE 16
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
Probabilistic Animation Prior
SLIDE 17
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
Temporal Joint Probabilistic Distribution
SLIDE 18
Eurographics 2012, Cagliari, Italy Eurographics 2012, Cagliari, Italy
MAP Estimation
SLIDE 19
Eurographics 2012, Cagliari, Italy