Motion Cues for Illustration of Skeletal Motion Capture Data Simon - - PowerPoint PPT Presentation

▶
motion cues for illustration of skeletal motion capture
SMART_READER_LITE
LIVE PREVIEW

Motion Cues for Illustration of Skeletal Motion Capture Data Simon - - PowerPoint PPT Presentation

Dec 27, 2023 195 likes •966 views

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion Motion Cues for Illustration of Skeletal Motion Capture Data Simon Bouvier-Zappa Victor Ostromoukhov Pierre Poulin LIGUM, Dept. I.R.O Universit de Montral

slide-1
SLIDE 1

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Cues for Illustration of Skeletal Motion Capture Data

Simon Bouvier-Zappa Victor Ostromoukhov Pierre Poulin

LIGUM, Dept. I.R.O Université de Montréal

Symposium on Non-Photorealistic Animation and Rendering, 2007

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 1 / 35

slide-2
SLIDE 2

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 2 / 35

slide-3
SLIDE 3

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 3 / 35

slide-4
SLIDE 4

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Limitations Of The 2D Image

Conversion of 4D {x, y, z, t} information to 2D {x, y} data Artists use visual cues to compensate inherent limitations of the visualization medium. Motion cues are visual cues emphasizing temporal information in a static 2D representation.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 4 / 35

slide-5
SLIDE 5

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Limitations Of The 2D Image

Conversion of 4D {x, y, z, t} information to 2D {x, y} data Artists use visual cues to compensate inherent limitations of the visualization medium. Motion cues are visual cues emphasizing temporal information in a static 2D representation.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 4 / 35

slide-6
SLIDE 6

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Limitations Of The 2D Image

Conversion of 4D {x, y, z, t} information to 2D {x, y} data Artists use visual cues to compensate inherent limitations of the visualization medium. Motion cues are visual cues emphasizing temporal information in a static 2D representation.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 4 / 35

slide-7
SLIDE 7

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Limitations Of The 2D Image

Conversion of 4D {x, y, z, t} information to 2D {x, y} data Artists use visual cues to compensate inherent limitations of the visualization medium. Motion cues are visual cues emphasizing temporal information in a static 2D representation.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 4 / 35

slide-8
SLIDE 8

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Limitations Of The 2D Image

Conversion of 4D {x, y, z, t} information to 2D {x, y} data Artists use visual cues to compensate inherent limitations of the visualization medium. Motion cues are visual cues emphasizing temporal information in a static 2D representation.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 4 / 35

slide-9
SLIDE 9

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Visual Cues

1

Technical design

2

Cartoon illustration

3

Storyboard illustration

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 5 / 35

[Agrawala et al. 2003]

slide-10
SLIDE 10

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Visual Cues

1

Technical design

2

Cartoon illustration

3

Storyboard illustration

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 5 / 35

[Collomosse et al. 2005]

slide-11
SLIDE 11

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Visual Cues

1

Technical design

2

Cartoon illustration

3

Storyboard illustration

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 5 / 35

[Nienhaus et al. 2005]

slide-12
SLIDE 12

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Visual Cues

1

Technical design

2

Cartoon illustration

3

Storyboard illustration

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 5 / 35

[Goldman et al. 2006]

slide-13
SLIDE 13

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

slide-14
SLIDE 14

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

Evocative

slide-15
SLIDE 15

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

Clear Evocative

slide-16
SLIDE 16

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

Robust Clear Evocative

slide-17
SLIDE 17

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

Interactive Robust Clear Evocative

slide-18
SLIDE 18

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

Interactive Robust Clear Evocative

slide-19
SLIDE 19

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Criteria For The Motion Cue

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 6 / 35

Interactive Robust Clear Evocative

slide-20
SLIDE 20

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

A Quick Example

Is this character in motion ? If so, what is he doing ? Motion cues can help reconstitute past and future motions. Other cues will emphasize subtle, otherwise imperceptible, movements.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 7 / 35

slide-21
SLIDE 21

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

A Quick Example

Is this character in motion ? If so, what is he doing ? Motion cues can help reconstitute past and future motions. Other cues will emphasize subtle, otherwise imperceptible, movements.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 7 / 35

slide-22
SLIDE 22

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

A Quick Example

Is this character in motion ? If so, what is he doing ? Motion cues can help reconstitute past and future motions. Other cues will emphasize subtle, otherwise imperceptible, movements.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 7 / 35

slide-23
SLIDE 23

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 8 / 35

slide-24
SLIDE 24

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Capturing Motion On A Single Bone

We extract a sequence of points at γ on the bone from pose ti− to pose ti+ to create a motion curve.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 9 / 35

slide-25
SLIDE 25

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Capturing Motion On A Single Bone

The motion curve gives satisfactory results for translations and most rotations. The motion curve cannot evaluate the rolling value in a rotation.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 10 / 35

slide-26
SLIDE 26

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Possible Result Using Such Technique

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 11 / 35

slide-27
SLIDE 27

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Subdivide The Skeleton In Joint Groupings

Form anatomically meaningful groups of bones

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 12 / 35

slide-28
SLIDE 28

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Subdivide The Skeleton In Joint Groupings

Isolate articulated path

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 12 / 35

slide-29
SLIDE 29

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Subdivide The Skeleton In Joint Groupings

Identify local root quaternion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 12 / 35

slide-30
SLIDE 30

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Subdivide The Skeleton In Joint Groupings

Define a point at distance γ on the articulated path

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 12 / 35

slide-31
SLIDE 31

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Subdivide The Skeleton In Joint Groupings

Extract the “roll” value from the local root quaternion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 12 / 35

slide-32
SLIDE 32

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Modified Result With Improved Technique

Before After

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 13 / 35

slide-33
SLIDE 33

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Generalizing The Groupings Into A Motion Hierarchy

Recursively refine the groupings No subdivision 1 subdivision, 2 groups 2 subdivisions, 5 groups

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 14 / 35

slide-34
SLIDE 34

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Human Skeleton Hierarchy: Level 0

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 15 / 35

Body

slide-35
SLIDE 35

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Human Skeleton Hierarchy: Level 1

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 15 / 35

Body Upper Body Lower Body

slide-36
SLIDE 36

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Human Skeleton Hierarchy: Level 2

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 15 / 35

Upper Body Torso Head Left Arm Right Arm Lower Body Left Leg Right Leg

slide-37
SLIDE 37

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Human Skeleton Hierarchy: Level 3

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 15 / 35

Head Head Torso Torso Left Arm Left Upper Arm Left Forearm Left Hand Right Arm Right Upper Arm Right Forearm Right Hand Left Leg Left Upper Leg Left Lower Leg Left Foot Right Leg Right Upper Leg Right Lower Leg Right Foot

slide-38
SLIDE 38

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 16 / 35

slide-39
SLIDE 39

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-40
SLIDE 40

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-41
SLIDE 41

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-42
SLIDE 42

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-43
SLIDE 43

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-44
SLIDE 44

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-45
SLIDE 45

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 17 / 35

slide-46
SLIDE 46

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 18 / 35

slide-47
SLIDE 47

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 18 / 35

slide-48
SLIDE 48

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 18 / 35

slide-49
SLIDE 49

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Motion Arrow: Parameters

v1

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 19 / 35

slide-50
SLIDE 50

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Analysis Of Motion Data

We calculate motion amplitude using bounding box of motion curve.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 20 / 35

slide-51
SLIDE 51

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 21 / 35

slide-52
SLIDE 52

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 21 / 35

slide-53
SLIDE 53

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 21 / 35

slide-54
SLIDE 54

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 21 / 35

slide-55
SLIDE 55

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Analysis Of Motion Data

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 21 / 35

slide-56
SLIDE 56

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 22 / 35

slide-57
SLIDE 57

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 22 / 35

slide-58
SLIDE 58

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 22 / 35

slide-59
SLIDE 59

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 22 / 35

slide-60
SLIDE 60

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 22 / 35

slide-61
SLIDE 61

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Noise Waves: Construction

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 22 / 35

slide-62
SLIDE 62

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Stroboscopic Motion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 23 / 35

slide-63
SLIDE 63

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 24 / 35

slide-64
SLIDE 64

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

A Soccer Player

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 25 / 35

slide-65
SLIDE 65

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

A Weight-Lifter

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 26 / 35

slide-66
SLIDE 66

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

A Weight-Lifter

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 26 / 35

slide-67
SLIDE 67

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Multiple Key Poses

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 27 / 35

slide-68
SLIDE 68

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Foot Steps

Technical illustration Our result

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 28 / 35

slide-69
SLIDE 69

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 29 / 35

slide-70
SLIDE 70

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Video

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 30 / 35

slide-71
SLIDE 71

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Outline

1

Motivation

2

Motion Capture Hierarchy

3

Motion Cues

4

Results

5

Video

6

Conclusion

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 31 / 35

slide-72
SLIDE 72

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Summary

Combined use of motion arrows, noise waves and stroboscopic motion to illustrate skeletal motion capture data. Robust implementation of motion cues that adapt to the point of view and the character’s geometry. Interactive system to perform intuitive manipulations on motion cues.

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 32 / 35

slide-73
SLIDE 73

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Future Work

Short term

Integrate other motion cues to the system

Speed lines Motion blur

Refine motion analysis tool for better pattern recognition Perform user evaluation of our system

Long term

Automatically recognize specific movements from a database and apply adapted motion cues

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 33 / 35

slide-74
SLIDE 74

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Thank You !

Acknowledgements

Ubisoft Philippe Beaudoin and Luc Leblanc for support and precious insights ! Yann Rousseau for vector support ! All the people at the LIGUM !

Credits

Motion capture data: Carnegie Mellon University

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 34 / 35

slide-75
SLIDE 75

Motivation Motion Capture Hierarchy Motion Cues Results Video Conclusion

Thank You !

Bouvier-Zappa, Ostromoukhov, Poulin (Université de Montréal) NPAR 2007 35 / 35