Artimate : an articulatory animation framework for audiovisual - - PowerPoint PPT Presentation

▶
artimate an articulatory animation framework for
SMART_READER_LITE
LIVE PREVIEW

Artimate : an articulatory animation framework for audiovisual - - PowerPoint PPT Presentation

Dec 30, 2022 498 likes •797 views

Introduction Modelling Architecture Conclusion Artimate : an articulatory animation framework for audiovisual speech synthesis Ingmar Steiner and Slim Ouni Speech Group Dublin, March 9, 2012 Introduction Modelling Architecture Conclusion

slide-1
SLIDE 1

Introduction Modelling Architecture Conclusion

Artimate: an articulatory animation framework for audiovisual speech synthesis

Ingmar Steiner and Slim Ouni

Speech Group

Dublin, March 9, 2012

slide-2
SLIDE 2

Introduction Modelling Architecture Conclusion

Motion Capture

Face/Body Performance

slide-3
SLIDE 3

Introduction Modelling Architecture Conclusion

Motion Capture

Face/Body Performance

source: photobucket.com

slide-4
SLIDE 4

Introduction Modelling Architecture Conclusion

Motion Capture

Face/Body Performance

source: photobucket.com source: tumblr.com

slide-5
SLIDE 5

Introduction Modelling Architecture Conclusion

Motion Capture

Speech

slide-6
SLIDE 6

Introduction Modelling Architecture Conclusion

Motion Capture

Speech

source: turbosquid.com

slide-7
SLIDE 7

Introduction Modelling Architecture Conclusion

Motion Capture

Speech?

source: turbosquid.com

slide-8
SLIDE 8

Introduction Modelling Architecture Conclusion

Model Assembly

Static model & EMA

slide-9
SLIDE 9

Introduction Modelling Architecture Conclusion

Model Assembly

Rigging

slide-10
SLIDE 10

Introduction Modelling Architecture Conclusion

Model Animation

Skeleton

slide-11
SLIDE 11

Introduction Modelling Architecture Conclusion

Model Animation

Surface

slide-12
SLIDE 12

Introduction Modelling Architecture Conclusion

Architecture

. . . . . . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . . . . . . . . . . .

peech

ven

ma

slide-13
SLIDE 13

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler

. . . . . . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . . . . . . . . . . .

peech

ven

ma

slide-14
SLIDE 14

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . . . . . . . . . . .

peech

ven

ma

slide-15
SLIDE 15

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-16
SLIDE 16

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-17
SLIDE 17

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-18
SLIDE 18

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-19
SLIDE 19

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-20
SLIDE 20

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-21
SLIDE 21

Introduction Modelling Architecture Conclusion

Architecture

Artimate Model Compiler Artimate Core

. . . . . . .

M . A

.

R . Y

. . . . . . . . . . . . . . . . . . . .

ext

. . . . . . . . . . . . . . . . . . . .

  • .

. . . . . . . . . . . . . . . . . . .

peech

Artimate Demo App

ven

ma

slide-22
SLIDE 22

Introduction Modelling Architecture Conclusion

Summary

  • Adapted skeletal animation for articulatory animation
slide-23
SLIDE 23

Introduction Modelling Architecture Conclusion

Summary

  • Adapted skeletal animation for articulatory animation
  • Motion capture data (EMA)
slide-24
SLIDE 24

Introduction Modelling Architecture Conclusion

Summary

  • Adapted skeletal animation for articulatory animation
  • Motion capture data (EMA)
  • Modular, cross-platform implementation with open-source

dependencies

slide-25
SLIDE 25

Introduction Modelling Architecture Conclusion

Summary

  • Adapted skeletal animation for articulatory animation
  • Motion capture data (EMA)
  • Modular, cross-platform implementation with open-source

dependencies

  • Self-contained, portable resource
slide-26
SLIDE 26

Introduction Modelling Architecture Conclusion

Further work

  • Handle noisy EMA data
slide-27
SLIDE 27

Introduction Modelling Architecture Conclusion

Further work

  • Handle noisy EMA data
  • Testing (validation, portability, integration, . . . )
slide-28
SLIDE 28

Introduction Modelling Architecture Conclusion

Further work

  • Handle noisy EMA data
  • Testing (validation, portability, integration, . . . )
  • Documentation
slide-29
SLIDE 29

Introduction Modelling Architecture Conclusion

Further work

  • Handle noisy EMA data
  • Testing (validation, portability, integration, . . . )
  • Documentation
  • Public release