towards an intuitive sign language animation authoring
play

Towards an Intuitive Sign Language Animation Authoring Environment - PowerPoint PPT Presentation

Jun 07, 2023 •472 likes •665 views

Towards an Intuitive Sign Language Animation Authoring Environment For the Deaf Alexis Heloir, Fabrizio Nunnari UVHC, LAMIH - Valenciennes, France DFKI-MMCI, SLSI group - Germany NLP: Parallel Corpora Aligned annotated videos Aligned Glosses

  1. Towards an Intuitive Sign Language Animation Authoring Environment For the Deaf Alexis Heloir, Fabrizio Nunnari UVHC, LAMIH - Valenciennes, France DFKI-MMCI, SLSI group - Germany

  2. NLP: Parallel Corpora Aligned annotated videos Aligned Glosses DictaSign Project (2009--2012) RWTH-Phoenix corpus (2010)

  3. NLP: Corpora Hand-crafting Motion capture CUNY SL Corpus (2012) ATLAS (2009-- 2011) SignCom System (2012)

  4. SL Corpora - Videos - Motion capture - Manual annotation - Hand-crafted animation

  5. Video + Easy to use and accessible + High fidelity - Low semantics

  6. Motion Capture + High fidelity + 3D plus numerical values - Still Low semantics - Cumbersome and expensive

  7. Hand-crafted animation + More intelligible animation + Theory independent motion abstraction - Expensive - Requires both expert interpreters and 3D animators

  8. Annotation + High semantic + Abstracted away - Requires expert annotators - Theory Dependent

  9. SL corpuses Abstraction Synthetic signs s n o i t (Sign Writing, HamNoSys) a t o n n A ??? Hand-crafted animation Motion Capture Videos Quantity of data

  10. SL corpuses Abstraction Synthetic signs s n o i t (Sign Writing, HamNoSys) a t o n n A Monitored handcrafted NEW! avatar animation Hand-crafted animation Motion Capture Videos Quantity of data

  11. Current SL production pipelines Mocap 3D operator operator Performance Sign animation mocap → Data Cleanup Capture Cleanup Hired Signary Performer / Interpreter Video hand-craft → Sign animation Capture 3D operator & Interpreter

  12. Production pipeline: to the user Mocap 3D operator operator Performance Sign animation mocap → Data Cleanup Capture Cleanup Signary Deaf user Video hand-craft → Sign animation Capture 3D operator & Interpreter

  13. Production pipeline: no complex 3D authoring Mocap 3D operator operator Performance Sign animation mocap → Data Cleanup Capture Cleanup Signary Deaf user hand-craft →

  14. Production pipeline: NUIs and no specialized operators Mocap 3D operator operator Performance Sign animation Data Cleanup Capture Cleanup Signary Deaf user NUI !!!

  15. Production pipeline: possibility to refine captured signs Performance Sign animation Data Cleanup Capture Cleanup Signary Deaf user

  16. New SL production pipelines Performance Data Cleanup Capture Signary Deaf user Manual Edit

  17. Production pipeline at work Video

  18. Future: Gathering users’ intention ● LIS relevant info ○ Contacts Manual Edit ○ Time alignments ○ Gesture amplification ○ ... Edit history Patterns extraction

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Sign Language Avatars Animation and Comprehensibility Michael Kipp* Alexis Heloir

Sign Language Avatars Animation and Comprehensibility Michael Kipp* Alexis Heloir

Sign Language Avatars Animation and Comprehensibility Michael Kipp* Alexis Heloir Quan Nguyen DFKI Embodied Agents Research Group Exzellenzcluster Multimodal Computing and Interaction Universitt des Saarlandes * University of

1.09k views • 32 slides
American Sign Language (ASL) Ms. Havens Class Sign Language Alphabet Numbers (0-10) Mother

American Sign Language (ASL) Ms. Havens Class Sign Language Alphabet Numbers (0-10) Mother

American Sign Language (ASL) Ms. Havens Class Sign Language Alphabet Numbers (0-10) Mother Father Sister Brother Day Sch chool ool Wo Word rds Learn Teacher Friend Quiet Monkey Animals Cat Duck Turkey Deer

481 views • 9 slides
ne o ed a language . c o m m n 2 FOR EXAMPLE: Sign symbols Imagine... You arrive at an

ne o ed a language . c o m m n 2 FOR EXAMPLE: Sign symbols Imagine... You arrive at an

A language is a standard form of communication . Humans speak many different languages . But, there are certain things we all need to understand and communicate . For t he se , we ne o ed a language . c o m m n 2 FOR EXAMPLE: Sign

958 views • 32 slides
Introduction to Computer Graphics Animation (1) May 23, 2019 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 23, 2019 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 23, 2019 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=DsoNab58QVA 2 Representing a pose using skeleton Tree

682 views • 40 slides
Introduction to Computer Graphics Animation (1) May 18, 2017 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 18, 2017 Kenshi Takayama

Introduction to Computer Graphics Animation (1) May 18, 2017 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=DsoNab58QVA 2 Representing a pose using skeleton Tree

895 views • 40 slides
A Lexical Comparison of Tajik Sign Language and Afghan Sign Language Justin Power The University

A Lexical Comparison of Tajik Sign Language and Afghan Sign Language Justin Power The University

A Lexical Comparison of Tajik Sign Language and Afghan Sign Language Justin Power The University of Texas at Austin First North American Conference in Iranian Linguistics 28 April 2017 Stony Brook University, New York, USA Introduction

497 views • 34 slides
Is there disruption in the sign language interpreting profession? Jemina Napier #WeAreLeverage

Is there disruption in the sign language interpreting profession? Jemina Napier #WeAreLeverage

Is there disruption in the sign language interpreting profession? Jemina Napier #WeAreLeverage Context Deaf sign language users 70 million deaf sign language users in the world (WFD) 138 sign languages listed on Ethnologue

237 views • 8 slides
Chapter 8 - Animation Animation before the time of 3DCG Animation techniques

Chapter 8 - Animation Animation before the time of 3DCG Animation techniques

Chapter 8 - Animation Animation before the time of 3DCG Animation techniques keyframing bone animation & motion capture simulation Animation principles LMU Mnchen Medieninformatik Heinrich Hussmann

812 views • 47 slides
Introduction to Computer Graphics Animation (1) July 2, 2020 Kenshi Takayama

Introduction to Computer Graphics Animation (1) July 2, 2020 Kenshi Takayama

Introduction to Computer Graphics Animation (1) July 2, 2020 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=DsoNab58QVA 2 Representing a pose using skeleton

536 views • 41 slides
Indian Sign Language Gesture Recognition Group 11 CS365 - Project Presentation Sanil

Indian Sign Language Gesture Recognition Group 11 CS365 - Project Presentation Sanil

Indian Sign Language Gesture Recognition Group 11 CS365 - Project Presentation Sanil Jain(12616) Kadi Vinay Sameer Raja(12332) Indian Sign Language History ISL uses both hands similar to British Sign Language and is similar to

479 views • 21 slides
Animation Presented by Sancho McCann Animation Is animation useful? Why?

Animation Presented by Sancho McCann Animation Is animation useful? Why?

Animation Presented by Sancho McCann Animation Is animation useful? Why? Principles of animation Principles applied Animation: can it facilitate? Does animation help the understanding of changes over time? A picture

4.12k views • 49 slides
Sign Language MT Sara Morrissey Overview Introduction Irish Sign Language Problems

Sign Language MT Sara Morrissey Overview Introduction Irish Sign Language Problems

Sign Language MT Sara Morrissey Overview Introduction Irish Sign Language Problems for SLMT SLMT Data MaTrEx for SLs Future work Introduction (1) Motivation Motivation SLs are poorly resourced and lack

308 views • 18 slides
1 Steps in Creating Animation Secondary Actions Sequences (1 of 3) Animation part that does

1 Steps in Creating Animation Secondary Actions Sequences (1 of 3) Animation part that does

Outline The Pipeline IMGD 1001: Concept Art 2D Art 2D Art (next) Animation Tiles Animation, Tiles 3D Art Modeling, Texturing, Lighting IMGD 1001 Animation Key Frames Animation produces the illusion of

80 views • 4 slides
Phrase Boundary Blinks in American Sign Language MON SKRATT HENRY MENTOR: DR. MARTHA TYRONE,

Phrase Boundary Blinks in American Sign Language MON SKRATT HENRY MENTOR: DR. MARTHA TYRONE,

Phrase Boundary Blinks in American Sign Language MON SKRATT HENRY MENTOR: DR. MARTHA TYRONE, LONG ISLAND UNIVERSITY- DOWNTOWN BROOKLYN & HASKINS LABORATORIES 1 Background American Sign Language (ASL) is a sign language used in the

218 views • 20 slides
Outline 1. Principles of Traditional Animation Applied to Computer Animation Animation

Outline 1. Principles of Traditional Animation Applied to Computer Animation Animation

Outline 1. Principles of Traditional Animation Applied to Computer Animation Animation (Lasseter, 1987) 2. Animation: Can it facilitate? (Tversky and Morrison, 2002) Presented By Timothy Chan 3. On Creating Animated Presentations (Zongker

541 views • 9 slides
Jianning Yue Wookyun Kho Young Jin Yoon AGL : Animation applet Generation Language Contents

Jianning Yue Wookyun Kho Young Jin Yoon AGL : Animation applet Generation Language Contents

Jianning Yue Wookyun Kho Young Jin Yoon AGL : Animation applet Generation Language Contents IPL? Advantages Syntax Development Examples Lessons Learned AGL : Animation applet Generation Language IPL? IPL is not

629 views • 26 slides
Synchronized Aggregate Signatures from the RSA Assumption Brent Waters Susan Hohenberger

Synchronized Aggregate Signatures from the RSA Assumption Brent Waters Susan Hohenberger

Synchronized Aggregate Signatures from the RSA Assumption Brent Waters Susan Hohenberger Aggregate Signatures [Boneh-Gentry-Lynn-Shacham03] Idea: Compress several signatures into one PK 3 PK 1 PK 2 PK n M 3 M 1 M 2 M n Sig 1 Sig 2 Sig

646 views • 23 slides
Completely log-concave polynomials and matroids Cynthia Vinzant (North Carolina State

Completely log-concave polynomials and matroids Cynthia Vinzant (North Carolina State

Completely log-concave polynomials and matroids Cynthia Vinzant (North Carolina State University) joint work with Nima Anari, KuiKui Liu, Shayan Oveis Gharan (Stanford) (U. Washington) (U. Washington) Cynthia Vinzant Completely

242 views • 20 slides
CENG 342 Digital Systems Sign-magnitude Adder Larry Pyeatt SDSM&T Inattention Blindness

CENG 342 Digital Systems Sign-magnitude Adder Larry Pyeatt SDSM&T Inattention Blindness

CENG 342 Digital Systems Sign-magnitude Adder Larry Pyeatt SDSM&T Inattention Blindness How many Red Points do you see in the picture? 5 or 6? Inattention Blindness How many Red Points do you see in the picture? 5 or 6? How many

517 views • 9 slides
Communi ty Meeti ng: R oute 93 / 38 / 28 T r affi c Cr ashes Ci ty of S omer vi l

Communi ty Meeti ng: R oute 93 / 38 / 28 T r affi c Cr ashes Ci ty of S omer vi l

Communi ty Meeti ng: R oute 93 / 38 / 28 T r affi c Cr ashes Ci ty of S omer vi l l e Massachusetts Mayor Joseph A. Cur tatone G e o rg e Pro a kis E xe c utive Dire c to r, OSPCD Bra d Ra w s o n Dire c to r, Mo b

364 views • 23 slides
Communication in Healthcare Settings Ann Deschamps, Mid-Atlantic ADA Center Bonnie OLeary,

Communication in Healthcare Settings Ann Deschamps, Mid-Atlantic ADA Center Bonnie OLeary,

8/29/2018 Effective Communication in Healthcare Settings Ann Deschamps, Mid-Atlantic ADA Center Bonnie OLeary, Northern Virginia Resource Center for Deaf and Hard of Hearing Persons Pamela Jones, Mary Washington Healthcare Mid-Atlantic

662 views • 30 slides
Interpreting for the Standardized Test Presented by Alaina Webb and Sammie Sheppard for Region

Interpreting for the Standardized Test Presented by Alaina Webb and Sammie Sheppard for Region

Interpreting for the STAAR Test The Dos and Donts of Interpreting for the Standardized Test Presented by Alaina Webb and Sammie Sheppard for Region XI ESC March, 2015 TEP pre-test What is our job as an interpreter? RID Code of

881 views • 73 slides
Brief Introduction to Continuous Sign Language Recognition 2019.1.19 Introduction

Brief Introduction to Continuous Sign Language Recognition 2019.1.19 Introduction

Brief Introduction to Continuous Sign Language Recognition 2019.1.19 Introduction What does a continuous sign language recognition (SLR) system do? word vocabulary: apple, sun, today, catch, you today is SLR system

457 views • 19 slides
Making a Tanabata wish at the LLC Think of a wish it can be anything youd like for

Making a Tanabata wish at the LLC Think of a wish it can be anything youd like for

Making a Tanabata wish at the LLC Think of a wish it can be anything youd like for yourself or others (some examples on the next slide). The more heartfelt the wish, the more likely it is to come true! Go to the LLCs counter

55 views • 3 slides

More recommend