Human Computer Intelligent Interaction Thomas S. Huang Department - - PowerPoint PPT Presentation
Human Computer Intelligent Interaction Thomas S. Huang Department of Electrical and Computer Engineering Coordinated Science Laboratory Beckman Institute for Advanced Science and Technology Center for Advanced Study University of Illinois at
Thomas S. Huang
Department of Electrical and Computer Engineering Coordinated Science Laboratory Beckman Institute for Advanced Science and Technology Center for Advanced Study University of Illinois at Urbana-Champaign
Four broad research areas
applications
Human Computer Interaction
Computer Processing Engine Memory Human Physical Environment Sensors Robotics Multimodal Interface Multimodal Display; Avatar Human Studies: Perception, Cognition, Behavior
Examples: Human to Computer
Hand tracking and applications to manipulating
virtual objects, etc.
Shrug detection Soft Biometrics: Recognition of gender, age
group, emotion
Audio-visual speech recognition
Example: Computer to Human
Audio-Visual emotive avatar
Mona Lisa was a white female, 43 year old, 83% happy
Images Data: Video Range 3D Face Model Geometry Texture Motion Analysis (tracking)
Lip reading Emotion recognition
Synthesis (animation)
Text- and Speech-
driven talking face
Facial Movement Action units ~10 Muscles Control points ~100 Smoothness Mesh vertices ~1000
Comparison of bimodal ASR and acoustic ASR recognition performances
Future: Biometrics
Recognizing gender, age group, emotion/ affect from non-frontal faces and body/ movement
Future: Robust Real-Time Algorithms
Sensors: High-speed cameras; 3D cameras; multiple cameras Parallel computing architectures Clever algorithms
Future: Applications
Finding applications to fit algorithm performance: Human in the loop Multimodality Forgiving
Demonstrations
By Zhen Li
Gender and age group recognition
By Vuong Le
3D face model from 2D face Audio-visual emotive avatar
(driven by text and emotion markers)
3D face tracking and emotion recognition