EM EMOTION RECOGNITION IN IN SOUND ANASTASIYA S. POPOVA HSE NN - PowerPoint PPT Presentation

Dec 05, 2022 •512 likes •672 views

EM EMOTION RECOGNITION IN IN SOUND ANASTASIYA S. POPOVA HSE NN 2017 INTRODUCTION THE PROBLEM y : X Y y : R n Y THE DATASET (RA RAVDESS DA DATABASE) http://neuron.arts.ryerson.ca/ravdess/?f=3 PRETREATMENT Length equalization

EM EMOTION RECOGNITION IN IN SOUND ANASTASIYA S. POPOVA HSE NN 2017
INTRODUCTION
THE PROBLEM y : X → Y y : R n → Y
THE DATASET (RA RAVDESS DA DATABASE) http://neuron.arts.ryerson.ca/ravdess/?f=3
PRETREATMENT Length equalization
PRETREATMENT Loudness normalization
PRETREATMENT Highpass&Lowpass filters, voice audio detection (VAD) algorithm
SPECTROGRAM -> MELSPECTROGRAM
THE DIFFERENCE BETWEEN CLASSES (HYPOTHESIS ) neutral calm happy sad surprised fearful angry disgust
CONVOLUTION NETWORK
Input RGB image VGG-11 à VGG-16 Conv3-64 Maxpool Input RGB image Conv3-128 Conv3-64 Maxpool Maxpool Conv3-256 Conv3-128 Conv3-256 Maxpool Conv3-256 Conv3-256 Conv3-256 Maxpool Conv3-512 Maxpool Conv3-512 Conv3-512 Conv3-512 Conv3-512 Maxpool Maxpool Conv3-512 Conv3-512 Conv3-512 Conv3-512 Conv3-512 Maxpool Maxpool FC-4096 FC-4096 FC-4096 FC-4096 FC-1000 FC-1000 Soft-max Soft-max
CLASSIFICATION ON 8 CLASSES ACCURACY VGG-11 + spectrogram VGG-16 + melspectrogram
CONFUSION MATRIX
MEL FREQUENCY CEPSTRAL COEFFICIENTS (MFCC)
stasysp.96@gmail.com

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Based on Signal Processing SHREEKANT MARWADI Why Emotion Recognition in HCI? 1 2 3 Natural

Emotion Recognition Based on Signal Processing SHREEKANT MARWADI Why Emotion Recognition in HCI? 1 2 3 Natural way of interaction Computers will Ease interaction for humans understand human between human and input more precisely

414 views • 16 slides

Emotion Recognition in the Wild Karan Sikka, Karmen Dykstra, Suchitra Sathyanarayana, Gwen

Multiple Kernel Learning for Emotion Recognition in the Wild Karan Sikka, Karmen Dykstra, Suchitra Sathyanarayana, Gwen Littlewort and Marian S. Bartlett Machine Perception Laboratory UCSD EmotiW Challenge, ICMI, 2013 1 Task Emotion

303 views • 27 slides

Emotion Recognition in Speech under Environmental Noise Conditions using Wavelet Decomposition

Emotion Recognition in Speech under Environmental Noise Conditions using Wavelet Decomposition asquez-Correa 1 , N. Garc a 1 , J.R. Orozco-Arroyave 1 , 2 , J.C. V no 1 , J.F. Vargas-Bonilla 1 , Elmar N oth 2 J.D. Arias-Londo 1 Faculty

781 views • 25 slides

DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation

DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation EMNLP19 Deepanway Ghosal, Navonil Majumder, Soujanya Poria , Niyati Chhaya and Alexander Gelbukh Singapore University of Technology and Design, Singapore

995 views • 21 slides

Speaker and Emotion Recognition of TV-Series Data Using Multimodal and Multitask Deep Learning

Speaker and Emotion Recognition of TV-Series Data Using Multimodal and Multitask Deep Learning Sashi Novitasari 1 , Quoc Truong Do 1 , Sakriani Saktj 1,3 , Dessi Lestari 2 , Satoshi Nakamura 1,3 1 Graduate School of Informatjon Science, Nara

395 views • 16 slides

Emotion Recognition from Speech with Acoustic, Non-Linear and Wavelet-based Features Extracted in

Emotion Recognition from Speech with Acoustic, Non-Linear and Wavelet-based Features Extracted in Different Acoustic Conditions Juan Camilo V asquez Correa Advisor: PhD. Jes us Francisco Vargas Bonilla. Department of Electronics and

1.55k views • 117 slides

The effect of presentation time and working memory load on emotion recognition. Tsouli A,

Research Article http://www.alliedacademies.org/journal-of-psychology-and-cognition/ The effect of presentation time and working memory load on emotion recognition. Tsouli A, Pateraki L, Spentza I, Nega C* The American College of Greece, Greece

494 views • 6 slides

A Personalized Affective Memory Model for Improving Emotion Recognition Pablo Barros , German I.

A Personalized Affective Memory Model for Improving Emotion Recognition Pablo Barros , German I. Parisi, Stefan Wermter Knowledge Technology Department of Informatics, University of Hamburg http://www.informatik.uni-hamburg.de/WTM/

437 views • 11 slides

Emotion and Child Development Eve Ekman, MSW, PhC UC Berkeley, UCSF Overview Science of Emotion

Emotion and Child Development Eve Ekman, MSW, PhC UC Berkeley, UCSF Overview Science of Emotion and Stress Early childhood Development of Emotion, Empathy and Pro-Social Behavior Adolescence, Risk Taking and Emotion Regulation Take

606 views • 24 slides

Motivation and Emotion: Emotions, Stress and Health Unit Overview Theories of Emotion

Motivation and Emotion: Emotions, Stress and Health Unit Overview Theories of Emotion Embodied Emotion Expressed Emotion Experienced Emotion Stress and Health Click on the any of the above hyperlinks to go to that section in

1.22k views • 90 slides

Emotion recognition for empathy-driven HRI: An adaptive approach Seminar Intelligent Robotics

Emotion recognition for empathy-driven HRI: An adaptive approach Seminar Intelligent Robotics WiSe 2018/19 Presentation by Angelie Kraft Overview I. Introduction II. An Empathy-Driven Approach by Churamani et al. (2018) III. Evaluation

610 views • 24 slides

Music Information Retrieval and Music Emotion Recognition Yi-Hsuan Yang Ph.D.

2014 Music Information Retrieval and Music Emotion Recognition Yi-Hsuan Yang Ph.D. http://www.citi.sinica.edu.tw/pages/yang/ yang@citi.sinica.edu.tw Music & Audio Computing Lab, Research Center for IT Innovation, Academia Sinica About

1.04k views • 31 slides

3D Sound GWU Why Sound? Emotional Impact Improved Presence Situational Awareness

3D Sound GWU Why Sound? Emotional Impact Improved Presence Situational Awareness Sensory Substitution Better Graphics Product Recognition GWU 3D Sound: Rendering Pipeline Emitter Model How we represent

896 views • 52 slides

Creating Emotion in the Blink of an Eye presented by Jeroen Snepvangers Q: How can we transform

TransFolio presents Creating Emotion in the Blink of an Eye presented by Jeroen Snepvangers Q: How can we transform VR into a mainstream must-have? A: Open your eyes to the power of Human Emotion Why Emotion Matters Wizard of Oz, a

373 views • 16 slides

Emotion Lecturer: Dr Tony Mowbray (tony.mowbray@monash.edu) Learning Objectives Define

Emotion Lecturer: Dr Tony Mowbray (tony.mowbray@monash.edu) Learning Objectives Define Emotion Explain the characteristics of emotion Identify the roles of social and cultural influences on emotion Describe the various theories

199 views • 9 slides

Preprocessing Clasification DDBB Features extraction Pretraining

MULTIMEDIA DATA ANALISYS FOR EMOTION RECOGNITION D e v e l o p a m e t h o d o l o g y t h a t a l l o w s t o d e t e c t t h e e m o t i o n s o f t h e p e o p l e t h r o u g h m u l t i m e d i a d a t a , i n s p e c i a l , s

925 views • 12 slides

Approach Md Mahadi Hasan Nahid, Bishwajit Purkaystha, Md Saiful Islam Department of Computer

Bengali Speech Recognition: A Double Layered LSTM-RNN Approach Md Mahadi Hasan Nahid, Bishwajit Purkaystha, Md Saiful Islam Department of Computer Science and Engineering Shahjalal University of Science and Technology, Sylhet-3114. Speech

642 views • 42 slides

We considered age-related disguise as the intentional modification of the speaker's voice to

We considered age-related disguise as the intentional modification of the speaker's voice to sound like a younger or older person. Corpus 60 speakers, native Finnish Speech: read text in Finnish and English 26 segments in each voice type:

268 views • 4 slides

Building Competitive Advantage through Successful Training and Development Submitted in the

Building Competitive Advantage through Successful Training and Development Submitted in the partial fulfillment for the award of Graduate Diploma in Management Dimuthu de Silva 421061422 Professional Project Module GDM 406 6874words 25 July

1.04k views • 87 slides

GC0097 Proposal Updates 14th November 2017 Pre-qualification Requirements System Operator

GC0097 Proposal Updates 14th November 2017 Pre-qualification Requirements System Operator Guidelines (SOGL) Article 162 RR prequalification process A potential RR provider shall demonstrate.. that it complies with RR technical

289 views • 12 slides

Chapter 1 Internals and Computer System Design Overview Principles Eighth Edition By

Operating Systems: Chapter 1 Internals and Computer System Design Overview Principles Eighth Edition By William Stallings Operating System Operating System Exploits the hardware resources of one or more processors Provides a

1.04k views • 59 slides

Disks and RAID (Chapter 12, 14.2) CS 4410 Operating Systems [R. Agarwal, L. Alvisi, A. Bracy,

Disks and RAID (Chapter 12, 14.2) CS 4410 Operating Systems [R. Agarwal, L. Alvisi, A. Bracy, E. Sirer, R. Van Renesse] Storage Devices Magnetic disks Storage that rarely becomes corrupted Large capacity at low cost Block

2.33k views • 29 slides

FlashTier: A Lightweight, Consistent and Durable Storage Cache 1 Outline Introduction

467 views • 33 slides

Maximally entangled mixed states with fixed marginals Giuseppe Baio SUPA & University of

Maximally entangled mixed states with fixed marginals Giuseppe Baio SUPA & University of Strathclyde, Glasgow, UK 51 Symposium of Mathematical Physics, Toru, Poland 17 th June 2019 17 th June 2019 Giuseppe Baio 51 SMP Toru 1 / 22 My

736 views • 61 slides