Emotion AI: A New Frontier Boisy Pitre Emotion AI Evangelist - - PowerPoint PPT Presentation

@affectiva

Emotion AI:
 A New Frontier

Boisy Pitre Emotion AI Evangelist Affectiva @boisypitre

@affectiva

Emotions influence every aspect of our lives

@affectiva

From our health
 and wellbeing

@affectiva

To what we purchase

@affectiva

How we learn

@affectiva

To the decisions
 we make

@affectiva

And how we connect
 with each other

@affectiva

We are surrounded by hyper-intelligent technologies with massive cognitive and autonomous capabilities

@affectiva

All these systems have 
 high “I.Q” but no EQ (Emotional Intelligence)

@affectiva

Yet our interactions with technology are rapidly becoming… more conversational

@affectiva

More relational

@affectiva

What if our cars knew
 if we were getting
 angry and could make


• ur brakes more 


responsive?

@affectiva

What if doctors could

• bjectively measure how 


you are feeling the way 
 they measure our other 
 vital signs?

@affectiva

What if social robots, could actually be “social”?

@affectiva

What if every device in the internet

• f things had an emotion chip

and could make personalized suggestions based on your mood? Your smart refrigerator could identify 
 how you felt and suggest a food that matched your emotion.

@affectiva

Our vision is to humanize technology with Emotion Intelligence by enabling machines to be emotion-aware and by allowing businesses to get emotion analytics.
 This is Emotion AI.

@affectiva

Emotion AI
 
 How it works

@affectiva

Our faces 
 tell stories.

@affectiva

SHAME CALM GUILT JOY ANGER LOVE PAIN PASSION

@affectiva

What does emotion data look like?

@affectiva

Telling the difference between… a Smile a Smirk

@affectiva

Emotion Analysis in the Cloud

@affectiva

Limitations of a
 Cloud-based API

@affectiva

The case for a
 Real-Time API

@affectiva

@affectiva

@affectiva

@affectiva

@affectiva

VIDEO AUDIO 496MB 32KB Just two seconds of…

1920x1080 32-bit frames at 30 frames per second 16KHz 8-bit mono audio

@affectiva

World’s largest emotion repository

75 countries, 5.3M faces analyzed, 2B facial frames Top Countries for Emotion Data

USA 956K MEXICO 117K BRAZIL 176K GERMANY 126K UNITED KINGDOM 265K CHINA 502K JAPAN 52K VIETNAM 131K PHILIPINES 133K INDONESIA 284K THAILAND 162K INDIA 1,065K

@affectiva

Guarding against biases

Female Male African American South 
 Asian South 
 Asian Hispanic Caucasian Unknown Other

Ensuring ethnicity, gender and age diversity in our training data

@affectiva

What have we
 learned from the data?

@affectiva

Women more expressive than men!

Man Woman Smile intensity Smile duration (s)

Females express more than men

30%

0% 15% 30% 45% 60%

5 10 15 20 25 30 50% 40% 30% 20% 10%

@affectiva

Women smiled 32% more than men

Women smiled in just

• ver a quarter of the facial

video responses, smiling 32% more than men. Women smiled more than men and their smiles were longer in duration.

@affectiva

Men showed more “brow furrowing” compared to women

Women furrowed in only 20% of the videos, and they actually furrow 12% less than men Brow furrows from women were significantly shorter in duration than those from men.

@affectiva

Gender differences vary by culture

50% 75% 100% 125% 150%

UNITED STATES FRANCE UNITED KINGDOM

In the US women smile 40% more than men, in France it’s 25%, but in the UK it’s the same

@affectiva

+25%

more

50 years below 50+ years

Older people 
 more emotive 
 than younger people

@affectiva

In the US, pet care and baby care ads elicit the most enjoyment!

Enjoyment Enjoyment

1 2 3 4 5 6 7 8 9 10

Pet Care Baby Care Dairy Entertainment Snacks Ice cream Telecom Chocolate Apparel Auto Restaurant Services Prescription Fuel

1 2 3 4 5 6 7 8 9

@affectiva

In Canada, its the Cereal ads that elicit the most enjoyment!

0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8

Cereal Finance OTC Beverage Entertainment Chocolate Spreads Candy Telecom

1.5 2.0 2.5 3.5 4.0 4.5 3.0 5.0 5.5 6.5 7.0 7.5 6.0 8.0 1.0 0.5 1 2 3 4 5 6 7 8 9

Enjoyment Enjoyment

@affectiva

Emotion AI
 
 How it is used

@affectiva

Insights & Analytics

Understand how people engage emotionally in the digital world

Real Time Interaction

Apps and digital experiences adapt to our emotions in real time

How Emotion AI is used

@affectiva

Gaming

Nevermind

Psychological thriller game becomes more challenging when sensing player distress

@affectiva

Top performers are more expressive

They smile more, but its not just

• that. They show a wider range of

emotion compared to bottom performers – maybe they are more authentic? Data pulled from 13,356 
 interviews that also had 
 performance model scores.

Percent Change

Anger (range) Fear (range) Sadness (max) Attention (range) Joy (range) Valence (max) Smile (range) Surpise (range) Contempt (range) Disgust (max) Smirk (range)

Bottom 20% Top 80% 20 40 80 100 160 180 140 120 60

Video Recruitment

Brain Power: helping individuals on
 the autism spectrum

@affectiva

World’s First Augmented Reality 
 Smart-Glass-System empowers children and adults with autism to teach themselves crucial social and cognitive skills using Affectiva emotion recognition tech.

Health and Wellbeing

@affectiva

We’ve spent the past 50 years interacting with computers with their language.
 
 The time has come where computers can interact with us using our language.

@affectiva

Combining 
 Face and Voice Metrics

@affectiva

Facing the
 Road Ahead

@affectiva

Learn more at
 affectiva.com

@affectiva Boisy Pitre
 @boisypitre