Embodied Emoticons | Antidepressant Face Detection Interaction - - PowerPoint PPT Presentation

Embodied Emoticons | Antidepressant Face Detection

Interaction Engineering, WS 2016/17, Augsburg University of Applied Sciences, Prof. Dr. Michael Kipp Susan Kaltschmidt and Djamilia Richter

Motivation | Embodiment Cognition

• Concept of embodiment
• Smiling makes happier
• Get rid of daily routine and stress

Related Work | MSQRD

• Live fjlter overlays

Related Work | Snapchat

• Live fjlter overlays
• Goal to enhance selfjes

Related Work | Androidify on Times Square

• Individual avatars
• Little games

tracking the body

• Public setting

Interaction | Process

• Only the face of the user is detected

Interaction | Process

• Only the face of the user is detected
• Face expression is recognized

Interaction | Process

• Only the face of the user is detected
• Face expression is recognized
• Different overlays according to expression

Interaction | Process

• Only the face of the user is detected
• Face expression is recognized
• Different overlays according to expression
• Share the interaction

Realization | Technical Setup

Webcam Processing FaceOSC

Santa Tracker | User Test Prototype I

• Test prior Christmas season
• Six participants
• Feedback with Microsoft

Reaction Cards

Feedback | Changes

• Overlays are confusing

˚ Clear relation between expression/overlay ˚ Reduction to 4 Emoticons ˚ No camera image → better focus & face detection

Feedback | Changes

• Overlays are confusing

˚ Clear relation between expression/overlay ˚ Reduction to 4 Emoticons ˚ No camera image → better focus & face detection

• Clear goal

˚ Puzzle game ˚ Entertaining level design

Emoticon Puzzle | Prototype II

• Two levels
• Four puzzle pieces
• Emoticons

depict emotion

Emoticon Puzzle | First Level

Emoticon Puzzle | Second Level

• Animal Emoticons

harder to interpret

• Two actions

combined, like kiss and rise eyebrows

Emoticon Puzzle | Second Level