Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura - PowerPoint PPT Presentation

Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet, Makarand Tapaswi, Ziad Al-Halah, Rainer Stiefelhagen SOFTWARE DESIGN AND QUALITY GROUP KIT - Computer Vision for Human Computer Interaction Lab INSTITUTE FOR PROGRAM STRUCTURES AND DATA ORGANIZATION, FACULTY OF INFORMATICS Penny asked me to Yes, that’s nice, We haven’t met. do her a favor. Leonard . I’m Kate. Sheldon Leonard Kate KIT – University of the State of Baden-Wuerttemberg and www.kit.edu National Research Center of the Helmholtz Association

Person Identification in TV series Transcripts Subtitles who speaks when? what is spoken when ? who speaks what ? 00:11:38  00:11:40 Penny - Oh, hey, Leonard. Ah, hey Leonard. - Good afternoon, Penny. Leonard Good afternoon Penny, 00:11:40  00:11:42 so hi, hey. Uh So, hi, hey. Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

Person Identification in TV series Transcripts Subtitles who speaks when? what is spoken when ? who speaks what ? 00:11:38  00:11:40 Penny - Oh, hey, Leonard. Ah, hey Leonard. - Good afternoon, Penny. Leonard Good afternoon Penny, 00:11:40  00:11:42 so hi, hey. Uh So, hi, hey. Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

Person Identification in TV series Transcripts Subtitles who speaks when? what is spoken when ? who speaks what ? 00:11:38  00:11:40 Penny - Oh, hey, Leonard . Ah, hey Leonard. - Good afternoon, Penny . Leonard Good afternoon Penny, 00:11:40  00:11:42 so hi, hey. Uh So, hi, hey. Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

From Weak Labels to PersonID ...in the information age, Sheldon … 2 nd person Leonard can’t process corn 3 rd person I’m Leonard. 1 st person Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

From Weak Labels to PersonID ...in the information age, Sheldon … + 2 nd person Sheldon Sheldon - + MIL Leonard can’t process corn - Leonard 3 rd person Leonard + - MIL I’m Leonard. + Leonard 1 st person SVM Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

From Weak Labels to PersonID ...in the information age, Sheldon … + 2 nd person Sheldon Sheldon - + MIL Sheldon Leonard can’t process corn - Leonard 3 rd person Leonard Sheldon + - Leonard MIL I’m Leonard. + Leonard 1 st person Leonard SVM Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

Evaluation ρ + tracks Series % correct BBT + Positive 96.0 0.23 Series AP Buffy + BBT 98 89.5 0.24 Buffy 83 Lost + 84.8 0.32 Lost 76 Negative BBT - 46.5 0.11 Buffy - 44.4 0.12 Lost - 70.9 0.06 Surname Lastname - Presentation Title Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet

Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet, Makarand Tapaswi, Ziad Al-Halah, Rainer Stiefelhagen Karlsruhe Institute of Technology, Germany haurilet@kit.edu I am Dracula What do you Penny is a little want, Sawyer ? messy.