Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura - - PowerPoint PPT Presentation

naming tv characters by watching and analyzing dialogs
SMART_READER_LITE
LIVE PREVIEW

Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura - - PowerPoint PPT Presentation

Naming TV Characters by Watching and Analyzing Dialogs Monica-Laura Haurilet, Makarand Tapaswi, Ziad Al-Halah, Rainer Stiefelhagen SOFTWARE DESIGN AND QUALITY GROUP KIT - Computer Vision for Human Computer Interaction Lab INSTITUTE FOR PROGRAM


slide-1
SLIDE 1

KIT – University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz Association SOFTWARE DESIGN AND QUALITY GROUP INSTITUTE FOR PROGRAM STRUCTURES AND DATA ORGANIZATION, FACULTY OF INFORMATICS

www.kit.edu

Naming TV Characters by Watching and Analyzing Dialogs

Monica-Laura Haurilet, Makarand Tapaswi, Ziad Al-Halah, Rainer Stiefelhagen

KIT - Computer Vision for Human Computer Interaction Lab

Yes, that’s nice, Leonard. Penny asked me to do her a favor. We haven’t met. I’m Kate.

Sheldon Leonard Kate

slide-2
SLIDE 2

what is spoken when? 00:11:38  00:11:40

  • Oh, hey, Leonard.
  • Good afternoon, Penny.

00:11:40  00:11:42 So, hi, hey.

Person Identification in TV series

Monica-Laura Haurilet

who speaks what? Penny Ah, hey Leonard. Leonard Good afternoon Penny, so hi, hey. Uh Transcripts Subtitles who speaks when?

Naming TV Characters by Watching and Analyzing Dialogs

slide-3
SLIDE 3

what is spoken when? 00:11:38  00:11:40

  • Oh, hey, Leonard.
  • Good afternoon, Penny.

00:11:40  00:11:42 So, hi, hey.

Person Identification in TV series

Monica-Laura Haurilet

who speaks what? Penny Ah, hey Leonard. Leonard Good afternoon Penny, so hi, hey. Uh Transcripts Subtitles who speaks when?

Naming TV Characters by Watching and Analyzing Dialogs

slide-4
SLIDE 4

what is spoken when? 00:11:38  00:11:40

  • Oh, hey, Leonard.
  • Good afternoon, Penny.

00:11:40  00:11:42 So, hi, hey.

Person Identification in TV series

Monica-Laura Haurilet

who speaks what? Penny Ah, hey Leonard. Leonard Good afternoon Penny, so hi, hey. Uh Transcripts Subtitles who speaks when?

Naming TV Characters by Watching and Analyzing Dialogs

slide-5
SLIDE 5

From Weak Labels to PersonID

...in the information age, Sheldon… I’m Leonard.

1st person

Leonard can’t process corn

3rd person 2nd person

Monica-Laura Haurilet Naming TV Characters by Watching and Analyzing Dialogs

slide-6
SLIDE 6

Sheldon

MIL MIL

Leonard Leonard

Sheldon +

  • SVM

Leonard +

  • +

+

  • From Weak Labels to PersonID

...in the information age, Sheldon… I’m Leonard.

1st person

Leonard can’t process corn

3rd person 2nd person

Monica-Laura Haurilet Naming TV Characters by Watching and Analyzing Dialogs

slide-7
SLIDE 7

Sheldon

MIL MIL

Leonard Leonard

Sheldon +

  • SVM

Leonard +

  • +

+

  • From Weak Labels to PersonID

...in the information age, Sheldon…

Sheldon Leonard Leonard Sheldon

I’m Leonard.

1st person

Leonard can’t process corn

3rd person 2nd person

Monica-Laura Haurilet Naming TV Characters by Watching and Analyzing Dialogs

slide-8
SLIDE 8

Evaluation

Surname Lastname - Presentation Title

Series % correct ρ +tracks Positive BBT+ 96.0 0.23 Buffy+ 89.5 0.24 Lost+ 84.8 0.32 Negative BBT- 46.5 0.11 Buffy- 44.4 0.12 Lost- 70.9 0.06

Monica-Laura Haurilet Naming TV Characters by Watching and Analyzing Dialogs

Series AP BBT 98 Buffy 83 Lost 76

slide-9
SLIDE 9

Naming TV Characters by Watching and Analyzing Dialogs

Monica-Laura Haurilet, Makarand Tapaswi, Ziad Al-Halah, Rainer Stiefelhagen Karlsruhe Institute of Technology, Germany haurilet@kit.edu

Penny is a little messy. I am Dracula What do you want, Sawyer?