Analysis by Synthesis of Speech Prosody: from Data to Models.
Daniel Hirst
Laboratoire Parole et Langage, CNRS & Université de Provence, Aix en Provence, France
Analysis by Synthesis of Speech Prosody: from Data to Models. - - PowerPoint PPT Presentation
Analysis by Synthesis of Speech Prosody: from Data to Models. Daniel Hirst Laboratoire Parole et Langage, CNRS & Universit de Provence, Aix en Provence, France With the past, present and future collaboration of: Caroline Bouzon
Laboratoire Parole et Langage, CNRS & Université de Provence, Aix en Provence, France
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– Yesterday – Today – Tomorrow
Last week my friend had to go to the doctor’s to have some injections. She is going to the far east for a holiday and needs to have an injection againnst cholera, tyhphoid fever, hepatitis A, polio and tetanus.
QuickTimeᆰ and a decompressor are needed to see this picture.06/03/10 ATILF Nancy Daniel Hirst
– Input
– Storage
– Manipulation
– Output
06/03/10 ATILF Nancy Daniel Hirst
– Input
– Storage
– Manipulation
– Output
06/03/10 ATILF Nancy Daniel Hirst
– Prosody
06/03/10 ATILF Nancy Daniel Hirst
intelligibility naturalness
–
OK. /əʊkeɪ/
–
OK...
–
OK?
–
OK!
–
OK OK!?
–
OK :)
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– He's very hard-working... – Prosody sounds really interesting! – She asked the man who lived there. – Woman without her man is nothing. – Sept cent vingt cinq mille six cent trente neuf
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– timing of phonological unit
06/03/10 ATILF Nancy Daniel Hirst
– autocorrelation (intonation research) – cross-correlation (voice research)
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– more promising – no standard extraction algorithm
06/03/10 ATILF Nancy Daniel Hirst
– time – frequency – intensity
– quantity – tone – stress
06/03/10 ATILF Nancy Daniel Hirst
– taka
– takka
– taakka
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– No lexical quantity
– No lexical tone – No lexical stress
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– English, Russian, Arabic...
– French, Telugu, Yoruba...
– Japanese, Tamil...
06/03/10 ATILF Nancy Daniel Hirst
– for (2 minutes each of)
– no significant difference in variability of
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– Spanish, Greek, Italian
– English, Swedish, Icelandic
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst Scuola Normale Superiore, Pisa 2009 March 13
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst Scuola Normale Superiore, Pisa 2009 March 13
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– Independent variable:
– Dependent variable:
p
06/03/10 ATILF Nancy Daniel Hirst
– Word – Foot – Narrow Rhythm Unit
06/03/10 ATILF Nancy Daniel Hirst
– Syllable – Anacrusis
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
(cf Jassem et al. 1978)
(cf Jassem 1952!)
(cf Jassem 1952!!!)
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
Il faut que je sois à Grenoble, Samedi vers quinze heures
06/03/10 ATILF Nancy Daniel Hirst
1 2
1 5 0 1 5 5 1 6 0 1 6 5 1 7 0 1 7 5 1 8 0 1 8 5 1 9 0 1 9 5 2 0 01 2 3 4 5
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
value minimising sum of squares of diferences from data
value minimising number of cases more than ∆ from data
function minimising sum of squares of diferences from data
function minimising number of cases more than ∆ from data
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
– Fujisaki model (Mixdorff) – ToBI (Maghbouleh, Wightman & Cambell,
– INTSINT
06/03/10 ATILF Nancy Daniel Hirst
– British English, Spanish, European Portuguese,
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
5 0 1 0 0 1 5 0 2 0 0 M T L H L H L H B
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
; French.intsint created on Mon Aug 24 10:25:05 2009 by intsint.pl 2.11 ; from French.momel ; 27 values mean = 297 <parameter range=1.4> <parameter key=309> 0.469 B 190 190 0.989 M 354 309 1.081 H 429 394 1.464 L 252 274 2.014 T 500 502 2.353 L 275 309
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
06/03/10 ATILF Nancy Daniel Hirst
Pre-head Head +Body Nucleus + Tail English US [M [ H L] [ H L ] … [H B]]
English UK [M [ H ] [D ] …
French [M [ S H] [ L H ] … [D B]]
06/03/10 ATILF Nancy Daniel Hirst
TU1
06/03/10 ATILF Nancy Daniel Hirst
|But she 'didn't 'say she was 'coming 'home on °Saturday +
[But she [didn't] [say she was] [coming] [home on] [Saturday]] [L [H L ] [H L][H L ] [H L ] [H L] H]
[But she [didn't] [say she was] [coming] [home on] [Saturday]] [M [ H ] [ D ] [ D ] [ D ] [ D B] T]
[But she [didn't] [say she was] [coming] [home on] [Saturday]]
[ 127 151 133 120 112 106 90 180 ]
06/03/10 ATILF Nancy Daniel Hirst