Translating Unknown Words by Analogical Learning Philippe Langlais - - PowerPoint PPT Presentation

translating unknown words by analogical learning
SMART_READER_LITE
LIVE PREVIEW

Translating Unknown Words by Analogical Learning Philippe Langlais - - PowerPoint PPT Presentation

Motivations Analogical Learning Experiments Discussion Translating Unknown Words by Analogical Learning Philippe Langlais and Alexandre Patry Dept. I.R.O. Universit e de Montr eal, Qu ebec, Canada { felipe,patryale }


slide-1
SLIDE 1

Motivations Analogical Learning Experiments Discussion

Translating Unknown Words by Analogical Learning

Philippe Langlais and Alexandre Patry

  • Dept. I.R.O.

Universit´ e de Montr´ eal, Qu´ ebec, Canada {felipe,patryale}@iro.umontreal.ca

EMNLP-CoNLL 2007, Prague, June 30th, 2007

slide-2
SLIDE 2

Motivations Analogical Learning Experiments Discussion

The Problem we Address

Translating unknown words

L, seed lexicon lucide ↔ clear-thinking, blind, refocussed, lucid, far-sighted lucidit´ e ↔ well-informed,meti- culously, moderation, penetrating lucidity, clear-headed, clear-sighted futile ↔ meaningless, futile

futilit´ e ?

faillites ↔ bankruptcies, ban- kruptcy faillite ↔ collapse, bust, insol- vency, ruin, complaining, wall, business, bankruptcy, bankrupt

slide-3
SLIDE 3

Motivations Analogical Learning Experiments Discussion

Existing Solutions to Translating Unknown Entities

  • Translating proper-names [Chen et al., 1998] and

named-entities [Al-Onaizan and Knight, 2001] ֒ → analog is complementary to those approaches

  • Paraphrasing unknown entities by making use of massive

homogeneous bitexts [Callisson-Burch et al., 2006 ; Cohn and Lapata, 2007] ֒ → analog requires only a seed lexicon (+ target- language lexicon)

  • Identifying translations in comparable corpora [Fung

and Yee, 1998 ; Rapp,1999 ; Tanaka, 1999] ֒ → analog requires only a seed lexicon (+ target- language lexicon)

slide-4
SLIDE 4

Motivations Analogical Learning Experiments Discussion

Other (more) Popular Solutions to Translating Unknown Words

  • Removing unknown (source) words before

translating

  • Leaving unknown-words untranslated

Our approach : Translating unknown-words by analogy

slide-5
SLIDE 5

Motivations Analogical Learning Experiments Discussion

Overview

Motivations Analogical Learning Introduction Principle Bilingual Lexicon Enrichment Practical Issues Experiments Protocol Results Discussion

slide-6
SLIDE 6

Motivations Analogical Learning Experiments Discussion

Proportional Analogy

[A : B = C : D] “A is to B as C is to D”

(See for instance [Chiu et al., 2007])

slide-7
SLIDE 7

Motivations Analogical Learning Experiments Discussion

Formal Analogies

Examples taken from (Lepage, 1998)

  • Formal analogical proportions :

honor : hon¯

  • rem

= ¯

ator : ¯

at¯

  • rem

reader : unreadable = doer : undoable r´ epression : r´ epressionnaire = r´ eaction : r´ eactionnaire tinggal : ketinggalan = duduk : kedudukan

  • Formal analogical equation :

[lang : l¨ angste = scharf : ?]

slide-8
SLIDE 8

Motivations Analogical Learning Experiments Discussion

Formal Analogies

Examples taken from (Lepage, 1998)

  • Formal analogical proportions :

honor : hon¯

  • rem

= ¯

ator : ¯

at¯

  • rem

reader : unreadable = doer : undoable r´ epression : r´ epressionnaire = r´ eaction : r´ eactionnaire tinggal : ketinggalan = duduk : kedudukan

  • Formal analogical equation :

[lang : l¨ angste = scharf : sch¨ arfste]

slide-9
SLIDE 9

Motivations Analogical Learning Experiments Discussion

Principle

Stroppa & Yvon, 2005

L : training corpus I : input space (defined by a set of features over L) O : output space (defined by a set of features over L) X : incomplete observation (the input features are known)

  • 1. Build EI(X) :

{(A, B, C) ∈ L3 | [I(A) : I(B) = I(C) : I(X)]}

  • 2. Build EO(X) :

{Y | [O(A) : O(B) = O(C) : Y ] , ∀(A, B, C) ∈ EI(X)}

  • 3. Choose O(X) among EO(X).

where I(X) and O(X) stand for the projection of X into the input and output space respectively.

slide-10
SLIDE 10

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

futilit´ e ?

slide-11
SLIDE 11

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

faillites faillite futilit´ e ? futilit´ es [faillites : faillite = futilit´ es : futilit´ e]

slide-12
SLIDE 12

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

faillites futile faillite futilit´ e ? futilit´ es lucide lucidit´ e [lucide : lucidit´ e = futile : futilit´ e]

slide-13
SLIDE 13

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

faillites futile faillite hostilit´ es futilit´ e ? hostiles futilit´ es lucide lucidit´ e [hostiles : hostilit´ es = futile : futilit´ e]

slide-14
SLIDE 14

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

faillites futile r´ ealit´ es r´ ealit´ e faillite hostilit´ es futilit´ es futilit´ e ? hostiles futilit´ es lucide lucidit´ e [r´ ealit´ es : r´ ealit´ e = futilit´ es : futilit´ e]

slide-15
SLIDE 15

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

faillites brutale futile r´ ealit´ es brutalit´ e r´ ealit´ e mutil´ e faillite bestialit´ e hostilit´ es futilit´ es futilit´ e ? natalit´ e facile facilit´ es hostiles futilit´ es bestiale timide natale lucide faillite maille timidit´ e lucidit´ e 2944 analogical equations, 84 valid stems

slide-16
SLIDE 16

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-1 : computing EI(futilit´ e)

activit´ es, activit´ e, futilit´ es fatale, futile, fatalit´ e timide, timidit´ e, futile faciles, facilit´ es, futile cupide, cupidit´ e, futile utilis´ es, futilit´ es, utilis´ e humide, humidit´ e, futile brutalit´ es, brutalit´ e, futilit´ es multipli´ es, multipli´ e, futilit´ es qualit´ es, qualit´ e, futilit´ es totale, totalit´ e, futile utilis´ es, utilis´ e, futilit´ es mutil´ es, mutil´ e, futilit´ es f´ elicit´ es, futilit´ es, f´ elicit´ e active, activit´ e, futile mature, maturit´ e, futile unit´ es, futilit´ es, unit´ e habilit´ es, habilit´ e, futilit´ es fragile, fragilit´ e, futile subtile, subtilit´ e, futile mutil´ es, futilit´ es, mutil´ e autorit´ es, autorit´ e, futilit´ es vitale, vitalit´ e, futile autoris´ es, autoris´ e, futilit´ es maille, faillite, mutil´ e mute, mutil´ e, futile facult´ es, facult´ e, futilit´ es f´ elicit´ es, f´ elicit´ e, futilit´ es utile, futile, utilit´ e facilit´ es, facilit´ e, futilit´ es rurale, ruralit´ e, futile brutalit´ es, futilit´ es, brutalit´ e finales, finalit´ es, futile subtiles, subtilit´ es, futile spatiale, spatialit´ e, futile visit´ es, visit´ e, futilit´ es r´ ealit´ es, r´ ealit´ e, futilit´ es p´ enale, p´ enalit´ e, futile brutales, brutalit´ es, futile habilit´ es, futilit´ es, habilit´ e hostilit´ es, futilit´ es, hostilit´ e (+ 42 others . . . )

slide-17
SLIDE 17

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-2 : computing EO(futilit´ e)

[faillites : faillite = futilit´ es : futilit´ e] faillites ↔ bankruptcies, bankruptcy faillite ↔ collapse, bust, insolvency, ruin, complaining, bankrupt, business, bankruptcy, wall futilit´ es ↔ trivialities [bankruptcies : bankruptcy = trivialities : ?] { triviality }

slide-18
SLIDE 18

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-2 : computing EO(futilit´ e)

[lucide : lucidit´ e = futile : futilit´ e] lucide ↔ clear-thinking, blind, refocussed, lucid, far- sighted lucidit´ e ↔ well-informed, meticulously, moderation, pene- trating, lucidity, clear-headed, clear-sighted futilit´ e ↔ meaningless, futile [lucid : lucidity = meaningless : ?] { meaninglessity } [lucid : lucidity = futile : ?] { futiityle, futileity, futilitye } [far-sighted : clear-sighted = futile : ?] { fucleile, cleutile, clefuile, cluteile, culetile, cluetile, cfuleile, clfueile, cutleile }

slide-19
SLIDE 19

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-3 : choosing from EO(futilit´ e)

1124 = forms generated, 120 seen at least twice (trivialities,27) (meaninglitiesss,3) (meaniitnglyss,2) (triviality,14) (meaningiltyss,2) (superfluous,2) (futile,9) (futiilty,2) (meaningitilesss,2) (futilitye,9) (applicatitrivialitis,2) (meaningitlyss,2) (meaningless,9) (futiitiles,2) (meaninglesity,2) (meaninglityess,8) (futiitly,2) (meaninglessity,2) (trivialitie,6) (futiityl,2) (meaninglityes,2) (futility,4) (futileity,2) (meaninigltyss,2) (meaninglityss,4) (futilessne,2) (meaninitglyss,2) (futilities,3) (high-triviality,2) (meaninitiglesss,2) (meaninglesit,3) (ltbbyirivialitig,2) (mfaninglecilits,2) . . .

slide-20
SLIDE 20

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-3 : choosing from EO(futilit´ e)

1124 = forms generated, 120 seen at least twice (trivialities,27) (meaninglitiesss,3) (meaniitnglyss,2) (triviality,14) (meaningiltyss,2) (superfluous,2) (futile,9) (futiilty,2) (meaningitilesss,2) (futilitye,9) (applicatitrivialitis,2) (meaningitlyss,2) (meaningless,9) (futiitiles,2) (meaninglesity,2) (meaninglityess,8) (futiitly,2) (meaninglessity,2) (trivialitie,6) (futiityl,2) (meaninglityes,2) (futility,4) (futileity,2) (meaninigltyss,2) (meaninglityss,4) (futilessne,2) (meaninitglyss,2) (futilities,3) (high-triviality,2) (meaninitiglesss,2) (meaninglesit,3) (ltbbyirivialitig,2) (mfaninglecilits,2) . . .

slide-21
SLIDE 21

Motivations Analogical Learning Experiments Discussion

Bilingual Lexicon Enrichment

Step-3 : choosing from EO(futilit´ e)

13 solutions kept (trivialities,27) (triviality,14) (futile,9) (meaningless,9) (futility,4) (meaninglessness,3) (superfluous,2) (unwieldy,2) (unnecessary,2) (uselessness,2) (trivially,1) (tie,1) (trivial,1)

slide-22
SLIDE 22

Motivations Analogical Learning Experiments Discussion

Analogical Equation Solver

[Lepage, 1998] [Stroppa & Yvon, 2005]

  • We implemented the algorithm of [Lepage, 1998]
slide-23
SLIDE 23

Motivations Analogical Learning Experiments Discussion

Practical Issues

  • Computing

EI(unk) = {(A, B, C) ∈ I3/[A : B = C : unk]} is an

  • peration cubic in |I|.

֒ → generative search : A,B ∈ I2 and C ∈ [B : A = unk : ⋄] ֒ → heuristic : A ∈ vδ(unk) et B ∈ vβ(A) with : vγ(X) = {Y | d(X, Y ) ≤ γ}

  • The number of lowest-cost paths is potentially

exponential in the length of the sequences to align

֒ → synchronize at most M2 paths (M=20)

  • Analogical solver “imperfect”

֒ → filter with a target lexicon V of 466 439 entries

slide-24
SLIDE 24

Motivations Analogical Learning Experiments Discussion

Motivations Analogical Learning Introduction Principle Bilingual Lexicon Enrichment Practical Issues Experiments Protocol Results Discussion

slide-25
SLIDE 25

Motivations Analogical Learning Experiments Discussion

Resources from WMT’06

[Koehn et Monz, 2006]

unk-words in the test set (French → English) :

  • 20% of proper names
  • 12% of numerical expressions (years, page

numbers, etc.)

  • 8% of compound-words
  • 4% of borrowed-word (latin, greek)

∼ 54% of ordinary words

slide-26
SLIDE 26

Motivations Analogical Learning Experiments Discussion

Protocol

  • LT : seed lexicon

IBM model 2 (s2t ∩ t2s models), trained on the T first pairs of sentences of train.

֒ → T : 5 000, 10 000, 100 000, 200 000, and 500 000

  • Lref : reference lexicon

IBM model 2 (s2t ∩ t2s models), trained on train.

  • Translate with analog non-numerical words of test,

present in Lref , but unknown of LT

  • Two measurements :

recall % of words with at least one translation (good or not) precision % of words translated for which at least one translation is sanctioned by Lref ! !unusual ! !

slide-27
SLIDE 27

Motivations Analogical Learning Experiments Discussion

Baseline approaches

X ≡ unknown word base1 ˆ T = argminT∈O edit-dist(T, X) signalaient → signalling, signalled, salient, . . . base2 ˆ T = argmaxS∈V (X) projL(S) o` u V (X) = argminS∈I edit-dist(X, S) signalaient → signalement, signeraient, signalent, . . . → indicates, sign, signalling, . . .

slide-28
SLIDE 28

Motivations Analogical Learning Experiments Discussion

Recall rates (French→English)

slide-29
SLIDE 29

Motivations Analogical Learning Experiments Discussion

Precision rates (French→English)

slide-30
SLIDE 30

Motivations Analogical Learning Experiments Discussion

Case of T = 500 000 (French→English)

in-domain

  • Only a few words seen in Lref , but not in L500 000
  • 34 words (in-domain), 1.2 translations sanctioned by

Lref

  • ∼ 1/3 of the reference translations are wrong
  • Ex : perquisitions :

a (seizures,76) (seizure,17) (raid,1) Lref house-to-house

  • Ex : non-discriminatoire :

a (non-discriminatory,72) (non-discrimination,47) (nondiscrimination,24) (nondiscriminatory,23) (out- lawing,20) (race,20) (prosperity,20) (antidiscrimina- tion,20) (anti-discrimination,18) (discrimination,17) Lref affirmative

slide-31
SLIDE 31

Motivations Analogical Learning Experiments Discussion

Manual Evaluation

contournant (49 candidates) a ⋄ (circumventing,55) (undermining,20) (evading,19) (circumvented,17) (overturning,16) (circumvent,15) (cir- cumvention,15) (bypass,13) (evade,13) (skirt,12) . . . Lref ⋄ skirting, bypassing, by-pass, overcoming

  • 80% of ordinary words receive a valid translation in

first-position by analog

  • Only 35% in the case of b2
slide-32
SLIDE 32

Motivations Analogical Learning Experiments Discussion

Impact on translation (into English)

  • Extension of the phrase table with the first translation

produced for each unknown word by analog (seed lexicon = Lref ) French Spanish German wer bleu wer bleu wer bleu base 61.8 22.74 54.0 27.00 69.9 18.15 +a 61.6 22.90 53.7 27.27 69.7 18.30 sentences 387 452 814 ֒ → consistent but non-significant gains with analog

slide-33
SLIDE 33

Motivations Analogical Learning Experiments Discussion

Translating phrases

French → English

expulsent ⋄ (expelling,36) (expel,31) (are expelling,23) (are expel,10) focaliserai ⋄ (focus,10) (focus solely,9) (concentrate all,9) (will focus,9) (will placing,9) d´ epasseront ⋄ (will exceed,4) (exceed,3) (will be ex- ceed,3) (we go beyond,2) (will be exceeding,2) non-r´ eussite de ⋄ (lack of success for,4) (lack of success

  • f,4) (lack of success,4)

que vous subissez ⋄ (you are experiencing,2)

  • Lref , LT : phrase tables
  • Precision : 55%
  • Low recall : 10% (too much filtering during step-1)
slide-34
SLIDE 34

Motivations Analogical Learning Experiments Discussion

Motivations Analogical Learning Introduction Principle Bilingual Lexicon Enrichment Practical Issues Experiments Protocol Results Discussion

slide-35
SLIDE 35

Motivations Analogical Learning Experiments Discussion

Conclusion

  • Analogical learning allows to translate

correctly ∼ 80% of ordinary unknown-words (French→English)

  • Performance higher than fair baselines
  • No knowledge required or external

resources

  • Performance ∼ stable over language pairs
  • Not contrived to translate only words
slide-36
SLIDE 36

Motivations Analogical Learning Experiments Discussion

Future Work

  • Testing the systematic enrichment of a statistical

phrase-table (unknown and unfrequent words or phrases)

  • Weighting analogies (currently all analogies are

considered equally good)

  • Comparing analog to other approaches exploiting

morphology-related information in SMT [Nießen, 2002 ; Popovi´ c and Ney, 2004, Goldwater and McClosky, 2005 ; Lee, 2004, Sadat and Habash, 2006]

  • Comparing analog to unsupervised

morphology-acquisition techniques [GoldSmith, 2001 ; Baldwin, 2005 ; Freitag 2005]

slide-37
SLIDE 37

Motivations Analogical Learning Experiments Discussion

[do : you = have : ?]

slide-38
SLIDE 38

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

Property (Stroppa and Yvon, 2005) [x : y = z : t] ⇐ ⇒ t ∈ (y • z) \ x usual • unevenly = S = {unusevualenly, uneusveunlaly,. . . } S \ even = {unusually, unusulaly, . . . } [Lepage, 1998] 15 solutions [Stroppa & Yvon, 2005] 72 solutions

           uunsually usuaunlly usuunalyl unusually usunually uunslyual unulysual uunsualyl unuslyual unusualyl usunualyl uunsulyal unusulyal usunulyal usuunally           

slide-39
SLIDE 39

Motivations Analogical Learning Experiments Discussion

Manual Evaluation of 142 words

freq < 4, L200 000, (French→English)

analog Good Wrong Silent IBM Good 59 2 22 83 Wrong 41 3 15 59 100 5 37 142

  • ∼ 42% of the words receive a wrong associations by IBM

model 2 (∼ 4% with analog)

  • ∼ 70% of these wrongly translated words receive by

analog a valid translation

slide-40
SLIDE 40

Motivations Analogical Learning Experiments Discussion

Performances among language pairs

in-domain

French Spanish German T p% r% p% r% p% r% 5 51.4 30.7 52.8 30.3 49.3 23.1 10 55.3 44.4 52.0 45.2 47.6 33.3 50 58.8 64.3 54.0 66.5 44.6 53.2 100 58.2 65.1 53.9 69.1 45.8 55.6 200 59.4 65.2 46.4 71.8 43.0 59.2

  • ∼ 10% decrease for German→English
  • decrease in precision for T =200 000 in Spanish and

German

slide-41
SLIDE 41

Motivations Analogical Learning Experiments Discussion

Resources

  • WMT’06 [Koehn et Monz, 2006] : French, Spanish,

German ↔ English French Spanish German |sent|train 688 031 730 740 751 088 |voc|train 80 343 100 435 186 231 test- in

  • ut

in

  • ut

in

  • ut

|sent|test 2 000 1 064 2 000 1 064 2 000 1 064 |voc|test 7 230 5 263 7 719 5 322 8 812 6 067 |unknown| 180 265 233 292 469 599

  • ov%

0.26 1.22 0.38 1.37 0.84 2.87

slide-42
SLIDE 42

Motivations Analogical Learning Experiments Discussion

[x : y = z : t]

Propri´ et´ e (Stroppa et Yvon, 2005) [x : y = z : t] ⇐ ⇒ t ∈ (y • z) \ x Calculable par composition de deux transducteurs : shuffle a • b composition de sous-s´ equences de a et b en respectant l’ordre des symboles dans chaque s´ equence compl´ ementaire a \ b retrait dans a des symboles de b, de la gauche vers la droite

slide-43
SLIDE 43

Motivations Analogical Learning Experiments Discussion

[´ editeur : ´ edition = dicteur : ?]

0, 0 0, 1 0, 2 0, 3 0, 4 0, 5 0, 6 0, 7 1, 0 1, 1 1, 2 1, 3 1, 4 1, 5 1, 6 1, 7 2, 0 2, 1 2, 2 2, 3 2, 4 2, 5 2, 6 2, 7 3, 0 3, 1 3, 2 3, 3 3, 4 3, 5 3, 6 3, 7 4, 0 4, 1 4, 2 4, 3 4, 4 4, 5 4, 6 4, 7 5, 0 5, 1 5, 2 5, 3 5, 4 5, 5 5, 6 5, 7 6, 0 6, 1 6, 2 6, 3 6, 4 6, 5 6, 6 6, 7 7, 0 7, 1 7, 2 7, 3 7, 4 7, 5 7, 6 7, 7 ´ e d d d i d t d i d

  • d

n d ´ e i d i i i t i i i

  • i

n i ´ e c d c i c t c i c

  • c

n c ´ e t d t i t t t i t

  • t

n t ´ e e d e i e t e i e

  • e

n e ´ e u d u i u t u i u

  • u

n u ´ e r d r i r t r i r

  • r

n r ´ e d i t i

  • n

d i c t e u r

slide-44
SLIDE 44

Motivations Analogical Learning Experiments Discussion

[´ editeur : ´ edition = dicteur : ?]

0, 0 0, 1 0, 2 0, 3 0, 4 0, 5 0, 6 0, 7 1, 0 1, 1 1, 2 1, 3 1, 4 1, 5 1, 6 1, 7 2, 0 2, 1 2, 2 2, 3 2, 4 2, 5 2, 6 2, 7 3, 0 3, 1 3, 2 3, 3 3, 4 3, 5 3, 6 3, 7 4, 0 4, 1 4, 2 4, 3 4, 4 4, 5 4, 6 4, 7 5, 0 5, 1 5, 2 5, 3 5, 4 5, 5 5, 6 5, 7 6, 0 6, 1 6, 2 6, 3 6, 4 6, 5 6, 6 6, 7 7, 0 7, 1 7, 2 7, 3 7, 4 7, 5 7, 6 7, 7 ´ e d d d i d t d i d

  • d

n d ´ e i d i i i t i i i

  • i

n i ´ e c d c i c t c i c

  • c

n c ´ e t d t i t t t i t

  • t

n t ´ e e d e i e t e i e

  • e

n e ´ e u d u i u t u i u

  • u

n u ´ e r d r i r t r i r

  • r

n r ´ e d i t i

  • n

d i c t e u r

slide-45
SLIDE 45

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

0, 0 0, 1 0, 2 0, 3 1, 3 2, 3 3, 3 3, 4 3, 5 4, 5 5, 5 5, 6 5, 7 6, 7 7, 7 1 2 3 4 5 6 7 ´ e d i d i c t i t e

  • n

u r ´ e d i t e u r

slide-46
SLIDE 46

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

1 2 3 4 5 6 7 8 9 10 11 12 13 14 1 2 3 4 5 6 7 ´ e d i d i c t i t e

  • n

u r ´ e d i t e u r

slide-47
SLIDE 47

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

1 2 3 4 5 6 7 8 9 10 11 12 13 14 1 2 3 4 5 6 7 ´ e :ǫ ǫ :´ e ǫ :ǫ d :ǫ ǫ :d ǫ :ǫ i :ǫ ǫ :i ǫ :ǫ d :ǫ ǫ :d ǫ :ǫ i :ǫ ǫ :i ǫ :ǫ c :ǫ ǫ :c ǫ :ǫ t :ǫ ǫ :t ǫ :ǫ i :ǫ ǫ :i ǫ :ǫ t :ǫ ǫ :t ǫ :ǫ e :ǫ ǫ :e ǫ :ǫ

ǫ :o ǫ :ǫ n :ǫ ǫ :n ǫ :ǫ u :ǫ ǫ :u ǫ :ǫ r :ǫ ǫ :r ǫ :ǫ ǫ :ǫ ´ e :´ e ǫ :ǫ d :d ǫ :ǫ i :i ǫ :ǫ t :t ǫ :ǫ e :e ǫ :ǫ u :u ǫ :ǫ r :r ǫ :ǫ ǫ :ǫ

slide-48
SLIDE 48

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

0, 0 1, 1 2, 2 3, 3 3, 4 3, 5 3, 6 4, 7 3, 7 3, 8 4, 8 4, 9 2, 7 2, 6 2, 5 2, 4 2, 3 1, 3 1, 2 5, 10 5, 11 5, 12 6, 13 7, 14 ´ e :ǫ d :ǫ ǫ :d i :ǫ ǫ :i ǫ :d ǫ :i d :ǫ ǫ :i i :ǫ ǫ :c ǫ :t i :ǫ ǫ :d ǫ :i ǫ :c t :ǫ ǫ :t ǫ :i ǫ :t ǫ :i t :ǫ e :ǫ ǫ :o ǫ :n u :ǫ r :ǫ

slide-49
SLIDE 49

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

0, 0 1, 1 2, 2 3, 3 3, 4 3, 5 3, 6 4, 7 3, 7 3, 8 4, 8 4, 9 2, 7 2, 6 2, 5 2, 4 2, 3 1, 3 1, 2 5, 10 5, 11 5, 12 6, 13 7, 14 ´ e :ǫ d :ǫ ǫ :d i :ǫ ǫ :i ǫ :d ǫ :i d :ǫ ǫ :i i :ǫ ǫ :c ǫ :t i :ǫ ǫ :d ǫ :i ǫ :c t :ǫ ǫ :t ǫ :i ǫ :t ǫ :i t :ǫ e :ǫ ǫ :o ǫ :n u :ǫ r :ǫ

idction

slide-50
SLIDE 50

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

0, 0 1, 1 2, 2 3, 3 3, 4 3, 5 3, 6 4, 7 3, 7 3, 8 4, 8 4, 9 2, 7 2, 6 2, 5 2, 4 2, 3 1, 3 1, 2 5, 10 5, 11 5, 12 6, 13 7, 14 ´ e :ǫ d :ǫ ǫ :d i :ǫ ǫ :i ǫ :d ǫ :i d :ǫ ǫ :i i :ǫ ǫ :c ǫ :t i :ǫ ǫ :d ǫ :i ǫ :c t :ǫ ǫ :t ǫ :i ǫ :t ǫ :i t :ǫ e :ǫ ǫ :o ǫ :n u :ǫ r :ǫ

idction , diction

slide-51
SLIDE 51

Motivations Analogical Learning Experiments Discussion

´ edition • dicteur \ ´ editeur

0, 0 1, 1 2, 2 3, 3 3, 4 3, 5 3, 6 4, 7 3, 7 3, 8 4, 8 4, 9 2, 7 2, 6 2, 5 2, 4 2, 3 1, 3 1, 2 5, 10 5, 11 5, 12 6, 13 7, 14 ´ e :ǫ d :ǫ ǫ :d i :ǫ ǫ :i ǫ :d ǫ :i d :ǫ ǫ :i i :ǫ ǫ :c ǫ :t i :ǫ ǫ :d ǫ :i ǫ :c t :ǫ ǫ :t ǫ :i ǫ :t ǫ :i t :ǫ e :ǫ ǫ :o ǫ :n u :ǫ r :ǫ

idction , diction , idiction, diicton, diciton

slide-52
SLIDE 52

Motivations Analogical Learning Experiments Discussion

[´ editeur : ´ edition = dicteur : diction]

110 sol. f (diction) = 5180, f (ditcion) = 1155, . . . , f (tiondic) = 1 diction ditcion dcition diticon diciton diicton diitcon idction ditiocn diciotn cdition dticion dtiicon diicotn diioctn icdtion dctiion idtcion idticon itdicon ditionc diciont diitocn idciton dciiton dtiiocn idicton iditcon diicont diiocnt diionct ditoicn idtiocn itdcion tdicion dtioicn itdiocn tdiicon dioictn icditon dciiotn cdtiion ctdiion ictdion idciotn itidcon tidicon diitonc dtiionc idicotn idioctn cdiiton iditocn itdoicn itidocn tdiiocn idtionc dioicnt dioinct dionict ditoinc ditonic itdionc dciiont dtioinc dtionic idciont idtoicn itiodcn itodicn tdioicn tidiocn tidoicn tiodicn cdiiotn icdiotn idoictn iodictn idicont idiocnt idionct itidonc iditonc itdoinc itdonic itiodnc tdiionc cdiiont icdiont idoicnt idoinct idonict idtoinc idtonic iodicnt iodinct iodnict iondict itiondc itodinc itodnic itondic tdioinc tdionic tidionc tidoinc tidonic tiodinc tiodnic tiondic

slide-53
SLIDE 53

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n⊳ 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A l a u s u B C u n e v e n l y △ △ n,l,y, [sub,del], move C + copy y e v e n e v e n u s u a l u n e v e n l y △ △

slide-54
SLIDE 54

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n⊳ 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A l a u s u B C u n e v e n l y △ △ n,l,l, [sub,del], move C + copy l e v e n e v e n u s u a l u n e v e n l y △ △

y

slide-55
SLIDE 55

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n⊳ 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A l a u s u B C u n e v e n l y △ △ n,l,n, [sub,<=>], move A,B,C + copy l e v e n e v e n u s u a l u n e v e n l y △ △

ly

slide-56
SLIDE 56

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e⊳ 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A l a u s u B C u n e v e n l y △ △ e,a,e, [ins,<=>], move B,C e v e n e v e n u s u a l u n e v e n l y △ △

lly

slide-57
SLIDE 57

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v⊳ 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A l a u s u B C u n e v e n l y △ △ v,a,v, [ins,<=>], move B,C e v e n e v e n u s u a l u n e v e n l y △ △

lly

slide-58
SLIDE 58

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e⊳ 1 1 1 A l a u s u B C u n e v e n l y △ △ e,a,e, [ins,<=>], move B,C e v e n e v e n u s u a l u n e v e n l y △ △

lly

slide-59
SLIDE 59

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,a,n, [del,del], move C + copy n e v e n e v e n u s u a l u n e v e n l y △ △

lly

slide-60
SLIDE 60

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,a,u, [del,del], move C + copy u e v e n e v e n u s u a l u n e v e n l y △ △

nlly

slide-61
SLIDE 61

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,a,ǫ, [del,•], move B + copy a e v e n e v e n u s u a l u n e v e n l y △ △

unlly

slide-62
SLIDE 62

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,u,ǫ, [del,•], move B + copy u e v e n e v e n u s u a l u n e v e n l y △ △

aunlly

slide-63
SLIDE 63

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,s,ǫ, [del,•], move B +copy s e v e n e v e n u s u a l u n e v e n l y △ △

uaunlly

slide-64
SLIDE 64

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,u,ǫ, [del,•], move B + copy u e v e n e v e n u s u a l u n e v e n l y △ △

suaunlly

slide-65
SLIDE 65

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ ǫ,ǫ,ǫ, [•,•], stop e v e n e v e n u s u a l u n e v e n l y △ △

usuaunlly

slide-66
SLIDE 66

Motivations Analogical Learning Experiments Discussion

[even : usual : : unevenly : ?]

4 4 4 4 4 4 n 4 4 3 3 2 1 3 3 3 3 3 3 e 3 3 3 2 1 2 2 2 2 2 2 v 2 2 2 1 1 1 1 1 1 1 e 1 1 1 A⊳ l a u s u B C u n e v e n l y △ △ e v e n e v e n u s u a l u n e v e n l y △ △

unusually

slide-67
SLIDE 67

Motivations Analogical Learning Experiments Discussion

[even : usual = unevenly : ⋄]

15 solutions (681 synchronisations) :            uunsually usuaunlly usuunalyl unusually usunually uunslyual unulysual uunsualyl unuslyual unusualyl usunualyl uunsulyal unusulyal usunulyal usuunally            72 solutions avec la m´ ethode de [Stroppa et Yvon, 2005]