Word Reordering in Statistical Machine Translation with a POS-Based - PowerPoint PPT Presentation

Outline Motivation The Model Experiments Conclusion Translation Examples Word Reordering in Statistical Machine Translation with a POS-Based Distortion Model Kay Rottmann (UKA), Stephan Vogel (CMU) September 7, 2007 Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation The Model Experiments Conclusion Translation Examples 1 Motivation Word Order Problem Current Approaches Goals 2 The Model Using POS Information Learning the Rules Application of the Rules Reordering of Training Corpus 3 Experiments Setup Results 4 Conclusion 5 Translation Examples Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Problem of Word Order Different languages differ in word order Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Problem of Word Order Different languages differ in word order Differences within small context Example: ADJ NN → NN ADJ An important agreement Un acuerto importante Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Problem of Word Order Different languages differ in word order Differences within small context Example: ADJ NN → NN ADJ An important agreement Un acuerto importante Long range reorderings Example: auxiliary verb and infinite verb Ich werde morgen nachmittag ... ankommen I will arrive tomorrow afternoon ... Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Current Approaches IBM constraints [BePP96], ITG [Wu96], lexicalised block oriented model [KAMCB + 05] . . . Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Current Approaches IBM constraints [BePP96], ITG [Wu96], lexicalised block oriented model [KAMCB + 05] . . . Reordering of source sentence [ChCF06], [PoNe06], [CrMa06] Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Current Approaches IBM constraints [BePP96], ITG [Wu96], lexicalised block oriented model [KAMCB + 05] . . . Reordering of source sentence [ChCF06], [PoNe06], [CrMa06] Reordering before translation process Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Current Approaches IBM constraints [BePP96], ITG [Wu96], lexicalised block oriented model [KAMCB + 05] . . . Reordering of source sentence [ChCF06], [PoNe06], [CrMa06] Reordering before translation process monotone decoding Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Current Approaches IBM constraints [BePP96], ITG [Wu96], lexicalised block oriented model [KAMCB + 05] . . . Reordering of source sentence [ChCF06], [PoNe06], [CrMa06] Reordering before translation process monotone decoding more than one word order coded in lattice structure Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Current Approaches IBM constraints [BePP96], ITG [Wu96], lexicalised block oriented model [KAMCB + 05] . . . Reordering of source sentence [ChCF06], [PoNe06], [CrMa06] Reordering before translation process monotone decoding more than one word order coded in lattice structure ⇒ our work based on this approach Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Goals Restriction of search to make it fast Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Goals Restriction of search to make it fast Correct reorderings in different contexts Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Word Order Problem The Model Current Approaches Experiments Goals Conclusion Translation Examples Goals Restriction of search to make it fast Correct reorderings in different contexts Better translations of long range reorderings Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples How the System works Reorderings based on rules extracted prior to translation from corpus Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples How the System works Reorderings based on rules extracted prior to translation from corpus Use of POS-Tags for generalization POS-Tagger are available for many languages Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples How the System works Reorderings based on rules extracted prior to translation from corpus Use of POS-Tags for generalization POS-Tagger are available for many languages Assign probabilies to rules as a guide for the decoding process Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples How the System works Reorderings based on rules extracted prior to translation from corpus Use of POS-Tags for generalization POS-Tagger are available for many languages Assign probabilies to rules as a guide for the decoding process Create a lattice with possible reorderings Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples How the System works Reorderings based on rules extracted prior to translation from corpus Use of POS-Tags for generalization POS-Tagger are available for many languages Assign probabilies to rules as a guide for the decoding process Create a lattice with possible reorderings Decoder finds best monotone translation path through the lattice Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples What is a Rule A rule consists of three parts: Left hand side: Sequence of POS on the source side Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples What is a Rule A rule consists of three parts: Left hand side: Sequence of POS on the source side Right hand side: Permutation on that word order Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based

Outline Motivation Using POS Information The Model Learning the Rules Experiments Application of the Rules Conclusion Reordering of Training Corpus Translation Examples What is a Rule A rule consists of three parts: Left hand side: Sequence of POS on the source side Right hand side: Permutation on that word order Score for the rule: Relative frequency Kay Rottmann (UKA), Stephan Vogel (CMU) Word Reordering in Statistical Machine Translation with a POS-Based