non projective dependency based pre reordering with
play

Non-projective Dependency-based Pre-Reordering with Recurrent Neural - PowerPoint PPT Presentation

Jul 21, 2023 •753 likes •1.57k views

Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Non-projective Dependency-based Pre-Reordering with Recurrent Neural Network for Machine Translation Antonio Valerio Miceli Barone Giuseppe

  1. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Non-projective Dependency-based Pre-Reordering with Recurrent Neural Network for Machine Translation Antonio Valerio Miceli Barone Giuseppe Attardi University of Pisa, Italy Jun 4, 2015 Antonio Valerio Miceli Barone , Giuseppe Attardi 1 / 15

  2. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering for statistical machine translation Phrase-based machine translation quality is a ff ected by the amount of reordering between languages [Birch et al. 2009] Antonio Valerio Miceli Barone , Giuseppe Attardi 2 / 15

  3. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering for statistical machine translation Phrase-based machine translation quality is a ff ected by the amount of reordering between languages [Birch et al. 2009] Pre-reordering source sentences improves quality Antonio Valerio Miceli Barone , Giuseppe Attardi 2 / 15

  4. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering for statistical machine translation Phrase-based machine translation quality is a ff ected by the amount of reordering between languages [Birch et al. 2009] Pre-reordering source sentences improves quality die Katze hat die Frau gekauft . the woman has bought the cat . Antonio Valerio Miceli Barone , Giuseppe Attardi 2 / 15

  5. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering for statistical machine translation Phrase-based machine translation quality is a ff ected by the amount of reordering between languages [Birch et al. 2009] Pre-reordering source sentences improves quality die Katze hat die Frau gekauft . die Frau hat gekauft die Katze . the woman has bought the cat . Antonio Valerio Miceli Barone , Giuseppe Attardi 2 / 15

  6. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering approaches Syntax-based hand-coded rules [Collins et al. 2005, ...] � High quality improvement � Require extensive language-specific linguistic expertise Antonio Valerio Miceli Barone , Giuseppe Attardi 3 / 15

  7. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering approaches Syntax-based hand-coded rules [Collins et al. 2005, ...] � High quality improvement � Require extensive language-specific linguistic expertise Syntax-based statistical [Genzel, 2010, ...] � Trained on word alignments, exploit syntax � Only tree-local swaps, only constituency or projective dependency syntax Antonio Valerio Miceli Barone , Giuseppe Attardi 3 / 15

  8. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Pre-reordering approaches Syntax-based hand-coded rules [Collins et al. 2005, ...] � High quality improvement � Require extensive language-specific linguistic expertise Syntax-based statistical [Genzel, 2010, ...] � Trained on word alignments, exploit syntax � Only tree-local swaps, only constituency or projective dependency syntax Syntax-free statistical [Tromble and Eisner, 2009, ...] � Trained on word alignments � Don’t exploit syntax, only word pair features Antonio Valerio Miceli Barone , Giuseppe Attardi 3 / 15

  9. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example auf diese Weise wird die ra ffi nierte Undurchsichtigkeit geschickt aufrechterhalten ; w¨ ahrend der Euro ” stark und stabil ” sein sollte und die W¨ ahrungsreserven anfangs ahrend des ¨ lediglich zur Verteidigung w¨ Ubergangszeitraums ( falls notwendig ) dienen sollten , erweist sich heute , daßweder die eine noch die andere dieser Behauptungen zutre ff end waren und sich in Frankfurt ¨ uberhaupt nichts tut ! the issue therefore remains skilfully blurred ; while the euro was intended to be ’ strong and stable ’ and the reserve assets were originally intended to provide protection during the transitional period ( should this prove necessary ) , it now appears that neither of these expectations has been fulfilled and Frankfurt is totally deadlocked ! Antonio Valerio Miceli Barone , Giuseppe Attardi 4 / 15

  10. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example auf diese Weise wird die ra ffi nierte Undurchsichtigkeit geschickt aufrechterhalten ; w¨ ahrend der Euro ” stark und stabil ” sein sollte und die W¨ ahrungsreserven anfangs ahrend des ¨ lediglich zur Verteidigung w¨ Ubergangszeitraums ( falls notwendig ) dienen sollten , erweist sich heute , daßweder die eine noch die andere dieser Behauptungen zutre ff end waren und sich in Frankfurt ¨ uberhaupt nichts tut ! die ra ffi nierte geschickt Undurchsichtigkeit aufrechterhalten ; w¨ ahrend der Euro sollte auf sein ” stark und stabil ” und die W¨ ahrungsreserven anfangs lediglich ahrend des ¨ dienen sollten zur Verteidigung w¨ Ubergangszeitraums ( diese Weise wird falls notwendig ) , erweist sich heute , daßweder die eine noch dieser Behauptungen zutre ff end die andere waren und sich in Frankfurt ¨ uberhaupt nichts tut ! the issue therefore remains skilfully blurred ; while the euro was intended to be ’ strong and stable ’ and the reserve assets were originally intended to provide protection during the transitional period ( should this prove necessary ) , it now appears that neither of these expectations has been fulfilled and Frankfurt is totally deadlocked ! Antonio Valerio Miceli Barone , Giuseppe Attardi 4 / 15

  11. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  12. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  13. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  14. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven anfangs Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  15. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven anfangs lediglich Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  16. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven anfangs lediglich dienen Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  17. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven anfangs lediglich dienen sollten Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  18. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven anfangs lediglich dienen sollten zur Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  19. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Example ... die W¨ ahrungsreserven anfangs lediglich zur Verteidigung ... dienen sollten ... ... the reserve assets were originally intended to provide protection ... ... die W¨ ahrungsreserven anfangs lediglich dienen sollten zur Verteidigung ... Antonio Valerio Miceli Barone , Giuseppe Attardi 5 / 15

  20. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Our proposal Arbitrary permutation prediction Antonio Valerio Miceli Barone , Giuseppe Attardi 6 / 15

  21. Motivation Non-projective non-tree-local pre-reordering Reordering automaton GRU-RM Conclusions Our proposal Arbitrary permutation prediction Use syntactical features from a non-projective dependency parse Antonio Valerio Miceli Barone , Giuseppe Attardi 6 / 15

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Source side Dependency Tree Reordering Models with Subtree Movements and Constraints Nguyen

Source side Dependency Tree Reordering Models with Subtree Movements and Constraints Nguyen

Source side Dependency Tree Reordering Models with Subtree Movements and Constraints Nguyen Bach, Qin Gao and Stephan Vogel Carnegie Mellon University 1 Overview We introduce source side dependency tree reordering models Inspired

869 views • 53 slides
Transforming Projective Bilexical Dependency Grammars into efficiently-parsable CFGs with

Transforming Projective Bilexical Dependency Grammars into efficiently-parsable CFGs with

Transforming Projective Bilexical Dependency Grammars into efficiently-parsable CFGs with Unfold-Fold Mark Johnson Microsoft Research Brown University ACL 2007 1 / 22 Motivation and summary Whats the relationship between CKY parsing

752 views • 22 slides
Dependency Grammars Topological Dependency Trees: A Constraint-based Account of Linear

Dependency Grammars Topological Dependency Trees: A Constraint-based Account of Linear

Dependency Grammars Topological Dependency Trees: A Constraint-based Account of Linear Precedence Extensible Dependency Grammar: A New Methodology Sibel Ciddi NPFL106 - Linguistics 2013 Summer Framework Immediate dependency

656 views • 18 slides
Projective Dependency Parsing with Perceptron Xavier Carreras , Mihai Surdeanu, and Llus

Projective Dependency Parsing with Perceptron Xavier Carreras , Mihai Surdeanu, and Llus

Projective Dependency Parsing with Perceptron Xavier Carreras , Mihai Surdeanu, and Llus Mrquez Technical University of Catalonia {carreras,surdeanu,lluism}@lsi.upc.edu 8th June 2006 Outline Introduction Parsing and Learning Parsing

356 views • 22 slides
Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara Stymne and Joakim Nivre @ mdlhx 22 September 2017 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic

1.04k views • 85 slides
Last time 6.891 Computer Vision and Applications Projective SFM Projective spaces Prof.

Last time 6.891 Computer Vision and Applications Projective SFM Projective spaces Prof.

Last time 6.891 Computer Vision and Applications Projective SFM Projective spaces Prof. Trevor. Darrell Cross ratio Factorization algorithm Lecture 11: Model-based vision Hypothesize and test Euclidean upgrade

481 views • 11 slides
Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP

Dependency Parsing & Feature-based Parsing Ling571 Deep Processing Techniques for NLP February 2, 2015 Roadmap Dependency parsing Graph-based dependency parsing Maximum spanning tree CLE Algorithm Learning

899 views • 87 slides
Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized

Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized

Last class Dependency parsing and logistic regression Dependency parsing: a fully lexicalized formalism; tree edges connect words in the Shay Cohen sentence based on head-dependent relationships. (based on slides by Sharon Goldwater) a

359 views • 11 slides
Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma

Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma

Algorithms for NLP CS 11-711 Fall 2020 Lecture 14: Graph-based dependency parsing Emma Strubell Announcements No recitation on Friday (Tartan Community Day). 2 Dependency parsing 3 Dependency parsing Input buffer Transition-based

1.15k views • 77 slides
Advanced Dependency Parsing Joakim Nivre Uppsala University Linguistics and Philology Based on

Advanced Dependency Parsing Joakim Nivre Uppsala University Linguistics and Philology Based on

Advanced Dependency Parsing Joakim Nivre Uppsala University Linguistics and Philology Based on tutorials with Ryan McDonald Advanced Dependency Parsing 1(36) Introduction Plan for the Lecture 1. Graph-based vs. transition-based dependency

1.61k views • 109 slides
Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a

Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a

GRAPH-BASED DEPENDENCY PARSING Marina Valeeva Outline 2 1. Introduction What is Dependency Parsing? What is a Dependency Tree? Projectivity vs. Non-Projectivity 2. Graph-Based Dependency Parsing 3. Models Edge Based Factorization

572 views • 40 slides
1 last time reordering: processors and compilers avoiding reordering: special instructions,

1 last time reordering: processors and compilers avoiding reordering: special instructions,

1 last time reordering: processors and compilers avoiding reordering: special instructions, compiler directives memory fence idea: everything before fence, then everything after cache coherency (keeping caches in sync) baseline idea:

1.52k views • 116 slides
Dynamically shaping the reordering search space of phrase-based SMT Arianna Bisazza &

Dynamically shaping the reordering search space of phrase-based SMT Arianna Bisazza &

Dynamically shaping the reordering search space of phrase-based SMT Arianna Bisazza & Marcello Federico Phrase-based SMT No sentence structure, can only model local dependencies Wrt

644 views • 43 slides
Linguistically Motivated Reordering Modeling for Phrase-Based Statistical Machine Translation

Linguistically Motivated Reordering Modeling for Phrase-Based Statistical Machine Translation

PhD Thesis: Linguistically Motivated Reordering Modeling for Phrase-Based Statistical Machine Translation Arianna Bisazza Advisor: Marcello Federico Fondazione Bruno Kessler / Universit di Trento PSMT decoding overview E' necessario

1.36k views • 86 slides
Reordering Philipp Koehn 31 October 2017 Philipp Koehn Machine Translation: Reordering 31

Reordering Philipp Koehn 31 October 2017 Philipp Koehn Machine Translation: Reordering 31

Reordering Philipp Koehn 31 October 2017 Philipp Koehn Machine Translation: Reordering 31 October 2017 Why Word Order? 1 Language has words to name things (nouns) actions (verbs) properties (adjectives, adverbs) Function

488 views • 32 slides
Dependency parsing and logistic regression Shay Cohen (based on slides by Sharon Goldwater) 21

Dependency parsing and logistic regression Shay Cohen (based on slides by Sharon Goldwater) 21

Dependency parsing and logistic regression Shay Cohen (based on slides by Sharon Goldwater) 21 October 2019 Last class Dependency parsing: a fully lexicalized formalism; tree edges connect words in the sentence based on head-dependent

764 views • 43 slides
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting LSTM

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting LSTM

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting LSTM : VALSE 2016/03/23 Content Quick Review of Recurrent Neural Network

738 views • 27 slides
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification Duyu Tang,

Document Modeling with Gated Recurrent Neural Network for Sentiment Classification Duyu Tang,

Document Modeling with Gated Recurrent Neural Network for Sentiment Classification Duyu Tang, Bing Qin, Ting Liu Harbin Institute of Technology 1 Sentiment Classification Given a piece of text, sentiment classification focus on inferring

287 views • 27 slides
Lecture 4: Recurrent neural networks for natural language processing Plan of the lecture Part

Lecture 4: Recurrent neural networks for natural language processing Plan of the lecture Part

Neural Natural Language Processing Lecture 4: Recurrent neural networks for natural language processing Plan of the lecture Part 1 : Language modeling. Part 2 : Recurrent neural networks. Part 3 : Long-Short Term Memory (LSTM).

1.07k views • 78 slides
Convolutional and recurrent neural networks Benoit Favre < benoit.favre@univ-mrs.fr >

Convolutional and recurrent neural networks Benoit Favre < benoit.favre@univ-mrs.fr >

Deep learning for natural language processing Convolutional and recurrent neural networks Benoit Favre < benoit.favre@univ-mrs.fr > Aix-Marseille Universit, LIF/CNRS 22 Feb 2017 Benoit Favre (AMU) DL4NLP: CNNs and RNNs 22 Feb 2017 1

574 views • 25 slides
IN5550 Neural Methods in Natural Language Processing Applications of Recurrent Neural Networks

IN5550 Neural Methods in Natural Language Processing Applications of Recurrent Neural Networks

IN5550 Neural Methods in Natural Language Processing Applications of Recurrent Neural Networks Stephan Oepen University of Oslo March 24, 2019 Our Roadmap Last Week Language structure: sequences, trees, graphs Recurrent Neural

217 views • 19 slides
Stochastic Processes Will Perkins March 7, 2013 Stochastic Processes Q: What is a Stochastic

Stochastic Processes Will Perkins March 7, 2013 Stochastic Processes Q: What is a Stochastic

Stochastic Processes Will Perkins March 7, 2013 Stochastic Processes Q: What is a Stochastic Process? A: A collection of random variables defined on the same probability space and indexed by a time parameter. { Z t } t T where each Z

1.52k views • 17 slides
Recurrent Neural Networks CS60010: Deep Learning Abir Das IIT Kharagpur Mar 11, 2020

Recurrent Neural Networks CS60010: Deep Learning Abir Das IIT Kharagpur Mar 11, 2020

Recurrent Neural Networks CS60010: Deep Learning Abir Das IIT Kharagpur Mar 11, 2020 Introduction Recurrent Neural Network LSTM Agenda Get introduced to different recurrent neural architecture e.g. , RNNs, LSTMs, GRUs etc. Get

743 views • 48 slides
Deep Recurrent Survival Analysis Kan Ren, Jiarui Qin, Lei Zheng, Zhengyu Yang, Weinan Zhang, Lin

Deep Recurrent Survival Analysis Kan Ren, Jiarui Qin, Lei Zheng, Zhengyu Yang, Weinan Zhang, Lin

Deep Recurrent Survival Analysis Kan Ren, Jiarui Qin, Lei Zheng, Zhengyu Yang, Weinan Zhang, Lin Qiu, Yong Yu Apex Data & Knowledge Management Lab Shanghai Jiao Tong University Table of Contents Background Deep Recurrent Model

511 views • 30 slides

More recommend