Fast decoding in neural machine translation with Ray MAREK STRELEC - PowerPoint PPT Presentation

Aug 15, 2022 •45 likes •105 views

Fast decoding in neural machine translation with Ray MAREK STRELEC Time cost statistics for decoding Zhang, Wen, et al. (2018) Ray q A flexible, high-performance distributed execution framework q Implements a dynamic task graph

Fast decoding in neural machine translation with Ray MAREK STRELEC
Time cost statistics for decoding Zhang, Wen, et al. (2018)
Ray q “A flexible, high-performance distributed execution framework” q Implements a dynamic task graph computation model q Global Control Store q Bottom-up distributed scheduler q Actor abstraction
Steps q Implement an NMT model in TensorFlow q Train the model on a subset of parallel data (Europarl) q Experiments q Distributed batched translation q Distributed Beam Search q Dynamic Beam Search q Heterogeneous environment q Compare times and BLEU score
Thank you!

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Neural Machine Translation Decoding Philipp Koehn 8 October 2020 Philipp Koehn Machine

Neural Machine Translation Decoding Philipp Koehn 8 October 2020 Philipp Koehn Machine Translation: Neural Machine Translation Decoding 8 October 2020 Inference 1 Given a trained model ... we now want to translate test sentences We

682 views • 39 slides

Chapter 6 Decoding Statistical Machine Translation Decoding We have a mathematical model for

Chapter 6 Decoding Statistical Machine Translation Decoding We have a mathematical model for translation p ( e | f ) Task of decoding: find the translation e best with highest probability e best = argmax e p ( e | f ) Two types of

571 views • 34 slides

Investigations on Phrase-based Decoding with Recurrent Neural Network Language and Translation

Investigations on Phrase-based Decoding with Recurrent Neural Network Language and Translation Models Tamer Alkhouli, Felix Rietig, and Hermann Ney surname@cs.rwth-aachen.de Tenth Workshop on Statistical Machine Translation Lisbon, Portugal

563 views • 24 slides

Neural Machine Translation Gongbo Tang 8 October 2018 Outline Neural Machine Translation 1

Neural Machine Translation Gongbo Tang 8 October 2018 Outline Neural Machine Translation 1 Advances and Challenges 2 Gongbo Tang Neural Machine Translation 2/52 Neural Machine Translation Figure Recurrent neural network based NMT

906 views • 73 slides

BREAKTHROUGHS IN NEURAL MACHINE TRANSLATION Olof Mogren Chalmers University of Technology

BREAKTHROUGHS IN NEURAL MACHINE TRANSLATION Olof Mogren Chalmers University of Technology 2016-09-29 COMING SEMINARS T oday: Olof Mogren Neural Machine Translation October 6: John Wiedenhoeft Fast Bayesian inference in Hidden Markov

607 views • 22 slides

Decoding Philipp Koehn 17 September 2020 Philipp Koehn Machine Translation: Decoding 17

Decoding Philipp Koehn 17 September 2020 Philipp Koehn Machine Translation: Decoding 17 September 2020 Decoding 1 We have a mathematical model for translation p ( e | f ) Task of decoding: find the translation e best with highest

1.04k views • 61 slides

Neural Machine Translation Philipp Koehn 6 October 2020 Philipp Koehn Machine Translation:

Neural Machine Translation Philipp Koehn 6 October 2020 Philipp Koehn Machine Translation: Neural Machine Translation 6 October 2020 Language Models 1 Modeling variants feed-forward neural network recurrent neural network long

485 views • 36 slides

Convolutional over Recurrent Encoder for Neural Machine Translation Praveen Dakwale and Christof

Annual Conference of the European Association for Machine Translation 2017 Convolutional over Recurrent Encoder for Neural Machine Translation Praveen Dakwale and Christof Monz Neural Machine Translation End to end neural network with RNN

354 views • 20 slides

Machine Translation 12: (Non-neural) Statistical Machine Translation Rico Sennrich University of

Machine Translation 12: (Non-neural) Statistical Machine Translation Rico Sennrich University of Edinburgh R. Sennrich MT 2018 12 1 / 27 Todays Lecture So far, main focus of lecture was on: neural machine translation research

740 views • 46 slides

Decoding in Statistical Machine Translation Christian Hardmeier 2016-05-04 Mid-course Evaluation

Decoding in Statistical Machine Translation Christian Hardmeier 2016-05-04 Mid-course Evaluation http://stp.lingfil.uu.se/~sara/kurser/MT16/ mid-course-eval.html Decoding The decoder is the part of the SMT system that creates the

138 views • 10 slides

Adaptive Multi-pass Decoder for Neural Machine Translation EMNLP 2018

Adaptive Multi-pass Decoder for Neural Machine Translation EMNLP 2018 http://aclweb.org/anthology/D18-1048 Neural Machine Translation(NMT) The encoder-decoder are widely used in neural machine translation the encoder transforms the source

121 views • 11 slides

Decoding and Inference with Syntactic Translation Models Machine Translation Lecture 15

Decoding and Inference with Syntactic Translation Models Machine Translation Lecture 15 Instructor: Chris Callison-Burch TAs: Mitchell Stern, Justin Chiu Website: mt-class.org/penn jon-ga ringo-o tabeta jon-ga ringo-o tabeta ringo-o tabeta

1.16k views • 83 slides

lti Introduction Two trends in machine translation research Many approaches to decoding

Feature-Rich Translation by Quasi-Synchronous Lattice Parsing Kevin Gimpel and Noah A. Smith lti Introduction Two trends in machine translation research Many approaches to decoding Phrase-based Hierarchical phrase-based

854 views • 52 slides

Semi-supervised Learning for Neural Machine Translation Yong Cheng joint work with Wei Xu,

Semi-supervised Learning for Neural Machine Translation Yong Cheng joint work with Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu 1 Machine Translation Automated translation using computer software 2 Machine Translation Rule-based

650 views • 26 slides

Neural Machine Translation: Breaking the Performance Plateau Rico Sennrich Institute for

Neural Machine Translation: Breaking the Performance Plateau Rico Sennrich Institute for Language, Cognition and Computation University of Edinburgh July 4 2016 Rico Sennrich Neural Machine Translation 1 / 15 Is Machine Translation Getting

452 views • 21 slides

What can Statistical Machine Translation teach Neural Machine Translation about Structured

What can Statistical Machine Translation teach Neural Machine Translation about Structured Prediction? Graham Neubig @ ICLR Workshop on Deep Reinforcement Learning Meets Structured Prediction 5/6/2019 Types of Prediction Types of

1.73k views • 127 slides

Efficient Video Decoding on GPUs Efficient Video Decoding on GPUs by Point Based Rendering by

Efficient Video Decoding on GPUs Efficient Video Decoding on GPUs by Point Based Rendering by Point Based Rendering Bo Han, Bingfeng Zhou Peking University Outline Outline Motivation and Goal Previous work Review of video decoding

741 views • 30 slides

All - in - One Interactive Display Made in/for India +91 9980878877 | satish@aidio.in

All - in - One Interactive Display Made in/for India +91 9980878877 | satish@aidio.in Interactive Display Voice Conversational Interactivity 1 Touch Interactivity 2 Gesture & Sensor based Interactivity 3 +91 9980878877 |

111 views • 7 slides

Kindergarten Orientation Windsor Elementary School Welcome Introductions Mrs. Drake, Windsor

Kindergarten Orientation Windsor Elementary School Welcome Introductions Mrs. Drake, Windsor Elementary Principal drakea@windsorcusd.org (217) 459-2447 Mrs. Hendrickson, Windsor Elementary Secretary

157 views • 12 slides

Research-Based Practice to Improve Student Math Outcomes Lynn Lamers Sourcewell Technology

Research-Based Practice to Improve Student Math Outcomes Lynn Lamers Sourcewell Technology & Spring Math Who Am I? Classroom teacher for 20 years District Math Coordinator for 6 years Consultant for national assessment

590 views • 32 slides

Decoding How to Do Research to Produce High Quality Output 12th APGA-ASAN ON-LINE Workshop 27

Decoding How to Do Research to Produce High Quality Output 12th APGA-ASAN ON-LINE Workshop 27 April 27, 2020 by Mammo Muchie, DST/NRF Research Professor, TUT, South Africa, TMDC, Oxford University, UK & Adjunct Professor, BDU and Harmaya

3.36k views • 130 slides

A GPU Implementation of Belief Propagation Decoder for Polar Codes Bharath Kumar Reddy L. and

A GPU Implementation of Belief Propagation Decoder for Polar Codes Bharath Kumar Reddy L. and Nitin Chandrachoodan Indian Institute of Technology Madras Nov 6, 2012 Bharath et al. (IIT Madras) GPU Polar Codes Nov 6, 2012 1 / 29 Outline

366 views • 36 slides

Contents H.264 Overview First Parts of H.264 Decoder NAL Unit Unwrapping Details

Contents H.264 Overview First Parts of H.264 Decoder NAL Unit Unwrapping Details Entropy Decoding Details Hardware Design Chun-Chieh Lin Design Explorations Benchmark Results H.264 Overview NAL Unit Unwrapping Works

76 views • 5 slides

A plan was set for Operation Overlord, the Allied invasion of Normandy It included Operation

A plan was set for Operation Overlord, the Allied invasion of Normandy It included Operation Neptune, the largest seaborne invasion in history 4,000 ships 11,000 airplanes 150,000 soldiers and all their supplies A date of 5 June 1944 was agreed

561 views • 10 slides