SLIDE 1
Fast decoding in neural machine translation with Ray
MAREK STRELEC
Fast decoding in neural machine translation with Ray MAREK STRELEC - - PowerPoint PPT Presentation
Fast decoding in neural machine translation with Ray MAREK STRELEC - - PowerPoint PPT Presentation
Fast decoding in neural machine translation with Ray MAREK STRELEC Time cost statistics for decoding Zhang, Wen, et al. (2018) Ray q A flexible, high-performance distributed execution framework q Implements a dynamic task graph
SLIDE 2
SLIDE 3
Time cost statistics for decoding
Zhang, Wen, et al. (2018)
SLIDE 4
Ray
q “A flexible, high-performance distributed execution framework” q Implements a dynamic task graph computation model q Global Control Store q Bottom-up distributed scheduler q Actor abstraction
SLIDE 5
Steps
q Implement an NMT model in TensorFlow q Train the model on a subset of parallel data (Europarl) q Experiments
q Distributed batched translation q Distributed Beam Search q Dynamic Beam Search q Heterogeneous environment
q Compare times and BLEU score
SLIDE 6