phrasal rank encoding
play

Phrasal Rank-Encoding Exploiting Phrase Redundancy and - PowerPoint PPT Presentation

Jun 23, 2023 •290 likes •1.05k views

Phrasal Rank-Encoding Exploiting Phrase Redundancy and Translational Relations for Phrase Table Compression Marcin Junczys-Dowmunt Department of Mathematics and Computer Science Adam Mickiewicz University in Pozna n ul.Umultowska 87, 61-614

  1. Phrasal Rank-Encoding Exploiting Phrase Redundancy and Translational Relations for Phrase Table Compression Marcin Junczys-Dowmunt Department of Mathematics and Computer Science Adam Mickiewicz University in Pozna´ n ul.Umultowska 87, 61-614 Pozna´ n, Poland Global Databases Section World Intelectual Property Organizaton (WIPO) 34, chemin des Colombettes, 1211 Geneva, Switzerland junczys@amu.edu.pl September 4, 2012 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 1 / 31

  2. Translation Model Size 70 Phrase T. 60 30.4 + 27.6 Reord. T. 50 40 Gigabytes 30 20 10 0 Text M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 2 / 31

  3. Translation Model Size 70 Phrase T. 60 30.4 + 27.6 Reord. T. 50 40 Gigabytes 30 20 5.9 + 2.6 10 0 Text Gzipped M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 2 / 31

  4. Translation Model Size 70 22.0 + 44.4 Phrase T. 60 30.4 + 27.6 Reord. T. 50 40 Gigabytes 30 20 5.9 + 2.6 10 0 Text Gzipped Moses M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 2 / 31

  5. Translation Model Size 70 22.0 + 44.4 Phrase T. 60 30.4 + 27.6 Reord. T. 50 40 Gigabytes 30 20 5.9 + 2.6 10 4.8 + 1.4 0 Text Gzipped Moses Compact M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 2 / 31

  6. Translation Model Size 70 22.0 + 44.4 Phrase T. 60 30.4 + 27.6 Reord. T. 50 40 Gigabytes 30 20 5.9 + 2.6 10 4.8 + 1.4 2.9 + 1.4 0 Text Gzipped Moses Compact PR−Enc M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 2 / 31

  7. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 3 / 31

  8. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 3 / 31

  9. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch Maria no daba una bofetada a la bruja verde ||| Mary did not slap the green witch ||| 0-0 1-1 1-2 2-3 no daba una bofetada a la bruja verde ||| did not slap the green witch ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 Maria no daba una bofetada a la ||| Mary did not slap the ||| 0-0 1-1 1-2 2-3 3-3 4-3 5-4 6-4 daba una bofetada a la bruja verde ||| slap the green witch ||| 0-0 1-0 2-0 3-1 4-1 5-3 6-2 Maria no daba una bofetada ||| Mary did not slap ||| 0-0 1-1 1-2 2-3 3-3 4-3 no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 a la bruja verde ||| the green witch ||| 0-0 1-0 2-2 3-1 Maria no ||| Mary did not ||| 0-0 1-1 1-2 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 bruja verde ||| green witch ||| 0-1 1-0 Maria ||| Mary ||| 0-0 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 bruja ||| witch ||| 0-0 verde ||| green ||| 0-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 4 / 31

  10. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 5 / 31

  11. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 5 / 31

  12. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 5 / 31

  13. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  14. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  15. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| (0,2,0) the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  16. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| (0,2,0) the ||| 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  17. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| (0,2,0) the ||| 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  18. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| (0,2,0) (1,0,0) ||| 4-3 5-3 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  19. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| (0,2,0) (1,0,0) ||| no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  20. bofetada bruja Maria no daba una a la verde Mary did not slap the green witch no daba una bofetada a la ||| (0,2,0) (1,0,0) ||| no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 6 / 31

  21. Maria no daba una bofetada a la bruja verde ||| Mary did not slap the green witch ||| 0-0 1-1 1-2 2-3 no daba una bofetada a la bruja verde ||| did not slap the green witch ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 Maria no daba una bofetada a la ||| Mary did not slap the ||| 0-0 1-1 1-2 2-3 3-3 4-3 5-4 6-4 daba una bofetada a la bruja verde ||| slap the green witch ||| 0-0 1-0 2-0 3-1 4-1 5-3 6-2 Maria no daba una bofetada ||| Mary did not slap ||| 0-0 1-1 1-2 2-3 3-3 4-3 no daba una bofetada a la ||| did not slap the ||| 0-0 0-1 1-2 2-2 3-2 4-3 5-3 a la bruja verde ||| the green witch ||| 0-0 1-0 2-2 3-1 Maria no ||| Mary did not ||| 0-0 1-1 1-2 no daba una bofetada ||| did not slap ||| 0-0 0-1 1-2 2-2 3-2 daba una bofetada a la ||| slap the ||| 0-0 1-0 2-0 3-1 4-1 bruja verde ||| green witch ||| 0-1 1-0 Maria ||| Mary ||| 0-0 no ||| did not ||| 0-0 0-1 daba una bofetada ||| slap ||| 0-0 1-0 2-0 a la ||| the ||| 0-0 1-0 bruja ||| witch ||| 0-0 verde ||| green ||| 0-0 M. Junczys-Dowmunt (UAM) Phrasal Rank-Encoding September 2012 7 / 31

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

2 3 4 5 8 9 MINNEAPOLIS MILWAUKEE MSA RANK #16 MSA RANK #39 CHICAGO MSA RANK #3

2 3 4 5 8 9 MINNEAPOLIS MILWAUKEE MSA RANK #16 MSA RANK #39 CHICAGO MSA RANK #3

2 3 4 5 8 9 MINNEAPOLIS MILWAUKEE MSA RANK #16 MSA RANK #39 CHICAGO MSA RANK #3 INDIANAPOLIS MSA RANK #34 DETROIT MSA RANK #14 COLUMBUS MSA RANK #33 BALTIMORE/ DC CORRIDOR MSA RANK #21 CINCINNATI MSA RANK #28 ATLANTA MSA RANK

726 views • 44 slides
Non-Headed Structures and Phrasal Constructions Jackendoff (2011) gives the following examples

Non-Headed Structures and Phrasal Constructions Jackendoff (2011) gives the following examples

Unifying Everything: Simpler Syntax, Construction Grammar, Minimalism and HPSG Non-Headed Structures and Phrasal Constructions Non-Headed Structures and Phrasal Constructions Jackendoff (2011) gives the following examples for phrasal

119 views • 9 slides
Advanced Lesson 26 Topic 26: Phrasal verbs literal and idiomatic meaning A phrasal verb is a

Advanced Lesson 26 Topic 26: Phrasal verbs literal and idiomatic meaning A phrasal verb is a

2 nd semester Advanced Lesson 26 Topic 26: Phrasal verbs literal and idiomatic meaning A phrasal verb is a verb with one or several prepositions. Unlike verbs with dependent prepositions, they have a completely new meaning. Literal phrasal

340 views • 6 slides
ITG for Joint Phrasal Translation Modeling Colin Cherry Dekang Lin University of Alberta

ITG for Joint Phrasal Translation Modeling Colin Cherry Dekang Lin University of Alberta

ITG for Joint Phrasal Translation Modeling Colin Cherry Dekang Lin University of Alberta Google Inc. April 26, 2007 University of Alberta The Gist Joint phrasal translation models (JPTM) learn a bilingual phrase table using EM

341 views • 31 slides
Prominence-based licensing in head movement and phrasal movement Brian Hsu LSA 2020 Annual

Prominence-based licensing in head movement and phrasal movement Brian Hsu LSA 2020 Annual

Prominence-based licensing in head movement and phrasal movement Brian Hsu LSA 2020 Annual Meeting January 4, 2020 1 Introduction and overview Focus of this talk: Some challenging interactions between head movement and phrasal movement.

557 views • 40 slides
1 SVD applications: rank, column, row, and null spaces Rank : the rank of a matrix is equal to:

1 SVD applications: rank, column, row, and null spaces Rank : the rank of a matrix is equal to:

Statistical Modeling and Analysis of Neural Data (NEU 560) Princeton University, Spring 2018 Jonathan Pillow Lecture 3A notes: SVD and Linear Systems 1 SVD applications: rank, column, row, and null spaces Rank : the rank of a matrix is equal to:

462 views • 3 slides
The The Sel Selecti ection n & Pres esentati entation n of Phrasal Verbs bs in ELT

The The Sel Selecti ection n & Pres esentati entation n of Phrasal Verbs bs in ELT

The The Sel Selecti ection n & Pres esentati entation n of Phrasal Verbs bs in ELT Textbo books: Alternative Appr pproaches Katie Heil March 7, 2015 NYS TESOL Applied Linguistics Winter Conference Teachers College, Columbia

869 views • 20 slides
Dependency and Phrasal Parsers of the Czech Language: A Comparison ak 1 , Tom s Holan 2 ,

Dependency and Phrasal Parsers of the Czech Language: A Comparison ak 1 , Tom s Holan 2 ,

Outline Motivation Compared Parsers Differences of the Parses Results Conclusions and Future Directions Dependency and Phrasal Parsers of the Czech Language: A Comparison ak 1 , Tom s Holan 2 , Vladim r Kadlec 1 , Vojt r 1 Ale s

734 views • 46 slides
WEBee Reverse Convolution Coding Reverse Convolution Coding Convolutional encoding uses a

WEBee Reverse Convolution Coding Reverse Convolution Coding Convolutional encoding uses a

WEBee Reverse Convolution Coding Reverse Convolution Coding Convolutional encoding uses a 288-by-216 matrix M M is not full row-rank (row:288 > column:216), the matrix equation is an overdetermined system ZigBee signals occupy

164 views • 15 slides
Chapter 2: Lexical and Phrasal Signs Syntactic Constructions in English Kim and Michaelis (2020)

Chapter 2: Lexical and Phrasal Signs Syntactic Constructions in English Kim and Michaelis (2020)

Chapter 2: Lexical and Phrasal Signs Syntactic Constructions in English Kim and Michaelis (2020) Syntactic Constructions Chapter 2 1 / 70 1 Linguistic Signs and Constructions as Form-Meaning Pairs 2 From Lexical Signs to Phrasal Signs as a

884 views • 70 slides
/k Content 2/15 1. Introduction 2. Hamming weight 3. Rank weight 4. Extended rank weight

/k Content 2/15 1. Introduction 2. Hamming weight 3. Rank weight 4. Extended rank weight

On defining the generalized rank weight Ruud Pellikaan joint work with Relinde Jurrius Autonomous University Barcelona, 6 November 2014 /k Content 2/15 1. Introduction 2. Hamming weight 3. Rank weight 4. Extended rank weight enumerator

165 views • 15 slides
Phrasal Restrictions on Noncontrastive Topic: The Case of Japanese Ross Kirsling Department of

Phrasal Restrictions on Noncontrastive Topic: The Case of Japanese Ross Kirsling Department of

Introduction Background Data Analysis Conclusion References Phrasal Restrictions on Noncontrastive Topic: The Case of Japanese Ross Kirsling Department of Linguistics University of Wisconsin-Madison Prelim 1 Defense December 6, 2012

1.06k views • 19 slides
10. Learning to Rank Outline 10.1. Why Learning to Rank (LeToR)? 10.2. Pointwise, Pairwise,

10. Learning to Rank Outline 10.1. Why Learning to Rank (LeToR)? 10.2. Pointwise, Pairwise,

10. Learning to Rank Outline 10.1. Why Learning to Rank (LeToR)? 10.2. Pointwise, Pairwise, Listwise 10.3. Gathering User Input 10.4. LeToR Evaluation 10.5. Beyond Search Advanced Topics in Information Retrieval / Learning to Rank 2 10.1.

1.01k views • 34 slides
Deep Encode: Machine Learning for Per-Title Encoding Daniel Silhavy| IBC20| Per-Title Encoding

Deep Encode: Machine Learning for Per-Title Encoding Daniel Silhavy| IBC20| Per-Title Encoding

Fraunhofer FOKUS Institut fr Offene Kommunikationssysteme Deep Encode: Machine Learning for Per-Title Encoding Daniel Silhavy| IBC20| Per-Title Encoding What & Why & 1 How? Benefits of Per-Title Encoding Storage and bitrate

342 views • 12 slides
Harmonic Grammar in phrasal movement: an account of probe competition and blocking Brian Hsu 51

Harmonic Grammar in phrasal movement: an account of probe competition and blocking Brian Hsu 51

Harmonic Grammar in phrasal movement: an account of probe competition and blocking Brian Hsu 51 st Annual Meeting of the North East Linguistic society (NELS 51) November 8, 2020 1 Organization of the talk 1. Overview 2. Probe competition and

714 views • 60 slides
61A Extra Lecture 4 Announcements Encoding Strings Representing Strings: UTF-8 Encoding 4

61A Extra Lecture 4 Announcements Encoding Strings Representing Strings: UTF-8 Encoding 4

61A Extra Lecture 4 Announcements Encoding Strings Representing Strings: UTF-8 Encoding 4 Representing Strings: UTF-8 Encoding UTF (UCS (Universal Character Set) Transformation Format) 4 Representing Strings: UTF-8 Encoding UTF (UCS

1.62k views • 99 slides
for boron neutron capture therapy H. Kumada , K. Takada, T. Aihara, A. Matsumura H. Sakurai, T.

for boron neutron capture therapy H. Kumada , K. Takada, T. Aihara, A. Matsumura H. Sakurai, T.

iBNCT Project ct Verification of dose estimation for Monte- Carlo based treatment planning system for boron neutron capture therapy H. Kumada , K. Takada, T. Aihara, A. Matsumura H. Sakurai, T. Sakae Proton Medical Research Centre,

256 views • 15 slides
Year-end Report 2008 Press and analyst conference 10 February Financial result 2008

Year-end Report 2008 Press and analyst conference 10 February Financial result 2008

Year-end Report 2008 Press and analyst conference 10 February Financial result 2008 Strengthening of capital position Middle of the road approach to our organic growth strategy 2 Disclaimer This presentation contains forward-looking

557 views • 45 slides
Pancreatic Desmoplastic Small Round Cell Tumour - A Rare Presentation of Painful Obstructive

Pancreatic Desmoplastic Small Round Cell Tumour - A Rare Presentation of Painful Obstructive

JOP. J Pancreas (Online) 2014 Nov 28; 15(6): 618-621 CASE REPORT Pancreatic Desmoplastic Small Round Cell Tumour - A Rare Presentation of Painful Obstructive Jaundice Duminda Subasinghe 1 , Chathuranga Tisara Keppetiyagama 1 , Hemantha Sudasinghe

312 views • 4 slides
Critical Success Factors for Industry Academic Collaborations Industry Academic Collaborations

Critical Success Factors for Industry Academic Collaborations Industry Academic Collaborations

Critical Success Factors for Industry Academic Collaborations Industry Academic Collaborations Mary Shire Vice President Research September 9 th 2015 September 9 th 2015 Content Content Context Context Changing Mission of Universities

259 views • 22 slides
2. Presentation - DENR - FY17 Thursday, January 07, 2016 10:43 AM

2. Presentation - DENR - FY17 Thursday, January 07, 2016 10:43 AM

2. Presentation - DENR - FY17 Thursday, January 07, 2016 10:43 AM

575 views • 28 slides
PUTTING THE CENTRIC IN DONOR-ADVISED FUNDS September 13, 2017 Presentation by: Joanne Pipkin

PUTTING THE CENTRIC IN DONOR-ADVISED FUNDS September 13, 2017 Presentation by: Joanne Pipkin

PUTTING THE CENTRIC IN DONOR-ADVISED FUNDS September 13, 2017 Presentation by: Joanne Pipkin Agenda: History Components and Comparisons Donors and Gift Officers Brief History Overview What is a Donor-Advised Fund? According to

299 views • 13 slides
James Turner Product Marketing Manager DAF Trucks Ltd WHAT DOES THE FUTURE HOLD FOR NEW

James Turner Product Marketing Manager DAF Trucks Ltd WHAT DOES THE FUTURE HOLD FOR NEW

James Turner Product Marketing Manager DAF Trucks Ltd WHAT DOES THE FUTURE HOLD FOR NEW TECHNOLOGY? FULLY PNEUMATIC BRAKING SYSTEM 60% 6 bar 10 bar EBS (ELECTRONIC BRAKING SYSTEM) V.3 [2016] VALVE OPERATION 10 bar 10 bar Xxx bar Xxx bar

399 views • 14 slides
2019 CHDC & DAF Ports Tour: Central Highlands Accelerate Agribusiness (CHAA) Liz Alexander ,

2019 CHDC & DAF Ports Tour: Central Highlands Accelerate Agribusiness (CHAA) Liz Alexander ,

2019 CHDC & DAF Ports Tour: Central Highlands Accelerate Agribusiness (CHAA) Liz Alexander , CHDC Agribusiness Development Coordinator About Central Highlands Development Corporation (CHDC) Not-for-profit organisation and the lead

445 views • 27 slides

More recommend