61a lecture 35
play

61A Lecture 35 Wednesday, December 4 Announcements 2 - PowerPoint PPT Presentation

61A Lecture 35 Wednesday, December 4 Announcements 2 Announcements Homework 11 due Thursday 12/5 @ 11:59pm. 2 Announcements Homework 11 due Thursday 12/5 @ 11:59pm. No video of lecture on Friday 12/6. 2 Announcements Homework


  1. Machine Translation Target language corpus gives examples of well-formed sentences I will get to it later He will do it See you later Parallel corpus gives translation examples I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras 7

  2. Machine Translation Target language corpus gives examples of well-formed sentences I will get to it later He will do it See you later Parallel corpus gives translation examples I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: 7

  3. Machine Translation Target language corpus gives examples of well-formed sentences I will get to it later He will do it See you later Parallel corpus gives translation examples I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: Model of translation 7

  4. Machine Translation Target language corpus gives examples of well-formed sentences I will get to it later He will do it See you later Parallel corpus gives translation examples I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: Source language Target language Model of Yo lo haré después I will do it later translation N OVEL S ENTENCE 7

  5. Syntactic Agreement in Translation S S NP VP NP VP MD VP MD VP PRP VB PRP ADV PRP VB ADV I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: Model of Yo lo haré después I will do it later translation 8

  6. Syntactic Agreement in Translation S S NP VP NP VP MD VP MD VP PRP VB PRP ADV PRP VB ADV I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: ADV ADV Model of Yo lo haré después I will do it later translation 8

  7. Syntactic Agreement in Translation S S NP VP NP VP MD VP MD VP PRP VB PRP ADV PRP VB ADV I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: S S ADV ADV Model of Yo lo haré después I will do it later translation 8

  8. Syntactic Agreement in Translation S S NP VP NP VP MD VP MD VP PRP VB PRP ADV PRP VB ADV I will do it gladly You will see later Yo lo haré de muy buen grado Después lo veras Machine translation system: S S ADV ADV Model of Yo lo haré después I will do it later translation 8

  9. Syntactic Reordering in Translation pair added to the lexicon 9

  10. Syntactic Reordering in Translation S VP PP NP NP NN VBD TO DT NN pair added to the lexicon 9

  11. Syntactic Reordering in Translation S S VP PP NP NP NP NN VBD TO DT NN NN pair added to the lexicon pair 9

  12. Syntactic Reordering in Translation S S VP VP PP NP NP NP NN VBD TO DT NN NN VBD pair added to the lexicon pair added 9

  13. Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NN VBD TO DT NN NN TO VBD pair added to the lexicon pair to added 9

  14. Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon 9

  15. Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon 9

  16. Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon 9

  17. Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon 9

  18. Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon 9

  19. 一対 が Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon pair 9

  20. 目録 一対 が Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon pair list 9

  21. に 目録 一対 が Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon pair list to 9

  22. 一対 が 目録 追加 されました に Syntactic Reordering in Translation S S VP VP PP PP NP NP NP NP NN VBD TO DT NN NN DT NN TO VBD pair added to the lexicon pair to added the lexicon pair list to add was 9

  23. Context-Free Grammars

  24. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. 11

  25. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S 11

  26. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP S 11

  27. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP S NP VP 11

  28. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S NP VP 11

  29. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S NP VP PRP 11

  30. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S NP VP Lexicon PRP 11

  31. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S NP VP Lexicon PRP PRP -> I 11

  32. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S NP VP Lexicon PRP PRP -> I I 11

  33. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB NP VP Lexicon PRP PRP -> I I 11

  34. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP PRP -> I I 11

  35. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP VB NP PRP -> I I 11

  36. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP VB NP PRP -> I I VB -> know VB -> help 11

  37. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP VB NP PRP -> I I know VB -> know VB -> help 11

  38. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP VB NP PRP -> I I know PRP VB -> know VB -> help 11

  39. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP VB NP PRP -> I PRP -> you I know PRP VB -> know VB -> help 11

  40. A Context-Free Grammar Models Language Generation Grammar Rules A grammar contains rules that hierarchically generate word sequences using syntactic tags. S -> NP VP NP -> PRP S VP -> VB VP -> VB NP NP VP Lexicon PRP VB NP PRP -> I PRP -> you I know PRP VB -> know VB -> help you 11

  41. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP VP -> VB VP -> VB NP PRP Lexicon I PRP -> I PRP -> you VB -> know VB -> help 12

  42. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP VP -> VB VP -> VB NP PRP Lexicon I PRP -> I PRP -> you VB -> know VB -> help 12

  43. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP VP -> VB VP -> VB NP PRP VP -> MD VP Lexicon I PRP -> I PRP -> you VB -> know VB -> help 12

  44. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP VP -> VB VP -> VB NP PRP VP -> MD VP Lexicon I PRP -> I PRP -> you VB -> know VB -> help 12

  45. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 PRP 0.1 VP -> MD VP Lexicon I PRP -> I PRP -> you VB -> know VB -> help 12

  46. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I PRP -> I PRP -> you VB -> know VB -> help 12

  47. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I PRP -> I PRP -> you VB -> know VB -> help MD -> can 12

  48. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I can PRP -> I PRP -> you VB -> know VB -> help MD -> can 12

  49. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I can PRP -> I PRP -> you VB -> know VB -> help MD -> can 12

  50. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I can VB NP PRP -> I PRP -> you help VB -> know VB -> help MD -> can 12

  51. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I can VB NP PRP -> I PRP -> you help PRP VB -> know VB -> help MD -> can 12

  52. Probabilistic Context-Free Grammars S Grammar Rules S -> NP VP NP -> PRP NP VP 0.2 VP -> VB VP -> VB NP 0.7 VP PRP MD 0.1 VP -> MD VP Lexicon I can VB NP PRP -> I PRP -> you help PRP VB -> know VB -> help you MD -> can 12

  53. Learning Probabilistic Context-Free Grammars (Demo)

  54. Parsing with Probabilistic Context-Free Grammars

  55. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. 15

  56. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow 15

  57. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow 15

  58. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow 15

  59. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas 15

  60. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas 15

  61. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas 15

  62. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. 15

  63. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. Algorithm: Try every rule over every span. Match the lexicon to each word. 15

  64. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. Algorithm: Try every rule over every span. Match the lexicon to each word. time flies like an arrow 0 1 2 3 4 5 15

  65. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. Algorithm: Try every rule over every span. Match the lexicon to each word. S -> NP VP time flies like an arrow 0 1 2 3 4 5 15

  66. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. Algorithm: Try every rule over every span. Match the lexicon to each word. S -> NP VP NP -> NN time flies like an arrow 0 1 2 3 4 5 15

  67. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. Algorithm: Try every rule over every span. Match the lexicon to each word. S -> NP VP NP -> NN NN -> time time flies like an arrow 0 1 2 3 4 5 15

  68. Parsing is Maximizing Likelihood A probabilistic context-free grammar can be used to select a parse for a sentence. time flies like an arrow fruit flies like bananas Parse by finding the tree with the highest total probability that yields the sentence. Algorithm: Try every rule over every span. Match the lexicon to each word. S -> NP VP NP -> NN VP -> VBZ PP NN -> time time flies like an arrow 0 1 2 3 4 5 15

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend