t pr r r t r

t Prr r t r - PowerPoint PPT Presentation

t Prr r t r t t ss


  1. ❊✣❝✐❡♥t Pr♦❣r❛♠♠❛❜❧❡ ▲❡❛r♥✐♥❣ t♦ ❙❡❛r❝❤ ❲✐t❤ ❍❛❧ ❉❛✉♠❡✱ ❛♥❞ ❙t❡♣❤❛♥❡ ❘♦ss ❤tt♣✿✴✴❛r①✐✈✳♦r❣✴❛❜s✴✶✹✵✻✳✶✽✸✼ ■❈▼▲ ❲♦r❦s❤♦♣ ♦♥ ◆❡✇ ▲❡❛r♥✐♥❣ ❋r❛♠❡✇♦r❦s ❛♥❞ ▼♦❞❡❧s ❢♦r ❇✐❣ ❉❛t❛ ❏✉♥❡ ✷✺✱ ✷✵✶✹

  2. ❊①❛♠♣❧❡✿ P❛rt ♦❢ ❙♣❡❡❝❤ ❚❛❣❣✐♥❣ P✐❡rr❡ ❱✐♥❦❡♥ ✱ ✻✶ ②❡❛rs ♦❧❞ Pr♦♣❡r ◆✳ Pr♦♣❡r ◆✳ ❈♦♠♠❛ ◆✉♠❜❡r ◆♦✉♥ ❆❞❥✳ ❙tr✉❝t✉r❡❞ Pr❡❞✐❝t✐♦♥ ❂ ❥♦✐♥t ♣r❡❞✐❝t✐♦♥ ✇✐t❤ ❛ ❥♦✐♥t ❧♦ss

  3. ❙tr✉❝t✉r❡❞ Pr❡❞✐❝t✐♦♥ ❂ ❥♦✐♥t ♣r❡❞✐❝t✐♦♥ ✇✐t❤ ❛ ❥♦✐♥t ❧♦ss ❊①❛♠♣❧❡✿ P❛rt ♦❢ ❙♣❡❡❝❤ ❚❛❣❣✐♥❣ P✐❡rr❡ ❱✐♥❦❡♥ ✱ ✻✶ ②❡❛rs ♦❧❞ Pr♦♣❡r ◆✳ Pr♦♣❡r ◆✳ ❈♦♠♠❛ ◆✉♠❜❡r ◆♦✉♥ ❆❞❥✳

  4. ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳

  5. ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳

  6. ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳

  7. ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳

  8. ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝②

  9. ❆ ♣r♦❣r❛♠ ❝♦♠♣❧❡①✐t② ❝♦♠♣❛r✐s♦♥ 1000 lines of code for POS 100 10 1 CRFSGD CRF++ S-SVM Search

  10. Part of speech tagging (tuned hps) 0.98 96.6 96.1 96.1 0.96 95.8 95.7 95.7 95.0 Accuracy (per tag) 0.94 0.92 VW Search VW Search (own fts) 90.7 VW Classification CRF SGD 0.90 CRF++ Str. Perceptron Structured SVM 1m 10m 30m 1h Str.SVM (DEMI-DCD) 0.88 10 0 10 1 10 2 10 3 Training Time (minutes)

  11. Prediction (test-time) Speed VW Search VW Search (own fts) POS 13 CRF SGD 5.7 129 CRF++ 133 Str. Perceptron 5.3 Structured SVM 14 5.6 NER Str. SVM (DEMI-DCD) 98 24 218 285 0 50 100 150 200 250 300 Thousands of Tokens per Second

  12. ❆♥ ♦✉t❧✐♥❡ ✶✳ ❍♦✇❄ ✶✳✶ Pr♦❣r❛♠♠✐♥❣ ✶✳✷ ▲❡❛r♥✐♥❣ t♦ ❙❡❛r❝❤ ✶✳✸ ❊q✉✐✈❛❧❡♥❝❡ ✶✳✹ ❖♣t✐♠✐③❛t✐♦♥s ✷✳ ❖t❤❡r ❘❡s✉❧ts

  13. ■♥ ❡ss❡♥❝❡✱ ✇r✐t❡ t❤❡ ❞❡❝♦❞❡r✱ ♣r♦✈✐❞✐♥❣ ❛ ❧✐tt❧❡ ❜✐t ♦❢ s✐❞❡ ✐♥❢♦r♠❛t✐♦♥ ❢♦r tr❛✐♥✐♥❣✳ ❍♦✇ ❞♦ ②♦✉ ♣r♦❣r❛♠❄ ❙❡q✉❡♥t✐❛❧❴❘❯◆✭ ❡①❛♠♣❧❡s ✮ ✶✿ ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♣r❡❞✐❝t✐♦♥ ← ♣r❡❞✐❝t✭ ❡①❛♠♣❧❡s ❬ ✐ ❪✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮ ✷✿ ✐❢ ♦✉t♣✉t ✳ ❣♦♦❞ t❤❡♥ ✸✿ ♦✉t♣✉t ✓ ✬ ✬ ✓ ♣r❡❞✐❝t✐♦♥ ✹✿ ❡♥❞ ✐❢ ✺✿ ✻✿ ❡♥❞ ❢♦r

  14. ❍♦✇ ❞♦ ②♦✉ ♣r♦❣r❛♠❄ ❙❡q✉❡♥t✐❛❧❴❘❯◆✭ ❡①❛♠♣❧❡s ✮ ✶✿ ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♣r❡❞✐❝t✐♦♥ ← ♣r❡❞✐❝t✭ ❡①❛♠♣❧❡s ❬ ✐ ❪✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮ ✷✿ ✐❢ ♦✉t♣✉t ✳ ❣♦♦❞ t❤❡♥ ✸✿ ♦✉t♣✉t ✓ ✬ ✬ ✓ ♣r❡❞✐❝t✐♦♥ ✹✿ ❡♥❞ ✐❢ ✺✿ ✻✿ ❡♥❞ ❢♦r ■♥ ❡ss❡♥❝❡✱ ✇r✐t❡ t❤❡ ❞❡❝♦❞❡r✱ ♣r♦✈✐❞✐♥❣ ❛ ❧✐tt❧❡ ❜✐t ♦❢ s✐❞❡ ✐♥❢♦r♠❛t✐♦♥ ❢♦r tr❛✐♥✐♥❣✳

  15. ❙❡q❴❉❡t❡❝t✐♦♥✭ ❡①❛♠♣❧❡s ✱ ❢❛❧s❡❴♥❡❣❛t✐✈❡❴❧♦ss ✮ ▲❡t ♠❛①❴❧❛❜❡❧ ❂ ✶✱ ♠❛①❴♣r❡❞✐❝t✐♦♥ ❂ ✶ ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♠❛①❴❧❛❜❡❧ ← ♠❛①✭ ♠❛①❴❧❛❜❡❧ ✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮ ❡♥❞ ❢♦r ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♠❛①❴♣r❡❞✐❝t✐♦♥ ← ♠❛①✭ ♠❛①❴♣r❡❞✐❝t✐♦♥ ✱ ♣r❡❞✐❝t✭ ❡①❛♠♣❧❡s ❬ ✐ ❪✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮✮ ❡♥❞ ❢♦r ✐❢ ♠❛①❴❧❛❜❡❧ ❃ ♠❛①❴♣r❡❞✐❝t✐♦♥ t❤❡♥ ❧♦ss✭ ❢❛❧s❡❴♥❡❣❛t✐✈❡❴❧♦ss ✮ ❡❧s❡ ✐❢ ♠❛①❴❧❛❜❡❧ ❁ ♠❛①❴♣r❡❞✐❝t✐♦♥ t❤❡♥ ❧♦ss✭✶✮ ❡❧s❡ ❧♦ss✭✵✮ ❡♥❞ ✐❢ ❡♥❞ ✐❢

Recommend


More recommend