Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle
Miryam de Lhoneux, Sara Stymne and Joakim Nivre
@mdlhx 22 September 2017
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 1
Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic - - PowerPoint PPT Presentation
Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara Stymne and Joakim Nivre @ mdlhx 22 September 2017 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 1
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 2
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 3
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 6
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 8
Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9
Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9
Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9
1 2 4 3 Thanks Carlos Gomez-Rodriguez for the example! Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 11
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12
1 2 4 3
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 13
LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b MLP concat LSTM f LSTM b
STACK jumped root BUFFER Configuration: the brown fox
b r
f
j u e d w m p t h e Vthe Vfox Vjumped Vroot
Vbrown
fox jumped root e(brown) pe(brown) e(fox) pe(fox) e(jumped) pe(jumped) pe(the) e(the) (score(LEFT−ARC),score(RIGHT−ARC),score(SHIFT),score(SWAP)) Scoring:
Kiperwasser and Goldberg (2016); de Lhoneux et al. (2017) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 14
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15
e(the)
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15
pe(the) e(the)
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15
concat
Cf Cf Cf Cb Cb Cb h e t pe(the) e(the)
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15
fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16
LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b concat
Vthe Vfox Vjumped Vroot Vbrown
fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16
LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b concat
Vthe Vfox Vjumped Vroot Vbrown
fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16
LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b concat
Vthe Vfox Vjumped Vroot Vbrown
fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16
LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b MLP concat LSTM f LSTM b
Vthe Vfox Vjumped Vroot
Vbrown
fox jumped root (score(LEFT−ARC),score(RIGHT−ARC),score(SHIFT),score(SWAP)) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 17
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 17
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 17
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20
Miryam de Lhoneux, Yan Shao, Ali Basirat, Eliyahu Kiperwasser, Sara Stymne, Yoav Goldberg, and Joakim Nivre.
Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, Vancouver, Canada, pages 207–217. Yoav Goldberg and Joakim Nivre. 2013. Training deterministic parsers with non-deterministic oracles. Transactions
Eliyahu Kiperwasser and Yoav Goldberg. 2016. Simple and accurate dependency parsing using bidirectional LSTM feature representations. Transactions of the Association for Computational Linguistics 4:313–327. Marco Kuhlmann, Carlos Gómez-Rodríguez, and Giorgio Satta. 2011. Dynamic programming algorithms for transition-based dependency parsers. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL). pages 673–682. Joakim Nivre. 2009. Non-projective dependency parsing in expected linear time. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP (ACL-IJCNLP). pages 351–359. Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 21