Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic - - PowerPoint PPT Presentation

arc hybrid non projective dependency parsing with a
SMART_READER_LITE
LIVE PREVIEW

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic - - PowerPoint PPT Presentation

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle Miryam de Lhoneux , Sara Stymne and Joakim Nivre @ mdlhx 22 September 2017 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic


slide-1
SLIDE 1

Arc-Hybrid Non-Projective Dependency Parsing with a Static-Dynamic Oracle

Miryam de Lhoneux, Sara Stymne and Joakim Nivre

@mdlhx 22 September 2017

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 1

slide-2
SLIDE 2

Outline

1

System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs

2

Experiments

3

Conclusion and Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 2

slide-3
SLIDE 3

Outline

1

System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs

2

Experiments

3

Conclusion and Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 3

slide-4
SLIDE 4

Transition-Based Parsing with Arc-Hybrid

STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-5
SLIDE 5

Transition-Based Parsing with Arc-Hybrid

LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-6
SLIDE 6

Transition-Based Parsing with Arc-Hybrid

LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-7
SLIDE 7

Transition-Based Parsing with Arc-Hybrid

LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-8
SLIDE 8

Transition-Based Parsing with Arc-Hybrid

RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-9
SLIDE 9

Transition-Based Parsing with Arc-Hybrid

RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-10
SLIDE 10

Transition-Based Parsing with Arc-Hybrid

RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-11
SLIDE 11

Transition-Based Parsing with Arc-Hybrid

SHIFT RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-12
SLIDE 12

Transition-Based Parsing with Arc-Hybrid

SHIFT RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Kuhlmann et al. (2011) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 4

slide-13
SLIDE 13

Static Oracle for Arc-Hybrid

Drive your friend home **root**

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-14
SLIDE 14

Static Oracle for Arc-Hybrid

Drive your friend home **root** [ ] [Drive your friend home **root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-15
SLIDE 15

Static Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive ] [your friend home **root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-16
SLIDE 16

Static Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive your ] [friend home **root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-17
SLIDE 17

Static Oracle for Arc-Hybrid

LEFT-ARC Drive your friend home **root** [ Drive ] [friend home **root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-18
SLIDE 18

Static Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive friend] [home **root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-19
SLIDE 19

Static Oracle for Arc-Hybrid

RIGHT-ARC Drive your friend home **root** [ Drive ] [home **root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-20
SLIDE 20

Static Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive home] [**root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-21
SLIDE 21

Static Oracle for Arc-Hybrid

RIGHT-ARC Drive your friend home **root** [ Drive ] [**root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-22
SLIDE 22

Static Oracle for Arc-Hybrid

LEFT-ARC Drive your friend home **root** [ ] [**root**]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 5

slide-23
SLIDE 23

Outline

1

System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs

2

Experiments

3

Conclusion and Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 6

slide-24
SLIDE 24

Dynamic Oracle for Arc-Hybrid

Drive your friend home **root** [ Drive your ] [ friend home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-25
SLIDE 25

Dynamic Oracle for Arc-Hybrid

RIGHT-ARC Drive your friend home **root** [ Drive your ] [ friend home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-26
SLIDE 26

Dynamic Oracle for Arc-Hybrid

RIGHT-ARC Drive your friend home **root** [ Drive ] [ friend home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-27
SLIDE 27

Dynamic Oracle for Arc-Hybrid

RIGHT-ARC Drive your friend home **root** [ Drive ] [ friend home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-28
SLIDE 28

Dynamic Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive your ] [ friend home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-29
SLIDE 29

Dynamic Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive your friend ] [ home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-30
SLIDE 30

Dynamic Oracle for Arc-Hybrid

SHIFT Drive your friend home **root** [ Drive your friend ] [ home **root**]

Goldberg and Nivre (2013) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 7

slide-31
SLIDE 31

Outline

1

System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs

2

Experiments

3

Conclusion and Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 8

slide-32
SLIDE 32

Arc-Hybrid Parsing with Reordering

SHIFT RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9

slide-33
SLIDE 33

Arc-Hybrid Parsing with Reordering

SWAP SHIFT RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9

slide-34
SLIDE 34

Arc-Hybrid Parsing with Reordering

SWAP SHIFT RIGHT−ARC LEFT−ARC STACK BUFFER Configuration: friend home root Drive your Transitions:

Nivre (2009) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 9

slide-35
SLIDE 35

Arc-Hyrid Parsing with Reordering

found best example ever

1 2 4 3 Thanks Carlos Gomez-Rodriguez for the example! Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-36
SLIDE 36

Arc-Hyrid Parsing with Reordering

found best example ever

1 2 4 3 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-37
SLIDE 37

Arc-Hyrid Parsing with Reordering

found best example ever

1 2 4 3 Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-38
SLIDE 38

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ ] [ found1 best2 example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-39
SLIDE 39

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ found1 ] [ best2 example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-40
SLIDE 40

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ found1 best2 ] [ example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-41
SLIDE 41

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ found1 best2 example4 ] [ ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-42
SLIDE 42

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ found1 best2 example4 ] [ ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-43
SLIDE 43

Arc-Hyrid Parsing with Reordering

SWAP found best example ever

1 2 4 3

[ found1 best2 ] [ ever3 example4 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-44
SLIDE 44

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ found1 best2 ever3 ] [ example4 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-45
SLIDE 45

Arc-Hyrid Parsing with Reordering

RIGHT-ARC found best example ever

1 2 4 3

[ found1 best2 ] [ example4 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-46
SLIDE 46

Arc-Hyrid Parsing with Reordering

LEFT-ARC found best example ever

1 2 4 3

[ found1 ] [ example4 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-47
SLIDE 47

Arc-Hyrid Parsing with Reordering

SHIFT found best example ever

1 2 4 3

[ found1 example4 ] [ ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-48
SLIDE 48

Arc-Hyrid Parsing with Reordering

RIGHT-ARC found best example ever

1 2 4 3

[ found1 ] [ ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 10

slide-49
SLIDE 49

Outline

1

System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs

2

Experiments

3

Conclusion and Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 11

slide-50
SLIDE 50

A Static-Dynamic Oracle

found best example ever

1 2 4 3

[ found1 best2] [ example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12

slide-51
SLIDE 51

A Static-Dynamic Oracle

RIGHT-ARC found best example ever

1 2 4 3

[ found1 ] [ example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12

slide-52
SLIDE 52

A Static-Dynamic Oracle

RIGHT-ARC found best example ever

1 2 4 3

[ found1 ] [ example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12

slide-53
SLIDE 53

A Static-Dynamic Oracle

LEFT-ARC found best example ever

1 2 4 3

[ found1 ] [ example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12

slide-54
SLIDE 54

A Static-Dynamic Oracle

LEFT-ARC found best example ever

1 2 4 3

[ found1 ] [ example4 ever3 ]

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 12

slide-55
SLIDE 55

Outline

1

System Arc-Hybrid Dynamic Oracles Reordering A Static-Dynamic Oracle Parsing using BiLSTMs

2

Experiments

3

Conclusion and Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 13

slide-56
SLIDE 56

Transition-Based Parsing using BiLSTMs

LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b MLP concat LSTM f LSTM b

STACK jumped root BUFFER Configuration: the brown fox

X X

b r

  • n

f

  • x

j u e d w m p t h e Vthe Vfox Vjumped Vroot

X

Vbrown

X the X brown

fox jumped root e(brown) pe(brown) e(fox) pe(fox) e(jumped) pe(jumped) pe(the) e(the) (score(LEFT−ARC),score(RIGHT−ARC),score(SHIFT),score(SWAP)) Scoring:

Kiperwasser and Goldberg (2016); de Lhoneux et al. (2017) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 14

slide-57
SLIDE 57

Transition-Based Parsing using BiLSTMs

Xthe

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15

slide-58
SLIDE 58

Transition-Based Parsing using BiLSTMs

e(the)

Xthe

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15

slide-59
SLIDE 59

Transition-Based Parsing using BiLSTMs

pe(the) e(the)

Xthe

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15

slide-60
SLIDE 60

Transition-Based Parsing using BiLSTMs

concat

Cf Cf Cf Cb Cb Cb h e t pe(the) e(the)

Xthe

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 15

slide-61
SLIDE 61

Transition-Based Parsing using BiLSTMs

X X X X the X brown

fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16

slide-62
SLIDE 62

Transition-Based Parsing using BiLSTMs

LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b concat

Vthe Vfox Vjumped Vroot Vbrown

X X X X the X brown

fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16

slide-63
SLIDE 63

Transition-Based Parsing using BiLSTMs

LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b concat

Vthe Vfox Vjumped Vroot Vbrown

X X X X the X brown

fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16

slide-64
SLIDE 64

Transition-Based Parsing using BiLSTMs

LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b concat

Vthe Vfox Vjumped Vroot Vbrown

X X X X the X brown

fox jumped root Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16

slide-65
SLIDE 65

Transition-Based Parsing using BiLSTMs

LSTM f LSTM b LSTM f LSTM b LSTM f LSTM b concat concat concat concat LSTM f LSTM b MLP concat LSTM f LSTM b

X X

Vthe Vfox Vjumped Vroot

X

Vbrown

X the X brown

fox jumped root (score(LEFT−ARC),score(RIGHT−ARC),score(SHIFT),score(SWAP)) Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 16

slide-66
SLIDE 66

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 17

slide-67
SLIDE 67

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 17

slide-68
SLIDE 68

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 17

slide-69
SLIDE 69

Experiments

Static (baseline) Static-Dynamic (this work) Pseudo-Projective Projective (baseline)

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18

slide-70
SLIDE 70

Experiments

Static (baseline) Static-Dynamic (this work) Pseudo-Projective Projective (baseline)

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18

slide-71
SLIDE 71

Experiments

Static (baseline) Static-Dynamic (this work) Pseudo-Projective Projective (baseline)

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18

slide-72
SLIDE 72

Experiments

Static (baseline) Static-Dynamic (this work) Pseudo-Projective Projective (baseline)

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 18

slide-73
SLIDE 73

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19

slide-74
SLIDE 74

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19

slide-75
SLIDE 75

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19

slide-76
SLIDE 76

Experiments

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 19

slide-77
SLIDE 77

Conclusion

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-78
SLIDE 78

Conclusion

Conclusion

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-79
SLIDE 79

Conclusion

Conclusion We integrated a swap transition into arc-hybrid

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-80
SLIDE 80

Conclusion

Conclusion We integrated a swap transition into arc-hybrid We defined an oracle that is partially dynamic for this system

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-81
SLIDE 81

Conclusion

Conclusion We integrated a swap transition into arc-hybrid We defined an oracle that is partially dynamic for this system Our system benefits from error exploration

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-82
SLIDE 82

Conclusion

Conclusion We integrated a swap transition into arc-hybrid We defined an oracle that is partially dynamic for this system Our system benefits from error exploration Future Work

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-83
SLIDE 83

Conclusion

Conclusion We integrated a swap transition into arc-hybrid We defined an oracle that is partially dynamic for this system Our system benefits from error exploration Future Work Proper hyperparameter tuning

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-84
SLIDE 84

Conclusion

Conclusion We integrated a swap transition into arc-hybrid We defined an oracle that is partially dynamic for this system Our system benefits from error exploration Future Work Proper hyperparameter tuning A fully dynamic oracle?

Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 20

slide-85
SLIDE 85

References

Miryam de Lhoneux, Yan Shao, Ali Basirat, Eliyahu Kiperwasser, Sara Stymne, Yoav Goldberg, and Joakim Nivre.

  • 2017. From raw text to universal dependencies - look, no tags! In Proceedings of the CoNLL 2017 Shared

Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, Vancouver, Canada, pages 207–217. Yoav Goldberg and Joakim Nivre. 2013. Training deterministic parsers with non-deterministic oracles. Transactions

  • f the Association for Computational Linguistics 1:403–414.

Eliyahu Kiperwasser and Yoav Goldberg. 2016. Simple and accurate dependency parsing using bidirectional LSTM feature representations. Transactions of the Association for Computational Linguistics 4:313–327. Marco Kuhlmann, Carlos Gómez-Rodríguez, and Giorgio Satta. 2011. Dynamic programming algorithms for transition-based dependency parsers. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL). pages 673–682. Joakim Nivre. 2009. Non-projective dependency parsing in expected linear time. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP (ACL-IJCNLP). pages 351–359. Miryam de Lhoneux, Sara Stymne and Joakim Nivre Non-Projective Parsing with a Static-Dynamic Oracle 21