TUPA at MRP 2019 A Multi-Task Baseline System CoNLL Shared Task 3 November 2019 1 / 9 Daniel Hershcovich 1 , Ofjr Arviv 2 1 University of Copenhagen 2 Hebrew University of Jerusalem
Transition-Based UCCA Parser look (Hershcovich et al., 2017) A H A C C poster E my R at P D After should A you U , H P C break F the L 2 / 9
Scarcity of Training Data DM AMR UCCA 3 / 9
Multi-Task Parser top { you ARG1 poster i poss After the break , you should look at my poster ARG2 BV ARG0 ARG1 ARG1 ARG2 break-02 ARG1 ARG2 poss } Multi-task improves UCCA parsing (Hershcovich et al., 2018). Private Shared After break my poster … Classifjer op1 4 / 9 after look After L the F break C P H , U you A should D P look-01 at A H A C C poster E my R e ARG2 m i t ARG0
Multi-Task Parser top { you ARG1 poster i poss After the break , you should look at my poster ARG2 BV ARG0 ARG1 ARG1 ARG2 break-02 ARG1 ARG2 poss } Multi-task improves UCCA parsing (Hershcovich et al., 2018). Private Shared After break my poster … Classifjer op1 4 / 9 after look After L the F break C P H , U you A should D P look-01 at A H A C C poster E my R e ARG2 m i t ARG0
MRP op2=York John TOP Intermediate graph representation, name city ARG0 name name person op1 after name op3=City name op1=New op1=John name extended transition system. move-01 after graduate-01 op1 person name 5 / 9 city name ARG0 � ℓ � -01 ARG2 ARG2 time time ⇔ Anchor ARG0 r ARG0 o h c op= � ℓ � op= � ℓ � � ℓ � -01 n A r Anchor r Anchor A o o n h h c c c h n n o A A r After graduation , moved at New York City
Transition Classifjer MLP at the… The fox BiLSTM + BERT (Devlin et al., 2019). gazed at the… fox Private BiLSTM transition fox MLP transition MLP transition MLP transition MLP transition gazed 6 / 9 The at the… fox at the… The The fox gazed gazed at the… gazed S G S G S G S G S G B B B B B Shared BiLSTM ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕
Transition Classifjer MLP at the… The fox BiLSTM + BERT (Devlin et al., 2019). gazed at the… fox Private BiLSTM transition fox MLP transition MLP transition MLP transition MLP transition gazed 6 / 9 The at the… fox at the… The The fox gazed gazed at the… gazed S G S G S G S G S G B B B B B Shared BiLSTM ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕ ⊕
Results Baseline: single-task + multi-task. Best System TUPA Multi-Task TUPA Single-Task Full Evaluation MRP F-score (%). TUPA scores are post-evaluation. Amazon HIT-SCIR SUDA–Alibaba Saarland SJTU HIT-SCIR 7 / 9 AMR Overall DM EDS PSD UCCA 95 . 5 91 . 9 91 . 3 86 . 2 84 . 9 81 . 7 79 . 4 77 . 7 75 . 7 75 . 6 73 . 4 70 . 9 64 . 1 66 66 62 . 2 53 . 9 39
Results Baseline: single-task + multi-task. Best System TUPA Multi-Task TUPA Single-Task Full Evaluation MRP F-score (%). TUPA scores are post-evaluation. Amazon HIT-SCIR SUDA–Alibaba Saarland SJTU HIT-SCIR 7 / 9 AMR Overall DM EDS PSD UCCA 95 . 5 91 . 9 91 . 3 86 . 2 84 . 9 81 . 7 79 . 4 77 . 7 75 . 7 75 . 6 73 . 4 70 . 9 64 . 1 66 66 62 . 2 53 . 9 39
TUPA at MRP 2019 A Multi-Task Baseline System CoNLL Shared Task 3 November 2019 8 / 9 Daniel Hershcovich 1 , Ofjr Arviv 2 1 University of Copenhagen 2 Hebrew University of Jerusalem
References Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proc. of NAACL , pages 4171–4186. Daniel Hershcovich, Omri Abend, and Ari Rappoport. 2017. A transition-based directed acyclic graph parser for UCCA. In Proc. of ACL , pages 1127–1138. Daniel Hershcovich, Omri Abend, and Ari Rappoport. 2018. Multitask parsing across semantic representations. In Proc. of ACL , pages 373–385. 9 / 9
Recommend
More recommend
