Discourse Structure
LING 571 — Deep Processing Methods in NLP November 25, 2019 Shane Steinert-Threlkeld
1
Discourse Structure LING 571 Deep Processing Methods in NLP - - PowerPoint PPT Presentation
Discourse Structure LING 571 Deep Processing Methods in NLP November 25, 2019 Shane Steinert-Threlkeld 1 Announcements Hw8: 94.8 mean; great job! No class on Wednesday! HW9 due December 4 2 Ambiguity of the Week 3 Roadmap
LING 571 — Deep Processing Methods in NLP November 25, 2019 Shane Steinert-Threlkeld
1
2
3
4
5
681)
6
7
back to
8
*Not all anaphora is referential! e.g. “No dancer hurt their knee.”
9
10
11
Discourse Model
corefer
12
(h/t Ryan Georgi)
13
14
15
16
Begin at the noun phrase (NP) node immediately dominating the pronoun
X
17
Go up the tree to the first NP or sentence (S) node encountered. Call this node X, and call the path used to reach it p.
X
18
Traverse all branches below node X to the left of path p in a left-to-right, breadth-first fashion. Propose as the antecedent any encountered NP node that has an NP or S node between it and X.
✘
19
If node X is the highest S node in the sentence, traverse the surface parse trees of previous sentences in the text in order of recency, the most recent first; each tree is traversed in a left-to- right, breadth-first manner, and when an NP node is encountered, it is proposed as antecedent.
20
21
22
X p 23
X p 24
✘
No NP or S between “he” NP and X
X p p X 25
p X 26
✘
“536” can’t be “moved”!
27
p X
X p 28
p X
29
X p
30
X p
31
X p
✘
Moving castles? 🤕
32
X p
33
(Winograd, 1972)* *more on this later
34
35
36
37
38
NPi NPj NPk NPl NPm
39
NPi NPj NPk NPl NPm
0.9 0.23 0.96 0.77 0.1 0.7
40
NPi NPj NPk NPl NPm Ea Eb
41
42
43
44
45
46
47
48
No significant improvement over global embedding baseline [BERT slightly better] Liu et al 2019
large]?
received] help?
[successful/available]?
reluctant to [answer/repeat] the question?
49
50
Heavily supervised
51
crooked.”
gap
52
53
54
55
56
57
58
59
60
61
62
63
64
65
S1 – Armin went to the bank to deposit his paycheck S2 – He then took a train to Kim’s car dealership. S3 – He needed to buy a car. S4 – The company he works for now isn’t near any public transportation. S5 – He also wanted to talk to Kim about their softball league.
Adapted from J&M 2nd ed p. 690
66
S1 – Armin went to the bank to deposit his paycheck S2 – He then took a train to Kim’s car dealership. S3 – He needed to buy a car. S4 – The company he works for now isn’t near any public transportation. S5 – He also wanted to talk to Kim about their softball league.
Adapted from J&M 2nd ed p. 690
S1 – Armin went to the bank to deposit his paycheck S2 – He then took a train to Kim’s car dealership. S3 – He needed to buy a car. S4 – The company he works for now isn’t near any public transportation. S5 – He also wanted to talk to Kim about their softball league.
67
Adapted from J&M 2nd ed p. 690
S1 – Armin went to the bank to deposit his paycheck S2 – He then took a train to Kim’s car dealership. S3 – He needed to buy a car. S4 – The company he works for now isn’t near any public transportation. S5 – He also wanted to talk to Kim about their softball league.
68
Adapted from J&M 2nd ed p. 690
69
S1 – Armin went to the bank to deposit his paycheck S2 – He then took a train to Kim’s car dealership. S3 – He needed to buy a car. S4 – The company he works for now isn’t near any public transportation. S5 – He also wanted to talk to Kim about their softball league.
Adapted from J&M 2nd ed p. 690
70
S1 – Armin went to the bank to deposit his paycheck S2 – He then took a train to Kim’s car dealership. S3 – He needed to buy a car. S4 – The company he works for now isn’t near any public transportation. S5 – He also wanted to talk to Kim about their softball league.
Adapted from J&M 2nd ed p. 690
71
72
73
74
75
John went to his favorite music store to buy a piano. He had frequented the store for many years. He was excited that he could finally buy a piano.
John went to his favorite music store to buy a piano. It was a store John had frequented for many years. He was excited that he could finally buy a piano. It was closing just as John arrived.
76
77
78
demarcated adverbial PP
79
80
81
82
83
84
85