Comprehensive Annotation of Multiword Expressions in a Social Web - - PowerPoint PPT Presentation

▶
comprehensive annotation of multiword expressions in a
SMART_READER_LITE
LIVE PREVIEW

Comprehensive Annotation of Multiword Expressions in a Social Web - - PowerPoint PPT Presentation

Jun 20, 2023 283 likes •1.04k views

Comprehensive Annotation of Multiword Expressions in a Social Web Corpus Nathan Schneider, Spencer Onuffer, Nora Kazour, Emily Danchik, Michael T . Mordowanec, Henrietta Conrad, Noah A. Smith LREC May 28, 2014 2 CMWE, a text corpus

slide-1
SLIDE 1

Comprehensive Annotation of Multiword Expressions in a Social Web Corpus

Nathan Schneider, Spencer Onuffer, Nora Kazour, Emily Danchik, Michael T . Mordowanec, Henrietta Conrad, Noah A. Smith
 LREC • May 28, 2014

slide-2
SLIDE 2

2

slide-3
SLIDE 3

CMWE, a text corpus comprehensively annotated with multiword expressions

2

slide-4
SLIDE 4

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews

2

slide-5
SLIDE 5

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews ✴ fully heterogeneous MWEs

2

slide-6
SLIDE 6

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews ✴ fully heterogeneous MWEs ✴ shallow groupings, allowing gaps

2

slide-7
SLIDE 7

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews ✴ fully heterogeneous MWEs ✴ shallow groupings, allowing gaps ✴ strong vs. weak

2

slide-8
SLIDE 8

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews ✴ fully heterogeneous MWEs ✴ shallow groupings, allowing gaps ✴ strong vs. weak tinyurl.com/mwecorpus

2

slide-9
SLIDE 9

Outline

3

slide-10
SLIDE 10

Outline

  • multiword expressions
  • annotation process
  • the corpus

3

slide-11
SLIDE 11

4

slide-12
SLIDE 12

4

daddy longlegs

slide-13
SLIDE 13

4

daddy longlegs

slide-14
SLIDE 14

4

daddy longlegs Noam Chomsky

slide-15
SLIDE 15

5

Noam Chomsky daddy longlegs

slide-16
SLIDE 16

6

slide-17
SLIDE 17

6

The aliens will destroy Earth unless we their demands.

slide-18
SLIDE 18

6

The aliens will destroy Earth unless we accept their demands.

slide-19
SLIDE 19

6

The aliens will destroy Earth unless we accept agree to accede to yield to give in to their demands.

slide-20
SLIDE 20

6

The aliens will destroy Earth unless we accept agree to accede to yield to give in to comply with cooperate with go along with their demands.

slide-21
SLIDE 21

7

  • sdfsf

Jonathan Huang

slide-22
SLIDE 22

7

  • sdfsf

Jonathan Huang

Noam_Chomsky daddy_longlegs give_in_to

slide-23
SLIDE 23

8

Noam_Chomsky refused to give_in_to the vicious daddy_longlegs .

slide-24
SLIDE 24

9

Noam_Chomsky refused to give_in_to the vicious daddy_longlegs .

slide-25
SLIDE 25

10

Noam_Chomsky refused to give_in_to the vicious daddy_longlegs .

slide-26
SLIDE 26

11

Noam_Chomsky refused to give_in_to the vicious daddy_longlegs .

slide-27
SLIDE 27

12

Alan_Black refused to give_in_to the vicious daddy_longlegs . Noam_Chomsky refused to give_in_to the vicious daddy_longlegs .

slide-28
SLIDE 28

12

Alan_Black refused to give_in_to the vicious daddy_longlegs .

Lexical segmentation

Noam_Chomsky refused to give_in_to the vicious daddy_longlegs .

slide-29
SLIDE 29

Definition

13

slide-30
SLIDE 30

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

13

slide-31
SLIDE 31

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

  • idiomatic = not fully predictable in 


form, function, and/or frequency

13

slide-32
SLIDE 32

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

  • idiomatic = not fully predictable in 


form, function, and/or frequency

  • unusual morphosyntax: Me/*Him neither; 


by and large; plural of daddy longlegs?

13

slide-33
SLIDE 33

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

  • idiomatic = not fully predictable in 


form, function, and/or frequency

  • unusual morphosyntax: Me/*Him neither; 


by and large; plural of daddy longlegs?

  • non- or semi-compositional: 


ice cream, daddy longlegs, pay attention

13

slide-34
SLIDE 34

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

  • idiomatic = not fully predictable in 


form, function, and/or frequency

  • unusual morphosyntax: Me/*Him neither; 


by and large; plural of daddy longlegs?

  • non- or semi-compositional: 


ice cream, daddy longlegs, pay attention

  • statistically collocated:


p(highly unlikely) > p(strongly unlikely)

13

slide-35
SLIDE 35

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

  • idiomatic = not fully predictable in 


form, function, and/or frequency

  • unusual morphosyntax: Me/*Him neither; 


by and large; plural of daddy longlegs?

  • non- or semi-compositional: 


ice cream, daddy longlegs, pay attention

  • statistically collocated:


p(highly unlikely) > p(strongly unlikely)

14

slide-36
SLIDE 36

Definition

  • Multiword expression (MWE): 2 or more
  • rthographic words/lexemes that function

together as an idiomatic whole

  • idiomatic = not fully predictable in 


form, function, and/or frequency

  • unusual morphosyntax: Me/*Him neither; 


by and large; plural of daddy longlegs?

  • non- or semi-compositional: 


ice cream, daddy longlegs, pay attention

  • statistically collocated:


p(highly unlikely) > p(strongly unlikely)

14

SPECIALLY LEARNED

slide-37
SLIDE 37

Challenges

15

slide-38
SLIDE 38

Challenges

  • Not superficially apparent in text
  • Number/frequency
  • Too many expressions to list all of them
  • Individually rare, but frequent in aggregate
  • Diversity
  • Many different construction types
  • Semantically unrestricted
  • Can be gappy

15

slide-39
SLIDE 39

16

slide-40
SLIDE 40

16

Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. The structure of this paper is as follows.

slide-41
SLIDE 41

16 Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. e structure of this paper is as follows.

pay dry out attention (to) pick up where left off __

slide-42
SLIDE 42

16 Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. e structure of this paper is as follows.

pay dry the clothes

  • ut

attention (to) pick up where left off __

slide-43
SLIDE 43

16 Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. e structure of this paper is as follows.

pay dry the clothes out attention (to) pick up where left off __

slide-44
SLIDE 44

16 Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. e structure of this paper is as follows.

pay dry the clothes out close attention (to) pick up where left off __

slide-45
SLIDE 45

16 Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. e structure of this paper is as follows.

pay dry the clothes out close attention (to) pick up where left off __ no attention was paid (to)

slide-46
SLIDE 46

16 Fred Jelinek daddy longlegs, hot dog dry out depend on, come across pay attention (to) put up with, give in (to) under the weather cut and dry in spite of pick up where __ left off easy as pie You’re welcome. To each his own. e structure of this paper is as follows.

pay dry the clothes out close attention (to) they pick up where left off no attention was paid (to)

slide-47
SLIDE 47

Examples

My wife had taken_ her '07_Ford_Fusion _in for a routine oil_change .

17

slide-48
SLIDE 48

Examples

They gave me the run around and missing paperwork only to call back to tell me someone else wanted her and I would need to come in and put down a deposit .

18

slide-49
SLIDE 49

Examples

They gave_ me _the_run_around and missing paperwork only to call_back to tell me someone else wanted her and I would need to come_in and put_down~ a ~deposit .

19

slide-50
SLIDE 50

Examples

They gave_ me _the_run_around and missing paperwork only to call_back to tell me someone else wanted her and I would need to come_in and put_down~ a ~deposit .

19

weak MWE (collocation); cf. highly~recommended

slide-51
SLIDE 51

Examples

Among the animals that were available to touch were pony's , camels and EVEN AN OSTRICH !!!

20

slide-52
SLIDE 52

Examples

Among the animals that were available to touch were pony's , camels and EVEN AN OSTRICH !!!

20

No MWEs here. (This sentence is in the minority: 
 57% of all sentences/72% >10 words contain an MWE.)

slide-53
SLIDE 53

21

slide-54
SLIDE 54

21

slide-55
SLIDE 55

21

slide-56
SLIDE 56

21

slide-57
SLIDE 57

21

slide-58
SLIDE 58

22

slide-59
SLIDE 59

22

slide-60
SLIDE 60

22

slide-61
SLIDE 61

22

slide-62
SLIDE 62

The corpus

23

slide-63
SLIDE 63

The corpus

  • The entire Reviews subsection of the

English Web Treebank (Bies et al. 2012), fully annotated for MWEs

  • 723 reviews
  • 3,800 sentences
  • 55,000 words
  • found 3,500 MWE instances

23

slide-64
SLIDE 64

The corpus

  • The entire Reviews subsection of the

English Web Treebank (Bies et al. 2012), fully annotated for MWEs

  • 723 reviews
  • 3,800 sentences
  • 55,000 words
  • found 3,500 MWE instances
  • Every sentence: negotiated consensus

between at least 2 annotators

  • IAA between pairs: ~77%

23

slide-65
SLIDE 65

Other English corpora

24

slide-66
SLIDE 66

Other English corpora

  • SemCor (Miller et al. 1993)
  • Lexical annotation with WordNet synsets
  • NEs, compound nominals, some phrasal

verbs

24

slide-67
SLIDE 67

Other English corpora

  • SemCor (Miller et al. 1993)
  • Lexical annotation with WordNet synsets
  • NEs, compound nominals, some phrasal

verbs

  • Prague CEDT (Hajič et al. 2012)
  • NEs, light verb constructions, phrasal

idioms, multiword tlemmas

24

slide-68
SLIDE 68

Other English corpora

  • SemCor (Miller et al. 1993)
  • Lexical annotation with WordNet synsets
  • NEs, compound nominals, some phrasal

verbs

  • Prague CEDT (Hajič et al. 2012)
  • NEs, light verb constructions, phrasal

idioms, multiword tlemmas

  • Wiki50 (Vincze et al. 2011)
  • NEs, compound nominals, LVCs, VPCs,

phrasal idioms

24

slide-69
SLIDE 69

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews ✴ fully heterogeneous MWEs ✴ shallow groupings, allowing gaps ✴ strong vs. weak tinyurl.com/mwecorpus

25

slide-70
SLIDE 70
slide-71
SLIDE 71

Preview: 
 A tool for identifying MWEs in context
 
 (sequence tagging, but with gaps!)


slide-72
SLIDE 72

Preview: 
 A tool for identifying MWEs in context
 
 (sequence tagging, but with gaps!)


  • Discriminative lexical semantic

segmentation with gaps: running the MWE

  • gamut. Nathan Schneider, Emily Danchik,

Chris Dyer, and Noah A. Smith. TACL 2014.

slide-73
SLIDE 73

CMWE, a text corpus comprehensively annotated with multiword expressions

✦ 55k words of English web reviews ✴ fully heterogeneous MWEs ✴ shallow groupings, allowing gaps ✴ strong vs. weak tinyurl.com/mwecorpus

27

Many_thanks


(*Several thanks)

  • Thanks_a_million


(*Thanks a thousand)


Thanks_a_lot


(?Lots of thanks)


slide-74
SLIDE 74

28

POS MWEs pattern contig. gappy most frequent types (lowercased lemmas) and their counts

N_N

331 1 customer service: 31

  • il change: 9

wait staff: 5 garage door: 4

ˆ_ˆ

325 1 santa fe: 4

  • dr. shady: 4

V_P

217 44 work with: 27 deal with: 16 look for: 12 have to: 12 ask for: 8

V_T

149 42 pick up: 15 check out: 10 show up: 9 end up: 6 give up: 5

V_N

31 107 take time: 7 give chance: 5 waste time: 5 have experience: 5

A_N

133 3 front desk: 6 top notch: 6 last minute: 5

V_R

103 30 come in: 12 come out: 8 take in: 7 stop in: 6 call back: 5

D_N

83 1 a lot: 30 a bit: 13 a couple: 9

P_N

67 8

  • n time: 10

in town: 9 in fact: 7

R_R

72 1 at least: 10 at best: 7 as well: 6

  • f course: 5

at all: 5

V_D_N

46 21 take the time: 11 do a job: 8

V~N

7 56 do job: 9 waste time: 4

ˆ_ˆ_ˆ

63 home delivery service: 3 lake forest tots: 3

R~V

49 highly recommend: 43 well spend: 1 pleasantly surprise: 1

P_D_N

33 6

  • ver the phone: 4
  • n the side: 3

at this point: 2

  • n a budget: 2

A_P

39 pleased with: 7 happy with: 6 interested in: 5

P_P

39

  • ut of: 10

due to: 9 because of: 7

V_O

38 thank you: 26 get it: 2 trust me: 2

V_V

8 30 get do: 8 let know: 5 have do: 4

N~N

34 1 channel guide: 2 drug seeker: 2 room key: 1 bus route: 1

A~N

31 hidden gem: 3 great job: 2 physical address: 2 many thanks: 2 great guy: 1

V_N_P

16 15 take care of: 14 have problem with: 5

N_V

18 10 mind blow: 2 test drive: 2 home make: 2

ˆ_$

28 bj s: 2 fraiser ’s: 2 ham s: 2 alan ’s: 2 max ’s: 2

D_A

28 a few: 13 a little: 11

R_P

25 1 all over: 3 even though: 3 instead of: 2 even if: 2