Introducing a Lexicon of Verbal Polarity Shifters for English Marc - - PowerPoint PPT Presentation

▶
introducing a lexicon of verbal polarity shifters for
SMART_READER_LITE
LIVE PREVIEW

Introducing a Lexicon of Verbal Polarity Shifters for English Marc - - PowerPoint PPT Presentation

Dec 07, 2023 391 likes •886 views

Introducing a Lexicon of Verbal Polarity Shifters for English Marc Schulder Josef Ruppenhofer Michael Wiegand Stephanie Kser Spoken Language Systems Institute for German Language Saarland University, Germany Mannheim, Germany What are

slide-1
SLIDE 1

Introducing a Lexicon of Verbal Polarity Shifters for English

Marc Schulder Michael Wiegand Stephanie Köser Josef Ruppenhofer

Spoken Language Systems Saarland University, Germany Institute for German Language Mannheim, Germany

slide-2
SLIDE 2

Marc Schulder Saarland University

What are Polarity Shifters?

2

slide-3
SLIDE 3

Marc Schulder Saarland University

Shifters vs Negation

3

Negation Polarity Shifters Example He did [not have [hope]+]-. He [abandoned [hope]+]-.

slide-4
SLIDE 4

Marc Schulder Saarland University

Shifters vs Negation

3

Negation Polarity Shifters Example He did [not have [hope]+]-. He [abandoned [hope]+]-. Word Type Closed Class Open Class

slide-5
SLIDE 5

Marc Schulder Saarland University

Shifters vs Negation

3

Negation Polarity Shifters Example He did [not have [hope]+]-. He [abandoned [hope]+]-. Word Type Closed Class Open Class Resource Creation Cheap Expensive

slide-6
SLIDE 6

Marc Schulder Saarland University

Shifters vs Negation

3

Negation Polarity Shifters Example He did [not have [hope]+]-. He [abandoned [hope]+]-. Word Type Closed Class Open Class Resource Creation Cheap Expensive Existing polarity classifiers
 can process negation,
 but fail to detect polarity shifters
 due to a lack of resources.

slide-7
SLIDE 7

Marc Schulder Saarland University

Goal

Create a Lexicon


  • f


Verbal Polarity Shifters

4

slide-8
SLIDE 8

Marc Schulder Saarland University

Goal

Create a Lexicon


  • f


Verbal Polarity Shifters

4

Main sentence predicate ⇒ far reaching scope

slide-9
SLIDE 9

Marc Schulder Saarland University

Title Text Overview

  • Polarity Shifters
  • Related Work
  • Word Sense Ambiguity
  • Shifter Scope
  • Lexicon
  • Annotation Process
  • Lexicon Example
  • Conclusion

5

slide-10
SLIDE 10

Marc Schulder Saarland University

Related Work

6

Supervised Bootstrapping

(Schulder et al., 2017)

Complete Annotation

(this work)

Input Resource WordNet WordNet Lexicon Size 3,000 verbs 10,500 verbs Shifter Labels Lemma Word Sense Additional Information

  • Shifter Scope
slide-11
SLIDE 11

Marc Schulder Saarland University

Word Sense Ambiguity

  • 50% of verbs are polysemous.
  • 12% of verbs are shifters in at least one word sense.
  • Among polysemous verbal shifters,

  • nly 23% are shifters in all their word senses.

7

Mark down: Reduce in price Shifter The agency [marked down [their assets]+]-. Mark down: Write down No Shifter She [marked down [his confession of guilt]-]-.

slide-12
SLIDE 12

Marc Schulder Saarland University

Shifter Scope

When a phrase contains a polarity shifter, you need to know what part of the phrase it can affect.(Wiegand et al., 2017, GSCL) [ The villain]- defeated [the hero]+. [ The villain]- surrendered [to the hero]+.

8

slide-13
SLIDE 13

Marc Schulder Saarland University

Shifter Scope

When a phrase contains a polarity shifter, you need to know what part of the phrase it can affect.(Wiegand et al., 2017, GSCL) [ The villain]- defeated [the hero]+. [ The villain]- surrendered [to the hero]+.

8

  • dobj
slide-14
SLIDE 14

Marc Schulder Saarland University

Shifter Scope

When a phrase contains a polarity shifter, you need to know what part of the phrase it can affect.(Wiegand et al., 2017, GSCL) [ The villain]- defeated [the hero]+. [ The villain]- surrendered [to the hero]+.

8

+ subj

  • dobj
slide-15
SLIDE 15

Marc Schulder Saarland University

Shifter Scope

When a phrase contains a polarity shifter, you need to know what part of the phrase it can affect.(Wiegand et al., 2017, GSCL) [ The villain]- defeated [the hero]+. [ The villain]- surrendered [to the hero]+. Scope annotated for dependency relations.
 Assumes active sentence.

8

+ subj

  • dobj
slide-16
SLIDE 16

Marc Schulder Saarland University

Shifter Scope

9

Clausal
 Complement
 1% Subject
 18% Prepositional
 Object
 10% Direct Object
 71%

slide-17
SLIDE 17

Marc Schulder Saarland University

Shifter Scope

9

Verbal shifters
 affect not only 
 direct objects Clausal
 Complement
 1% Subject
 18% Prepositional
 Object
 10% Direct Object
 71%

slide-18
SLIDE 18

Marc Schulder Saarland University

Title Text Overview

  • Polarity Shifters
  • Related Work
  • Word Sense Ambiguity
  • Shifter Scope
  • Lexicon
  • Annotation Process
  • Lexicon Example
  • Conclusion

10

slide-19
SLIDE 19

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3

slide-20
SLIDE 20

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3

slide-21
SLIDE 21

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2

slide-22
SLIDE 22

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter?

slide-23
SLIDE 23

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? Sense Definition Lexicon Examples

slide-24
SLIDE 24

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? Sense Definition Lexicon Examples No :(

slide-25
SLIDE 25

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? Sense Definition Lexicon Examples ✘

slide-26
SLIDE 26

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? Sense Definition Lexicon Examples ✘

slide-27
SLIDE 27

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? Sense Definition Lexicon Examples ✘

slide-28
SLIDE 28

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? Sense Definition Lexicon Examples Yes! ✔ ✘

slide-29
SLIDE 29

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? What Scope? Sense Definition Lexicon Examples ✔ ✘

slide-30
SLIDE 30

Marc Schulder Saarland University

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 Is Shifter? What Scope? Sense Definition Lexicon Examples ✔ ✘

slide-31
SLIDE 31

Marc Schulder Saarland University

Subj

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 ✔ ✘

slide-32
SLIDE 32

Marc Schulder Saarland University

Subj

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 ✔ ✘

slide-33
SLIDE 33

Marc Schulder Saarland University

Subj

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 ✔ ✘ Sense = Lemma-Synset pair

slide-34
SLIDE 34

Marc Schulder Saarland University

Subj

Annotation Workflow

11

Lemma 1 Lemma 2 Lemma 3 Sense 1 Sense 2 ✔ ✘ Sense = Lemma-Synset pair Observation:
 Sense annotation
 considerably faster than lemma annotation

slide-35
SLIDE 35

Marc Schulder Saarland University

Annotators

Expert Annotator: Experience in linguistics and annotation work Inter-annotator Agreement: 2nd annotator labelled 400 word senses Cohen's 𝝀 = 0.73 ⇒ Substantial agreement Both annotators are authors of this paper.

12

slide-36
SLIDE 36

Marc Schulder Saarland University

Lexicon Example

13

Blow out Synset 00436247 SUBJ Shifter melt, break, or become otherwise unusable Blow out Synset 02767855 DOBJ Shifter put out, as of fires, flames, or lights Blow out Synset 02766970

  • No Shifter

erupt in an uncontrolled manner

slide-37
SLIDE 37

Marc Schulder Saarland University

Conclusion

Summary
 We introduced a lexicon of English verbal shifters:

  • Covers all verbs in WordNet
  • Annotations for each word sense
  • Shifter labels
  • Shifter scope labels

Data

  • https://github.com/uds-lsv/lrec2018

Future Work

  • Nouns, adjectives
  • Other languages

14

slide-38
SLIDE 38

Marc Schulder Saarland University

Title Text Thank You

slide-39
SLIDE 39

Marc Schulder Saarland University

References

  • N. Jindal and B. Liu. 2008. Opinion Spam and
  • Analysis. In Proceedings of WSDM.
  • S. Kiritchenko and S.M. Mohammad. 2016. The

Effect of Negators, Modals, and Degree Adverbs on Sentiment Composition. In Proceedings of WASSA@NAACL/HLT.

  • G. Miller, R. Beckwith, C. Fellbaum, D. Gross, and
  • K. Miller. 1990. Introduction to WordNet: An

Online Lexical Database. International Journal of Lexicography, 3:235–244.

  • C. Paradis, and C. Willners. 2006. Antonymy and

Negation: The Boundedness Hypothesis. Journal of Pragmatics, 38(7):1051–1080.

  • L. Polanyi, and A. Zaenen. 2006. Contextual

Valence Shifters . In J.G. Shanahan, et al., editors, Computing Attitude and Affect in Text: Theory and Applications, pages 1–10, Springer Netherlands.

  • J. Ruppenhofer, and J. Brandes. 2015. Extending

effect annotation with lexical decomposition. In Proceedings of WASSA@EMNLP .

  • N. Schneider, D. Hovy, A. Johannsen, and M.
  • Carpuat. 2016. SemEval-2016 Task 10: Detecting

Minimal Semantic Units and their Meanings (DiMSUM). In Proceedings of SemEval@NAACL- HLT.

  • M. Schulder, M. Wiegand, J. Ruppenhofer, and B.
  • Roth. 2017. Towards Bootstrapping a Polarity

Shifter Lexicon using Linguistic Features. In Proceedings of IJCNLP.

  • M. Wiegand, A. Balahur, B. Roth, D. Klakow, and
  • A. Montoyo. 2010. A Survey on the Role of

Negation in Sentiment Analysis. In Proceedings

  • f NeSp-NLP

.

  • M. Wiegand, M. Wolf, and J. Ruppenhofer. 2017.

Negation Modeling for German Polarity

  • Classification. In Proceedings of GSCL.
  • T. Wilson, J. Wiebe, and P

. Hoffmann. 2005. Recognizing Contextual Polarity in Phrase-level Sentiment Analysis. In Proceedings of HLT/ EMNLP .

16

slide-40
SLIDE 40

Marc Schulder Saarland University

Conclusion

Summary
 We introduced a lexicon of English verbal shifters:

  • Covers all verbs in WordNet
  • Annotation for each word sense
  • Shifter labels
  • Shifter scope labels

Data

  • https://github.com/uds-lsv/lrec2018

Future Work

  • Nouns, adjectives
  • Other languages

17

slide-41
SLIDE 41

Marc Schulder Saarland University

Real World Distribution

How frequent are shifters in actual corpora? Corpus: Amazon Product Reviews(Jindal and Liu, 2008) 5.8 million reviews Popular sentiment analysis domain Heuristic:

  • 1. List all lemmas that have at least one shifter sense
  • 2. Count occurrences of shifter lemmas
  • 3. Normalize over shifter sense ratio of lemma

Example: blow out: 2290 occur. * ⅔ shifter senses = 1527 shifter

  • ccur.

18

slide-42
SLIDE 42

Marc Schulder Saarland University

Real World Distribution

Verbal Shifters
 Vocabulary: 1163 words
 (95% of shifters in lexicon)
 Raw count: 34 million
 Corrected count: 13 million
 (5% of verbs in corpus)
 Negation
 Vocabulary: 15 words (Wilson et al., 2005)
 Count: 13 million

19

slide-43
SLIDE 43

Marc Schulder Saarland University

Fun Facts

  • 1. Annotating per word sense is faster than per lemma.
  • 2. Corpus frequency tests show that verbal shifters are as

frequent as negations

20

slide-44
SLIDE 44

Marc Schulder Saarland University

Shifter Scope

Subject (subj): [[The villain]- surrendered]+ [to the hero]+. Direct Object (dobj): The storm [ruined [their party]+ ]-. Prepositional Object (pobj): The wall [shielded them [from the explosion]- ]+. Clausal Complement (comp): He [failed [to pass the exam]+ ]-.

21 subj dobj pobj comp

slide-45
SLIDE 45

Marc Schulder Saarland University

Shifter Scope: Prepositions

22

  • ther

10 % at 4 %

  • n

4 % for 6 %

  • f

20 % from 57 %

slide-46
SLIDE 46

Marc Schulder Saarland University

The Trouble with Synsets

Synsets do not model syntactic information He [discarded [the evidence]+]-.
 ⇒ direct object He [disposed [of the evidence]+]-.
 ⇒ prepositional object

23

slide-47
SLIDE 47

Marc Schulder Saarland University

The Trouble with Synsets

Synsets do not model syntactic information He [discarded [the evidence]+]-.
 ⇒ direct object He [disposed [of the evidence]+]-.
 ⇒ prepositional object

23

WordNet S: (v) discard, dispose, [...] (throw or cast away) "Put away your worries"

slide-48
SLIDE 48

Marc Schulder Saarland University

Annotation Granularity

24

Lemma Lemma 1 + Sense 1 Lemma 1 + Sense 2 Lemma 1 + Sense 3 Synset Lemma 1 + Sense 1 Lemma 2 + Sense 1 Lemma 3 + Sense 1 Lemma-Sense Pair Lemma 1 Sense 1