Algorithms for NLP CS 11-711 Fall 2020 Lecture 11: Syntactic - PowerPoint PPT Presentation

Dependency parsing root dobj Recovering shallow semantics poss det nsubj My dog ate a sausage root D PN N V N ■ Some semantic information can be (approximately) derived from syntactic information ■ Subjects (nsubj) are (often) agents : initiators / doers of an action ■ Direct objects (dobj) are (often) patients : affected entities ■ Even for agents and patients, consider: ■ Mary is baking a cake in the oven 12

Dependency parsing root dobj Recovering shallow semantics poss det nsubj My dog ate a sausage root D PN N V N ■ Some semantic information can be (approximately) derived from syntactic information ■ Subjects (nsubj) are (often) agents : initiators / doers of an action ■ Direct objects (dobj) are (often) patients : affected entities ■ Even for agents and patients, consider: ■ Mary is baking a cake in the oven ■ A cake is baking in the oven 12

Dependency parsing root dobj Recovering shallow semantics poss det nsubj My dog ate a sausage root D PN N V N ■ Some semantic information can be (approximately) derived from syntactic information ■ Subjects (nsubj) are (often) agents : initiators / doers of an action ■ Direct objects (dobj) are (often) patients : affected entities ■ Even for agents and patients, consider: ■ Mary is baking a cake in the oven ■ A cake is baking in the oven ■ In general, it is not trivial even for the most shallow forms of semantics 12

Dependency parsing root dobj Recovering shallow semantics poss det nsubj My dog ate a sausage root D PN N V N ■ Some semantic information can be (approximately) derived from syntactic information ■ Subjects (nsubj) are (often) agents : initiators / doers of an action ■ Direct objects (dobj) are (often) patients : affected entities ■ Even for agents and patients, consider: ■ Mary is baking a cake in the oven ■ A cake is baking in the oven ■ In general, it is not trivial even for the most shallow forms of semantics ■ e.g. prepositions: in can encode direction, position, temporal information, … 12

Constituency and dependency representations 13

Constituency and dependency representations ■ Constituency trees can (potentially) be converted to dependency trees. 13

Constituency and dependency representations ■ Constituency trees can (potentially) be converted to dependency trees. ■ Dependency trees can (potentially) be converted to constituency trees. 13

Constituency trees ■ Internal nodes correspond to phrases . ■ S : a sentence ■ NP (noun phrase): My dog, a sandwich, lakes, … ■ VP (verb phrase): ate a sausage, barked, … ■ PP (prepositional phrases): with a friend, in a car, … ■ Nodes immediately above words are part-of-speech tags (or preterminals ). ■ PN : pronoun ■ D : determiner ■ V : verb ■ N : noun ■ P : preposition 14

Constituency tests 15

Constituency tests ■ How do we know what nodes go in the tree? 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: ■ Replacement 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: ■ Replacement ■ Substitution by proform 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: ■ Replacement ■ Substitution by proform ■ Movement: Clefting, preposing, passive 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: ■ Replacement ■ Substitution by proform ■ Movement: Clefting, preposing, passive ■ Modification 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: ■ Replacement ■ Substitution by proform ■ Movement: Clefting, preposing, passive ■ Modification ■ Coordination / conjunction 15

Constituency tests ■ How do we know what nodes go in the tree? ■ Classic constituency tests: ■ Replacement ■ Substitution by proform ■ Movement: Clefting, preposing, passive ■ Modification ■ Coordination / conjunction ■ Ellipsis / deletion 15

Conflicting tests 16

Conflicting tests ■ Constituency is not always clear. 16

Conflicting tests ■ Constituency is not always clear. ■ Coordination: He went to and came from the store. 16

Conflicting tests ■ Constituency is not always clear. ■ Coordination: He went to and came from the store. ■ Phonological reduction: I will go → I’ll go I want to go → I wanna go a le centre → au centre La velocité des ondes sismiques 16

Morphology + syntax + semantics 17

Morphology + syntax + semantics ■ Syntax : The study of the patterns of formation of sentences and phrases from a word. 17

Morphology + syntax + semantics ■ Syntax : The study of the patterns of formation of sentences and phrases from a word. ■ Borders with semantics and morphology are sometimes blurred. 17

Morphology + syntax + semantics ■ Syntax : The study of the patterns of formation of sentences and phrases from a word. ■ Borders with semantics and morphology are sometimes blurred. Afyonkarahisarlıla ş tırabildiklerimizdenmi ş sinizcesinee 17

Morphology + syntax + semantics ■ Syntax : The study of the patterns of formation of sentences and phrases from a word. ■ Borders with semantics and morphology are sometimes blurred. Afyonkarahisarlıla ş tırabildiklerimizdenmi ş sinizcesinee as if you are one of the people that we thought to be originating from Afyonkarahisar 17

Context-free grammars (CFGs) 18

Context-free grammars (CFGs) ■ Context-free grammars (CFGs) : a formalism for parsing. 18

Context-free grammars (CFGs) ■ Context-free grammars (CFGs) : a formalism for parsing. Grammar (CFG) ROOT → S NP → NP PP S → NP VP VP → VBP NP NP → DT NN VP → VBP NP PP NP → NN NNS PP → IN NP 18

Context-free grammars (CFGs) ■ Context-free grammars (CFGs) : a formalism for parsing. Grammar (CFG) Lexicon ROOT → S NP → NP PP NN → interest S → NP VP VP → VBP NP NNS → raises VBP → interest NP → DT NN VP → VBP NP PP VBP → raises NP → NN NNS PP → IN NP … 18

Context-free grammars (CFGs) ■ Context-free grammars (CFGs) : a formalism for parsing. Grammar (CFG) Lexicon ROOT → S NP → NP PP NN → interest S → NP VP VP → VBP NP NNS → raises VBP → interest NP → DT NN VP → VBP NP PP VBP → raises NP → NN NNS PP → IN NP … ■ Other grammar formalisms: LFG, HPSG, TAG, CCG, … 18

Context-free grammars (CFGs) Grammar (CFG) Lexicon S → NP VP N → girl N → telescope VP → V N → sandwich VP → V NP PN → I VP → VP PP V → saw V → ate NP → NP PP P → with NP → D N P → in NP → PN D → a D → the PP → P NP 19

Context-free grammars (CFGs) ■ CFG: Formal definition. A 4-tuple ( N , Σ , R , S ): N a set of non-terminal symbols (or variables ) Σ a set of terminal symbols (disjoint from N ) R a set of rules or productions, each of the form A → β , where A is a non-terminal, β is a string of symbols from the infinite set of strings ( Σ ∪ N ) ∗ S a designated start symbol and a member of N 31

Context-free grammars (CFGs) ■ CFG: Formal definition. A 4-tuple ( N , Σ , R , S ): VP , NP , S, PP , … V, N, P… N a set of non-terminal symbols (or variables ) Σ a set of terminal symbols (disjoint from N ) R a set of rules or productions, each of the form A → β , where A is a non-terminal, β is a string of symbols from the infinite set of strings ( Σ ∪ N ) ∗ S a designated start symbol and a member of N 31

Context-free grammars (CFGs) ■ CFG: Formal definition. A 4-tuple ( N , Σ , R , S ): VP , NP , S, PP , … V, N, P… saw, telescope, N a set of non-terminal symbols (or variables ) the, girl, … Σ a set of terminal symbols (disjoint from N ) R a set of rules or productions, each of the form A → β , where A is a non-terminal, β is a string of symbols from the infinite set of strings ( Σ ∪ N ) ∗ S a designated start symbol and a member of N 31

Context-free grammars (CFGs) ■ CFG: Formal definition. A 4-tuple ( N , Σ , R , S ): VP , NP , S, PP , … V, N, P… saw, telescope, N a set of non-terminal symbols (or variables ) the, girl, … Σ a set of terminal symbols (disjoint from N ) R a set of rules or productions, each of the form A → β , NP → NP PP , … where A is a non-terminal, β is a string of symbols from the infinite set of strings ( Σ ∪ N ) ∗ S a designated start symbol and a member of N 31

Algorithms for NLP CS 11-711 Fall 2020 Lecture 11: Syntactic - PowerPoint PPT Presentation

Algorithms for NLP CS 11-711 Fall 2020 Lecture 11: Syntactic parsing and context-free grammars Emma Strubell Announcements Fridays recitation will be a P2 Q&A + questions to work through. 2 Ambiguity I saw the woman with the

Greedy Algorithms Chapter 16 1 CPTR 430 Algorithms Greedy Algorithms Greedy Algorithms For

Evolutionary Algorithms CS 478 - Evolutionary Algorithms 1 Evolutionary Computation/Algorithms

Graph Algorithms Chapter 22 1 CPTR 430 Algorithms Graph Algorithms Why Study Graph Algorithms?

- - packing p a - packing algo- packing cking rithms algo- a l g o - theorems rithms

Algorithms Chapter 3 Chapter Summary Algorithms n Example Algorithms n Algorithmic Paradigms

Algorithms Theory Algorithms Theory 10 10 Greedy Algorithms G d Al ith Dr. Alexander

Randomized Algorithms Randomized Algorithms Two Types of Randomized Algorithms Two Types of

The Role of Algorithms in Computing Chapter 1 1 CPTR 430 Algorithms The Role of Algorithms in

Algorithms X. Zhang Fordham Univ. 1 Real World applications of algorithms Algorithms for

Mathematical Analysis of Genetic Algorithms Genetic Algorithms are not appropriate for

Genetic Algorithms Welcome to this introduction to Genetic Algorithms. The objective of this paper

Efficient Algorithms P and NP So far, we have developed algorithms for finding shortest

Algorithms in Nature Nature inspired algorithms http://www.cs.cmu.edu/~02317/ Ziv Bar-Joseph

Algorithms for Big Data CISC5835 Fordham Univ. Instructor: X. Zhang Lecture 1 Outline

Algorithms for Big Data CISC5835 Fordham Univ. Instructor: X. Zhang Lecture 1 Outline

Algorithms and Architecture 1 Introduction to Algorithms Alexandre David 1 Outline Notion

Dependency parsing and logistic regression Shay Cohen (based on slides by Sharon Goldwater) 21

1V Compact Class-AB CMOS Log Filters X. Redondo and F. Serra-Graells Circuits and Systems Group

PVMD Ren van Swaaij Delft University of Technology Learning objectives How is V oc related

The MOS Transistor Johan Lfgren The Devices Important Dimensions Technology development:

Today Lagrangian Dual. Already saw example! Convex Separator. Farkas Lemma. Lagrangian Dual.

The man I saw when Tim took me to see that new show down in Leeds was here a moment ago. What is

Jesus the Life of the Party After Jesus was born in Bethlehem in Judea, during the time of

Dependency Grammars Dependency grammars . ltekin, SfS / University of Tbingen WS