an hdp model for inducing combinatory categorial grammars
play

An HDP Model for Inducing Combinatory Categorial Grammars Yonatan - PowerPoint PPT Presentation

Mar 08, 2023 •184 likes •1.71k views

An HDP Model for Inducing Combinatory Categorial Grammars Yonatan Bisk & Julia Hockenmaier University of Illinois at Urbana-Champaign TACL Vol 1(2013):75 88 1 Thursday, June 13, 13 PRP VBD ADJ NN She ate crunchy granola 2

  1. Parameters for X i → X j X k X 1 X 2 X 3 X 4 X 5 X 6 X 7 X 8 X 9 ... ? ? ? ? ? ? ? ? ? ? X 1 ? ? ? ? ? ? ? ? ? ? X 2 ? ? ? ? ? ? ? ? ? ? X 3 ? ? ? ? ? ? ? ? ? ? X 4 ? ? ? ? ? ? ? ? ? ? X 5 ? ? ? ? ? ? ? ? ? ? X 6 ? ? ? ? ? ? ? ? ? ? X 7 ? ? ? ? ? ? ? ? ? ? X 8 ? ? ? ? ? ? ? ? ? ? X 9 ... ? ? ? ? ? ? ? ? ? ? 23 Thursday, June 13, 13

  2. Parameters for X i → X j X k Problem for nonparametric PCFG models: X 1 X 2 X 3 X 4 X 5 X 6 X 7 X 8 X 9 ... ? ? ? ? ? ? ? ? ? ? X 1 ? ? ? ? ? ? ? ? ? ? X 2 Each LHS nonterminal X i ? ? ? ? ? ? ? ? ? ? X 3 is allowed a ? ? ? ? ? ? ? ? ? ? X 4 ? ? ? ? ? ? ? ? ? ? X 5 doubly infinite ? ? ? ? ? ? ? ? ? ? X 6 cross-product ? ? ? ? ? ? ? ? ? ? X 7 ? ? ? ? ? ? ? ? ? ? X 8 of RHS children X j , X k ? ? ? ? ? ? ? ? ? ? X 9 ... ? ? ? ? ? ? ? ? ? ? 23 Thursday, June 13, 13

  3. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? ? ? ? ? ? ? ? ? ? S ? ? ? ? ? ? ? ? ? ? N ? ? ? ? ? ? ? ? ? ? S/S ? ? ? ? ? ? ? ? ? ? S\S ? ? ? ? ? ? ? ? ? ? S/N ? ? ? ? ? ? ? ? ? ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  4. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? ? ? ? ? ? ? ? ? ? N ? ? ? ? ? ? ? ? ? ? S/S ? ? ? ? ? ? ? ? ? ? S\S ? ? ? ? ? ? ? ? ? ? S/N ? ? ? ? ? ? ? ? ? ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  5. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? ? ? ? ? ? ? ? ? ? S/S ? ? ? ? ? ? ? ? ? ? S\S ? ? ? ? ? ? ? ? ? ? S/N ? ? ? ? ? ? ? ? ? ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  6. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? S/S ? ? ? ? ? ? ? ? ? ? S\S ? ? ? ? ? ? ? ? ? ? S/N ? ? ? ? ? ? ? ? ? ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  7. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? S/S S\S ? ? ? ? ? ? ? ? ? ? S/N ? ? ? ? ? ? ? ? ? ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  8. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? S/S S\S S/N ? ? ? ? ? ? ? ? ? ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  9. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? S/S S\S S/N ? S\N ? ? ? ? ? ? ? ? ? ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  10. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? S/S S\S S/N ? S\N ? (S\N)/N ? ? ? ? ? ? ? ? ? ? (S\N)\S ? ? ? ? ? ? ? ? ? ? (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  11. Parameters for S\N → ... ... S N S/S S\S S/N S\N (S\N)/N (S\N)\S (S\N)\N ... ? S ? N ? S/S S\S S/N ? S\N ? (S\N)/N (S\N)\S (S\N)\N ... ? ? ? ? ? ? ? ? ? ? 24 Thursday, June 13, 13

  12. CCG rules 25 Thursday, June 13, 13

  13. CCG rules Parent Combinator Left Right (S\N)/N N >B ((S\N)/N)/Y Y (S\N)/N /N (S\N)/N \N)/N (S\N)/N ((S\N)/N)\Y (S\N)/N (S\N)\Y (S\N)/N S\Y 25 Thursday, June 13, 13

  14. CCG rules Parent Combinator Left Right (S\N)/N N >B 0 ((S\N)/N)/Y Y (S\N)/N >B (S\N)/Y Y/N (S\N)/N \N)/N (S\N)/N ((S\N)/N)\Y (S\N)/N (S\N)\Y (S\N)/N S\Y 25 Thursday, June 13, 13

  15. CCG rules Parent Combinator Left Right (S\N)/N N >B 0 ((S\N)/N)/Y Y (S\N)/N >B 1 (S\N)/Y Y/N (S\N)/N >B S\Y (Y\N)/N (S\N)/N ((S\N)/N)\Y (S\N)/N (S\N)\Y (S\N)/N S\Y 25 Thursday, June 13, 13

  16. CCG rules Parent Combinator Left Right (S\N)/N N >B 0 ((S\N)/N)/Y Y (S\N)/N >B 1 (S\N)/Y Y/N (S\N)/N >B 2 S\Y (Y\N)/N (S\N)/N <B Y ((S\N)/N)\Y (S\N)/N (S\N)\Y (S\N)/N S\Y 25 Thursday, June 13, 13

  17. CCG rules Parent Combinator Left Right (S\N)/N N >B 0 ((S\N)/N)/Y Y (S\N)/N >B 1 (S\N)/Y Y/N (S\N)/N >B 2 S\Y (Y\N)/N (S\N)/N <B 0 Y ((S\N)/N)\Y (S\N)/N <B Y/N (S\N)\Y (S\N)/N S\Y 25 Thursday, June 13, 13

  18. CCG rules Parent Combinator Left Right (S\N)/N N >B 0 ((S\N)/N)/Y Y (S\N)/N >B 1 (S\N)/Y Y/N (S\N)/N >B 2 S\Y (Y\N)/N (S\N)/N <B 0 Y ((S\N)/N)\Y (S\N)/N <B 1 Y/N (S\N)\Y (S\N)/N <B (Y\N)/N S\Y 25 Thursday, June 13, 13

  19. CCG rules Parent Combinator Left Right (S\N)/N N >B 0 ((S\N)/N)/Y Y (S\N)/N >B 1 (S\N)/Y Y/N (S\N)/N >B 2 S\Y (Y\N)/N (S\N)/N <B 0 Y ((S\N)/N)\Y (S\N)/N <B 1 Y/N (S\N)\Y (S\N)/N <B 2 (Y\N)/N S\Y 25 Thursday, June 13, 13

  20. CCG rules 26 Thursday, June 13, 13

  21. CCG rules Parent Y (S\N)/N S (S\N)/N S (S\N)/N S (S\N)/N S (S\N)/N S (S\N)/N S 26 Thursday, June 13, 13

  22. CCG rules Parent Y Combinator (S\N)/N S (S\N)/N S (S\N)/N S (S\N)/N S (S\N)/N S (S\N)/N S 26 Thursday, June 13, 13

  23. CCG rules Parent Y Combinator Left (S\N)/N S >B 0 ((S\N)/N)/ (S\N)/N S >B 1 (S\N)/ (S\N)/N S >B 2 S\ (S\N)/N S <B 0 S (S\N)/N S <B 1 S/N (S\N)/N S <B 2 (S\N)/N 26 Thursday, June 13, 13

  24. CCG rules Parent Y Combinator Left Right (S\N)/N S >B 0 ((S\N)/N)/S S (S\N)/N S >B 1 (S\N)/S S/N (S\N)/N S >B 2 S\S (S\N)/N (S\N)/N S <B 0 S ((S\N)/N)\S (S\N)/N S <B 1 S/N (S\N)\S (S\N)/N S <B 2 (S\N)/N S\S 26 Thursday, June 13, 13

  25. CCG rules Parent Y Combinator Left Right (S\N)/N S >B 0 ((S\N)/N)/S S CCG rules are (S\N)/N S >B 1 (S\N)/S S/N heavily constrained: (S\N)/N S >B 2 S\S (S\N)/N (S\N)/N S <B 0 S ((S\N)/N)\S For a given parent category, (S\N)/N S <B 1 S/N (S\N)\S (S\N)/N S <B 2 (S\N)/N S\S the Y category and combinator determine both children 26 Thursday, June 13, 13

  26. HDPs for CCGs 27 Thursday, June 13, 13

  27. HDPs for CCGs S 27 Thursday, June 13, 13

  28. HDPs for CCGs Y = N S Combinator = <B 0 27 Thursday, June 13, 13

  29. HDPs for CCGs Y = N S Combinator = <B 0 S\N N 27 Thursday, June 13, 13

  30. HDPs for CCGs S S\N N 27 Thursday, June 13, 13

  31. HDPs for CCGs Y = N S Combinator = >B 0 S\N S\N N N (S\N)/N 27 Thursday, June 13, 13

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Combinatory Categorial Grammar The effort to develop natural language grammars and

Combinatory Categorial Grammar The effort to develop natural language grammars and

Combinatory Categorial Grammar Goal Mildly-context sensitive grammar framework, with provable polynomial parseability To present the intuitions behind Combinatory Categorial Grammar as a framework for relating the structure of a linguistic

280 views • 13 slides
Combinatory Categorial Grammars Lexicalized Semantically Guided Syntax Yonatan Bisk 1 The

Combinatory Categorial Grammars Lexicalized Semantically Guided Syntax Yonatan Bisk 1 The

Combinatory Categorial Grammars Lexicalized Semantically Guided Syntax Yonatan Bisk 1 The People (a very abridged version) Theory Data and Parsers Weakly Supervised Parsing Me! Dan Garrette (Google) Mark Steedman (Edinburgh) Jason

630 views • 38 slides
Semantic Parsing with Combinatory Categorial Grammars Yoav Artzi ! University of Washington Based

Semantic Parsing with Combinatory Categorial Grammars Yoav Artzi ! University of Washington Based

A b r i d g e d Semantic Parsing with Combinatory Categorial Grammars Yoav Artzi ! University of Washington Based on ACL 2013 Tutorial ! With Nicholas FitzGerald and Luke Zettlemyer ! Original tutorial slides available at

2.2k views • 197 slides
Combinatory Categorial Grammar (CCG) 11-711 Algorithms for NLP 22 October 2019 (With thanks to

Combinatory Categorial Grammar (CCG) 11-711 Algorithms for NLP 22 October 2019 (With thanks to

Combinatory Categorial Grammar (CCG) 11-711 Algorithms for NLP 22 October 2019 (With thanks to Alan W Black) Goals of CCG Simplify the ( combinatory ) rules Move complexity from rules to ( categorial ) lexical entries More tightly

527 views • 42 slides
Parsing Combinatory Categorial Grammar with Answer Set Programming: Preliminary Report Yuliya

Parsing Combinatory Categorial Grammar with Answer Set Programming: Preliminary Report Yuliya

Parsing Combinatory Categorial Grammar with Answer Set Programming: Preliminary Report Yuliya Lierler Peter Schller Computer Science Department, University of Kentucky KBS Group Institut fr Informationssysteme, Technische Universitt

548 views • 26 slides
Categorial Grammar C a gr C oltekin c.coltekin@rug.nl November 18, 2008 1 / 28

Categorial Grammar C a gr C oltekin c.coltekin@rug.nl November 18, 2008 1 / 28

Categorial Grammar C a gr C oltekin c.coltekin@rug.nl November 18, 2008 1 / 28 Overview A review of CFGs and Chomsky hierarchy Categorial Grammar Categorial Grammar and semantics Learning Categorial Grammars 2 /

288 views • 28 slides
Identifying Semantic Roles Using Combinatory Categorial Grammar Daniel Gildea and Julia

Identifying Semantic Roles Using Combinatory Categorial Grammar Daniel Gildea and Julia

Identifying Semantic Roles Using Combinatory Categorial Grammar Daniel Gildea and Julia Hockenmaier University of Pennsylvania Gildea &amp; Hockenmaier EMNLP 2003 1 Introduction Understanding difficult due to variation in syntactic

559 views • 22 slides
Categorial Grammars for Automatic Generation of Music Halley Young ICFP 2017 FARM Workshop

Categorial Grammars for Automatic Generation of Music Halley Young ICFP 2017 FARM Workshop

Categorial Grammars for Automatic Generation of Music Halley Young ICFP 2017 FARM Workshop Outline Introduction to music as math vs language Mathematical representations of musical objects Categorial grammars and linguistic/musical

498 views • 24 slides
Parsing Jazz: Harmonic Analysis of Music Using Combinatory Categorial Grammar Mark

Parsing Jazz: Harmonic Analysis of Music Using Combinatory Categorial Grammar Mark

Introduction Harmonic Analysis Harmonic CCG Statistical Parsing Conclusion Handout Pre-Viva Talk: Parsing Jazz: Harmonic Analysis of Music Using Combinatory Categorial Grammar Mark Granroth-Wilding Supervisors: Mark Steedman Sharon

775 views • 48 slides
Efficient NORMALFORM Parsing for Combinatory Categorial Grammar Jason M. Eisner University of

Efficient NORMALFORM Parsing for Combinatory Categorial Grammar Jason M. Eisner University of

Efficient NORMALFORM Parsing for Combinatory Categorial Grammar Jason M. Eisner University of Pennsylvania June 26, 1996 at ACL CCG and the Spurious Ambiguity Problem [John likes Mary] S (sentence) [likes Mary] S\NP (sentence missing NP

470 views • 22 slides
Plan Introduction 1 On categorial grammars and learnability 2 Logical Information Systems

Plan Introduction 1 On categorial grammars and learnability 2 Logical Information Systems

Introduction On categorial grammars and learnability Logical Information Systems (LIS) Categorial grammars and/as LIS Annex Plan Introduction 1 On categorial grammars and learnability 2 Logical Information Systems (LIS) 3 Categorial

1.09k views • 75 slides
Combinatory Categorial Grammar (CCG) Categories Categories = types Primitive categories

Combinatory Categorial Grammar (CCG) Categories Categories = types Primitive categories

Combinatory Categorial Grammar (CCG) Categories Categories = types Primitive categories N, NP, S, PP, etc Functions a combination of primitive categories S/NP, (S/NP) / (S/NP), etc V, VP, Adverb, PP, etc

671 views • 28 slides
When life gives you lemons, make GF! Inducing grammars from the lexicon-ontology interface

When life gives you lemons, make GF! Inducing grammars from the lexicon-ontology interface

When life gives you lemons, make GF! Inducing grammars from the lexicon-ontology interface Christina Unger Semantic Computing Group CITEC, Bielefeld University 1 / 41 In collaboration with: Jeroen van Grondelle, Frank Smit, Jouri Fledderman

702 views • 48 slides
From Tree Adjoining Grammars to Higher Order Representations of Abstract Meaning Representations

From Tree Adjoining Grammars to Higher Order Representations of Abstract Meaning Representations

From Tree Adjoining Grammars to Higher Order Representations of Abstract Meaning Representations via Abstract Categorial Grammars Rasmus Blanck, Aleksandre Maskharashvili Centre for Linguistic Theory and Studies in Probability, University of

1.01k views • 73 slides
L95: Natural Language Syntax and Parsing 4) Categorial Grammars Paula Buttery Dept of Computer

L95: Natural Language Syntax and Parsing 4) Categorial Grammars Paula Buttery Dept of Computer

L95: Natural Language Syntax and Parsing 4) Categorial Grammars Paula Buttery Dept of Computer Science &amp; Technology, University of Cambridge Paula Buttery (Computer Lab) L95: Natural Language Syntax and Parsing 1 / 15 Reminder: For

685 views • 15 slides
Inducing Efficiently Inducing Efficiently optimizi optimizing outpati ng outpatient i ent

Inducing Efficiently Inducing Efficiently optimizi optimizing outpati ng outpatient i ent

Inducing Efficiently Inducing Efficiently optimizi optimizing outpati ng outpatient i ent induction nduction of labour of labour Janet Lyons Henry Woo MD FRCSC MD MPH CCFP FRCSC Medical Lead, High Risk Obstetrics

913 views • 54 slides
an ICA World Rule 21 Working Group Two June 27, 2018 Risk of Queue Stacking When developers

an ICA World Rule 21 Working Group Two June 27, 2018 Risk of Queue Stacking When developers

Queue Management in an ICA World Rule 21 Working Group Two June 27, 2018 Risk of Queue Stacking When developers know the exact capacity they can propose with no upgrade costs, they will be more likely to get in the queue with a

178 views • 6 slides
A UAV Test and Development Environment Based on Dynamic System Reconfiguration Osamah A.

A UAV Test and Development Environment Based on Dynamic System Reconfiguration Osamah A.

A UAV Test and Development Environment Based on Dynamic System Reconfiguration Osamah A. Rawashdeh, Garrett D. Chandler, and James E. Lumpp, Jr. Department of Electrical and Computer Engineering University of Kentucky Lexington, KY Outline

300 views • 11 slides
KETCindy supporting tool to convert students findings into knowledge Masataka Kaneko Satoshi

KETCindy supporting tool to convert students findings into knowledge Masataka Kaneko Satoshi

IS4IS VIENNA (2015) KETCindy supporting tool to convert students findings into knowledge Masataka Kaneko Satoshi Yamashita Hideyo Makishita Yoshifumi Maeda Naoki Hamaguchi Shigeki Kobayashi Setsuo Takato KAKENHI 15K01037 CONTENTS

939 views • 69 slides
Marcus M. Morgenstern DGS-RP-AS LIU-PSB meeting - June 18 th , 2015 - Introduction Updated

Marcus M. Morgenstern DGS-RP-AS LIU-PSB meeting - June 18 th , 2015 - Introduction Updated

Marcus M. Morgenstern DGS-RP-AS LIU-PSB meeting - June 18 th , 2015 - Introduction Updated study previously performed by J. Blaha (2013) Updates include: Dump geometry Shielding geometry Aim: Study radiological

339 views • 16 slides
European co-operation for Accreditation WHO WE ARE https://european-accreditation.org CONTENT

European co-operation for Accreditation WHO WE ARE https://european-accreditation.org CONTENT

European co-operation for Accreditation WHO WE ARE https://european-accreditation.org CONTENT 1. About EA 2. EA Organisational Structure 3. The EA Multilateral Agreement (EA MLA) 4. EA in the Global Network EAs role in Europe 5. 6.

532 views • 50 slides
Chapter 3: Cohomology Felix Schremmer Technical University of Munich Different notions of

Chapter 3: Cohomology Felix Schremmer Technical University of Munich Different notions of

Chapter 3: Cohomology Felix Schremmer Technical University of Munich Different notions of cohomology Cohomology with integral coefficients Cohomology with real coefficients Different notions of cohomology 1 Cohomology from topology

508 views • 37 slides
Bi-angular lines Bi-angular lines Mutually unbiased weighing matrices Bi-angular

Bi-angular lines Bi-angular lines Mutually unbiased weighing matrices Bi-angular

Bi-angular lines in R n Hadi Kharaghani Joint work with Darcy Best University of Lethbridge CanaDAM 2013 Memorial University of Newfoundland June 10 13, 2013 Bi-angular lines Bi-angular lines Mutually unbiased weighing matrices

1.55k views • 106 slides
Interoperable eID as a key enabler for pan-European (eGovernment) services Karel De Vriendt

Interoperable eID as a key enabler for pan-European (eGovernment) services Karel De Vriendt

Interoperable eID as a key enabler for pan-European (eGovernment) services Karel De Vriendt European Commission Enterprise and Industry Directorate General OASIS Adoption Forum London, 28 November 2006 Outline eID in the eGovernment

219 views • 21 slides

More recommend