Defending that Grammaticality can be explained through a Fuzzy - - PowerPoint PPT Presentation

defending that grammaticality can be explained through a
SMART_READER_LITE
LIVE PREVIEW

Defending that Grammaticality can be explained through a Fuzzy - - PowerPoint PPT Presentation

LACOMPLING 2018 Symposium on Logic and Algorithms in Computational Linguistics 2018 Stockholm, 28 31 August 2018 A DRI T ORRENS U RRUTIA D EPARTAMENT DE F ILOLOGIES R OMNIQUES U NIVERSITAT R OVIRA I V IRGILI T ARRAGONA Defending that


slide-1
SLIDE 1

LACOMPLING 2018 Symposium on Logic and Algorithms in Computational Linguistics 2018

Stockholm, 28 –31 August 2018

ADRIÀ TORRENS URRUTIA

DEPARTAMENT DE FILOLOGIES ROMÀNIQUES UNIVERSITAT ROVIRA I VIRGILI TARRAGONA

slide-2
SLIDE 2

Grammaticality as an Uncertain/Fuzzy value

Defending that Grammaticality can be explained through a Fuzzy Grammar

Tools for taking into account Grammaticality Fuzzy Grammar as a model to explain Grammaticality in terms of Degrees

slide-3
SLIDE 3

Discrete Theoretical Approach

  • PERFECT
  • Degrees here are not

a deal either don’t exist

Competence

  • IMPERFECT
  • IMPERFECT
  • Degrees of Acceptability
  • (Psycholinguistic)

Performance

“To give up the notion that a grammar defines a set of well-formed utterances is to give up a great deal […] If we can maintain the concept of discrete grammaticality, we will be in a better position to pursue an understanding of grammatical universals” Bever (1975:601). Sobre la idealización del lenguaje “The only reasonable way to approach a grasp

  • f reality” Chomsky (1998:115).
slide-4
SLIDE 4

Natural Natural Language Language Processing Processing Do Do we we evaluate evaluate non non-

  • grammatical

grammatical inputs? inputs?

  • —--------

input

PERFECT

+ Deep +Closer to thinking

  • Deep +Closer performance
slide-5
SLIDE 5

Natural Natural Language Language Processing Processing We We Do Do Evaluate Evaluate Inputs Inputs

  • -X----X---

X---X---- X—X-------- X

input

This guy doesn’t speak very well

  • -----X---

X-------X— X--------X input

OBJECTIVE: OUR MACHINES HAVE TO BOTH UNDERSTAND/PARSE AND EVALUATE THE NATURAL LANGUAGE INPUTS, AS HUMANS DO INPUT: GRAMMATICALITY AT 85% SELF-TAUGHT LANGUAGE LEARNING SOFTWARES

slide-6
SLIDE 6

Linguistic modules

Phonetics Morphology Pragmatics LINGUISTIC COMPETENCE Syntax Semantics Prosody

slide-7
SLIDE 7

Spanish

THIS WORK IS ASSEMBLED ON

GRAMMATICALITY

Syntax

slide-8
SLIDE 8
slide-9
SLIDE 9

FUZZY GRAMMAR

FUZZY LOGIC GRAMMARS WITH CONSTRAINTS

GRADIENT EVALUATIVE SYSTEMS

slide-10
SLIDE 10

DISCRETE VS FUZZY

CLASSICAL LOGIC <1,0> FUZZY LOGIC: [1,0]

slide-11
SLIDE 11

DESCRIBING EVERY KIND OF LINGUISTIC INPUT (FUZZY)

AN INPUT IS EITHER GRAMMATICAL O NON- GRAMMATICAL LINGUISTIC INPUT DISCRETE GRAMMAR: FUZZY GRAMMAR: AN INPUT IS % GRAMMATICAL LINGUISTIC INPUT LINGUISTIC INPUT

slide-12
SLIDE 12

FUZZY REASONING IF-THEN RULES

IF THE VALUE OF GRAMMATICALITY IS HIGH, THEN THE VALUE OF NON-GRAMMATICALITY IS LOW

slide-13
SLIDE 13

TYPE THEORY HIGH ORDER FUZZY LOGIC

FTT Vilem Novak, (2005) The basic concept in FTT is type (denoted by Greek letters)

Atomic types are  representing elements Type o (omicron) is the type of truth degree In the semantics In the semantics the type  is assigned a set M whose elements can be anything In the semantics it is A set of truth values Mo Which in our case is Mo = [0,1]

[0,1]

a  [0,1] Representing various degrees, Grammaticality, Complexity, etc.   

slide-14
SLIDE 14

Defining a Fuzzy Set

B : M  [0,1]

Membership Function

(Universe)

Set

(ROL in U) Degree

Linguistic Knowledge of a Group:  Mo [0,1]

CL: M x M  Mo

Complex types, set of functions Mo

 Linguistic Knowledge of a Group:

slide-15
SLIDE 15

Example of a Module in a Fuzzy Grammar

X: X x D [0,1]

Syntactic Module in a FG

(Universe)

Set of Rules

(ROL en el U) DEGREE

Syntactic Knowledge in FG: Mo [0,1]  

slide-16
SLIDE 16

What is a Fuzzy Grammar? A Fuzzy Grammar (FGr) is a fuzzy set Which on the Cartesian product Which on the Cartesian product Of the set of the module’s rules. The rules define the Linguistic Knowdlege Of every module in a Fuzzy Grammar.

Multi-Modal Fuzzy Grammar

slide-17
SLIDE 17

How the linguistic modules are defined in a FGr?

X: X x D [0,1]

Set of syntactic Rules X = {x  x is a syntactic rule} The rules are extracted from a Grammar Set of dialect rule D= {d   d  is a dialect rule} These are obtained from the INPUT/OUTPUT

Syntax in FGr

(Universe)

Set of Rules

(ROL in U) DEGREE

slide-18
SLIDE 18

Defining the rules in each linguistic module

The Constraints define the linguistic relation between POS and Syntax (or other Modules)

Blache, 2016

Constraint behaviour in Fuzzy

and Syntax (or other Modules) Precedence A > B Requirement A  B Exclusion A  B

Constraint behaviour in Fuzzy Grammar () Canonical (Gold Standard) () Violated ()Variability

slide-19
SLIDE 19

PROPERTIES IN LINGUISTIC CONSTRUCTIONS

CONSTRUCTION IS OUR FUZZY SET

Each Category trigger a Set of Properties A Construction is Triggered by a Set of Categories PROPERTY GRAMMARS CONSTRUCTION= Set of Properties+ Set of Categories PROPER NOUN PROPN  DET (Set of Properties of the PROPN) Manchester vs El Manchester (?) NOMINAL PHRASE SUBJECT DIRECT OBJECT MODIFICATOR PHRASE etc.

slide-20
SLIDE 20

PROPERTIES IN LINGUISTIC CONSTRUCTIONS

LINGUISTIC CONSTRUCTION (Nominal Phrase) DET (the) ADJ (red) NOUN (car) (the) (red) (car)

DET PROPERTIE’S DET > N DET dep. N DET agree N DET  Pron, PROPN ADJ PROPERTIE’S ADJ > N ADJ dep N NOUN PROPERTIE’S N  DET

slide-21
SLIDE 21

“The book red”

Initial Set:{Det1 N2 Adj3}

A= {{Det1 N2} {Det1 N2 Adj3}} A= {{Det1 N2} {Det1 N2 Adj3}}

Assignation Properties

{Det1 N2} P+= {Det<N; N Det; Uniq (Det, N); Oblig (N)} P-= ∅ {Det1 N2 Adj3} P+= {Det<N; N  Det; Uniq (Det, N,Adj); Oblig (N) Adj

mod N}

P-= {Adj<N}

slide-22
SLIDE 22

Example of a table of Linguistic Properties

Transitivity Verb Construction In Spanish

Constraint behaviour in Fuzzy Grammar () Canonical (Gold Standard) () Violated ()Variability

In Spanish Canonical () Verb  dep Direct Object (N  PRON) Verb  dep Subject (N  PRON) Variability () 1: VS: S in verbal person (morpheme)

FGr takes into account the VIOLATIONS but DOESN’T VIOLATE RULES

slide-23
SLIDE 23

Extracting Constructions and Properties from

  • Univ. Dep. & MarsaGram (17.000 treebanks aprox.):

Linguistic Constructions & Properties

slide-24
SLIDE 24

Why Dialect? Demonstration degrees of G/C in a FGr

X: X  (D  Mo)

Linguistic Knowledge in FG: Mo [0,1] 

input

ACCEPTABILITY

input

slide-25
SLIDE 25

Full Definition of a FGr

X: X  (D  Mo) X: X x D [0,1] FGr  dx(X(o)x)d

Every Rule in a Dialect (D) triggers rules in a Module of a grammar (M / X) , Both have a degree of Grammaticality

slide-26
SLIDE 26

Example of association between sets and its Grammaticality

Rule1, Rule2, Rule3, Rule 4  X Is an example of rules that define the syntax of our FGr Rulea, Ruleb, Rulec, Ruled  D Is an example of rules that define an input in a Dialect

X(Rule1, Rulea) = 0.5 X(Rule2, Ruleb) = 0.8 X(Rule2, Ruleb) = 0.8 X(Rule3, Rulec) = 0.6 X(Rule4, Rulec) = 0.9

X(Rule3, Rulec) = 0.6 & X(Rule4, Rulec) = 0.9 They are an example of how a rule in an input of dialect can trigger two rules in the syntax rule set of a FGr (the canonical and the variable)

THE LESS GRAMMATICALITY THE MORE RULES ARE TRIGGERED

slide-27
SLIDE 27

First Parser VG1 =  +  Second Parser  Value of Grammaticality

Constraint behaviour in Fuzzy Grammar () Canonical (Gold Standard) () Violated

Second Parser VG2 = ( + ) +  

() Violated ()Variability

slide-28
SLIDE 28

Future Work…

slide-29
SLIDE 29

FFI2015-69978-P, Ministerio de Economía y Competitividad: “GRAMMATICAL INFERENCE ALGORITHMS

FOR MEASURING THE RELATIVE COMPLEXITY OF NATURAL LANGUAGE”

slide-30
SLIDE 30

adria.torrens@urv.cat