Quantified Sentences as a Window into Prediction and Priming: An ERP Study
Aniello De Santo Jon Rawski Amanda Yazdani John E. Drury
Stony Brook University aniello.desanto@stonybrook.edu aniellodesanto.github.io
Quantified Sentences as a Window into Prediction and Priming: An ERP - - PowerPoint PPT Presentation
Quantified Sentences as a Window into Prediction and Priming: An ERP Study Aniello De Santo Jon Rawski Amanda Yazdani John E. Drury Stony Brook University aniello.desanto@stonybrook.edu aniellodesanto.github.io CLS 54 April 26, 2018 The
Stony Brook University aniello.desanto@stonybrook.edu aniellodesanto.github.io
◮ N400 insensitive to truth-value (Fischler et al. 1983); ◮ N400 modulated by truth-value when controlling for
◮ Early prediction effects tied to the truth-conditional properties
◮ ERP markers of quantifier complexity.
◮ N400 insensitive to truth-value (Fischler et al. 1983); ◮ N400 modulated by truth-value when controlling for
◮ Early prediction effects tied to the truth-conditional properties
◮ ERP markers of quantifier complexity.
◮ N400 insensitive to truth-value (Fischler et al. 1983); ◮ N400 modulated by truth-value when controlling for
◮ Early prediction effects tied to the truth-conditional properties
◮ ERP markers of quantifier complexity.
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
1 N400 & Truth-value 2 Experimental Design 3 N400&Priming 4 Prediction Effects 5 Conclusions
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
2
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
2
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
2
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
N400 N400
→ cf. Kounios & Holcomb (1992), L¨ udtke et al. (2008) a.o.
3
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
N400 N400
→ cf. Kounios & Holcomb (1992), L¨ udtke et al. (2008) a.o.
3
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
3/30/2018 Click on image to zoom https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=3225068_nihms329928f1.jp Drag image to reposition. Double click to magnify further.
4
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
3/30/2018 Click on image to zoom https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=3225068_nihms329928f1.jp Drag image to reposition. Double click to magnify further.
N400
4
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
4
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
4
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ Shape/color combinations yield 8 conditions; ◮ Contrast ratio 7 : 7 (ALL/NONE) or 5 : 2 (MOST/SOME); ◮ False conditions: unprimed color/shape-predicates (i.e. red) ◮ Adult native English speakers (N = 10) asked for (mis)match
5
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ Shape/color combinations yield 8 conditions; ◮ Contrast ratio 7 : 7 (ALL/NONE) or 5 : 2 (MOST/SOME); ◮ False conditions: unprimed color/shape-predicates (i.e. red) ◮ Adult native English speakers (N = 10) asked for (mis)match
5
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P) ◮ Some... Red (UP>P) ◮ Most ... Red (UP>P) ◮ None... Red (UP>P)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P /F>T) ◮ Some... Red (UP>P /F>T) ◮ Most ... Red (UP>P /F>T) ◮ None... Red (UP>P /T>F)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
MOST SOME
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
ALL NONE
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P /F>T) ◮ Some... Red (UP>P /F>T) ◮ Most ... Red (UP>P /F>T) ◮ None... Red (UP>P /T>F)
6
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ ERPs (F−T) time-locked to predicate onset
7
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ All ... Red (F>T) ◮ Some ... Red (F>T) ◮ Most ... Red (F>T) ◮ None ... Blue(F>T)
◮ All ... Red (UP>P/F>T) ◮ Some... Red (UP>P/F>T) ◮ Most ... Red (UP>P/F>T) ◮ None... Red (UP>P/T>F) ◮ Truth-value does not modulate N400 amplitude. ◮ N400 is driven by priming the expected continuation;
8
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ ERPs (F−T) time-locked to predicate onset
9
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ Phonological Mismatch Negativities (Connolly&Phillips,1994).
10
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
11
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
11
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
11
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
11
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
200 400
−6 −3 3 6
Cz
N400 (T > F)
NONE
N200 (F > T)
ALL, SOME
11
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
12
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
12
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
12
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
12
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
−6 −3 3
12
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
All of the squares are blues All of the squares are reds None of the squares are blues None of the squares are reds
200 400
−6 −3 3 6
Cz
N400 (T > F)
NONE
N200 (F > T)
ALL, SOME
12
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
13
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
13
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
13
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
13
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
13
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
200 400
−6 −3 3 6
Cz
N400 (T > F)
NONE
N200 (F > T)
ALL, SOME
13
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
−6 −3 3
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
200 400
−6 −3 3 6
Cz
N400 (T > F)
NONE
N200 (F > T)
ALL, SOME
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
Most of the squares are blues Most of the squares are reds Some of the squares are yellows Some of the squares are reds
200 400
−6 −3 3 6
Cz
N400 (T > F)
NONE
N200 (F > T)
ALL, SOME
14
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ Complexity effects for
◮ Time-locking signals (F−T)
15
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ Complexity effects for
◮ Time-locking signals (F−T)
15
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ Complexity effects for
◮ Time-locking signals (F−T)
15
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ Complexity effects for
◮ Time-locking signals (F−T)
15
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ N400 for ALL/SOME/MOST (F>T) relative to NONE (T>F) ◮ N400 is driven by priming the expected continuation
◮ early negativity for ALL/SOME vs. NONE/MOST
◮ PMMNs → anticipatory effects + truth-conditional properties
◮ positivity for MOST > ALL/NONE/SOME (∼ 350-450ms) ◮ complexity effects associated with initial encoding of
16
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ N400 for ALL/SOME/MOST (F>T) relative to NONE (T>F) ◮ N400 is driven by priming the expected continuation
◮ early negativity for ALL/SOME vs. NONE/MOST
◮ PMMNs → anticipatory effects + truth-conditional properties
◮ positivity for MOST > ALL/NONE/SOME (∼ 350-450ms) ◮ complexity effects associated with initial encoding of
16
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ N400 for ALL/SOME/MOST (F>T) relative to NONE (T>F) ◮ N400 is driven by priming the expected continuation
◮ early negativity for ALL/SOME vs. NONE/MOST
◮ PMMNs → anticipatory effects + truth-conditional properties
◮ positivity for MOST > ALL/NONE/SOME (∼ 350-450ms) ◮ complexity effects associated with initial encoding of
16
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ N400 for ALL/SOME/MOST (F>T) relative to NONE (T>F) ◮ N400 is driven by priming the expected continuation
◮ early negativity for ALL/SOME vs. NONE/MOST
◮ PMMNs → anticipatory effects + truth-conditional properties
◮ positivity for MOST > ALL/NONE/SOME (∼ 350-450ms) ◮ complexity effects associated with initial encoding of
16
1
Connolly, J. F., Phillips, N. A. (1994). Event-related potential components reflect phonological and semantic processing of the terminal word of spoken sentences.
2
Fischler I., Bloom P., Childers D., Roucos S., Perry N. (1983) Brain potentials related to stages of sentence verification. Psychophysiology.
3
Kounios J, Holcomb P. (1992) Structure and process in semantic memory - evidence from event-related brain potentials and reaction-times.
4
L¨ udtke, J., Friedrich, C., Filippis, M., Kaup, B. (2008). Event-related Potential Correlates of Negation in a Sentence—Picture Verification Paradigm. Journal of Cognitive Neuroscience, 1355-1370.
5
McMillan, C. T., R. Clark, P. Moore, C. Devita, and M. Grossman (2005). Neural basis for generalized quantifier comprehension. Neuropsychologia.
6
Nieuwland MS, Kuperberg GR. (2008) When the truth isn’t too hard to handle: An event-related potential study on the pragmatics of negation. Psychological science.
7
Szymanik, J. (2016). Quantifiers and Cognition: Logical and Computational Perspectives. Springer International Publishing.
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
200 400 600 800 −6 −3 3 6 Fz 200 400 600 800 −6 −3 3 6 Cz 200 400 600 800 −6 −3 3 6 Pz 200 400 600 800 −6 −3 3 6 Oz
200 400 600 800 −6 −3 3 6 Fz 200 400 600 800 −6 −3 3 6 Cz 200 400 600 800 −6 −3 3 6 Pz 200 400 600 800 −6 −3 3 6 Oz
200 400 600 800 −6 −3 3 6 Fz 200 400 600 800 −6 −3 3 6 Cz 200 400 600 800 −6 −3 3 6 Pz 200 400 600 800 −6 −3 3 6 Oz
200 400 600 800 −6 −3 3 6 Fz 200 400 600 800 −6 −3 3 6 Cz 200 400 600 800 −6 −3 3 6 Pz 200 400 600 800 −6 −3 3 6 Oz
T (primed) F (unprimed) T (unprimed) F (primed) T (primed) F (unprimed) T (primed) F (unprimed)
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
RT <Q> dots are <C> 500 ms 4000 ms <Q> of the dots
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
◮ All quantifiers are associated with numerosity:
◮ Only higher-order activate working-memory capacity:
N400 & Truth-value Experimental Design N400&Priming Prediction Effects Conclusions
{All, Some} < {Even, Odd} < {At least n, At most n} < {Less than half, More than half, Most} FSA PDA