TAKING MORPHOLOGY SERIOUSLY: MEG STUDIES OF MORPHOLOGICAL - - PowerPoint PPT Presentation

taking morphology seriously meg studies of morphological
SMART_READER_LITE
LIVE PREVIEW

TAKING MORPHOLOGY SERIOUSLY: MEG STUDIES OF MORPHOLOGICAL - - PowerPoint PPT Presentation

TAKING MORPHOLOGY SERIOUSLY: MEG STUDIES OF MORPHOLOGICAL REPRESENTATIONS Laura Gwilliams & Alec Marantz 17th International Morphology Meeting | Vienna | February 18th 2016 1 TODAYS QUESTIONS 1. What is represented? 2. How are


slide-1
SLIDE 1

TAKING MORPHOLOGY SERIOUSLY: MEG STUDIES OF MORPHOLOGICAL REPRESENTATIONS

Laura Gwilliams & Alec Marantz

1

17th International Morphology Meeting | Vienna | February 18th 2016

slide-2
SLIDE 2

TODAY’S QUESTIONS

2
  • 1. What is represented?
  • 2. How are representations formed?
  • 3. How are representations accessed?
slide-3
SLIDE 3

MAGNETOENCEPHALOGRAPHY (MEG)

3
slide-4
SLIDE 4

MAGNETOENCEPHALOGRAPHY (MEG)

4
slide-5
SLIDE 5

MAGNETOENCEPHALOGRAPHY (MEG)

Amplitude (dSPM)

Average

Time (ms)

5
slide-6
SLIDE 6

MAGNETOENCEPHALOGRAPHY (MEG)

Amplitude (dSPM) Linguistic Variable

6
slide-7
SLIDE 7

MAGNETOENCEPHALOGRAPHY (MEG)

Amplitude (dSPM) Linguistic Variable + + + + + + + + + + + + + + + + + + + + + +

7
slide-8
SLIDE 8

EXPERIMENT 1: WHEN AND WHERE TO LOOK

8

Gwilliams, Lewis & Marantz (In Press)

slide-9
SLIDE 9

EXPERIMENT 1 - WHEN AND WHERE TO LOOK

9

Vinckier et al., 2007

less wordlike more wordlike

GRAVEL AVONIL QUMBSS QOADTQ JZWYWK

slide-10
SLIDE 10

FUNCTIONAL LOCALISER

10

Gwilliams, Lewis & Marantz (In Press)

iv)#Four-element# 1# 24# Symbols# ii)#One-element#

Mini-Experiment “Real” Experiment

free stem bound stem bookable durable perishable equable predictable hospitable printable numerable

slide-11
SLIDE 11

FUNCTIONAL LOCALISER

11

Gwilliams, Lewis & Marantz (In Press)

iv)#Four-element# 1# 24# ii)#One-element# iv)#Four-element# 1# Symbols# ii)#One-element#
slide-12
SLIDE 12

APPLYING FUNCTIONAL LOCALISER

12

Gwilliams, Lewis & Marantz (In Press)

Orthographic Morphological

iv)#Four-element# 1# 24# ii)#One-element# iv)#Four-element# 1# Symbols# ii)#One-element#
slide-13
SLIDE 13

EXPERIMENT 1 - TAKE AWAY

➤ Orthography: ~140 ms in the posterior temporal lobe ➤ Morphology: ~170 ms in the anterior temporal lobe ➤ Successfully created a localiser for these two streams of

processing

13
slide-14
SLIDE 14

EXPERIMENT 2: REPRESENTATIONS OF NON-EXISTENT STEMS

14

Gwilliams & Marantz (In Prep.)

slide-15
SLIDE 15

To be recognized as a [stem] morpheme, a form must either (1) occur as a free form, making up a complete word, or (2) occur, with the same meaning, in more than one word.

  • R.M.W. Dixon
15

Making New Words, 2014: 3

slide-16
SLIDE 16

➤ Copious evidence that:

CORNER

BACKGROUND & QUESTION

FARMER FARM + ER CORNER CORN + ER

➤ What is driving this effect?

presence of an isolatable stem morpheme visual form of a suffix morpheme congruent grammar

16

see Rastle & Davis, 2008 for a review

BROTHEL ≠ BROTH + EL

slide-17
SLIDE 17

QUESTION

LEAKAGE BROTHER EXCURSION WINTER

  • isolatable stem, + congruent grammar
  • isolatable stem, - congruent grammar

+ isolatable stem, + congruent grammar + isolatable stem, - congruent grammar

17

“to explode” “explosion” “to excurse” “excursion” “to bake” “baker” * “to wint” “winter”

slide-18
SLIDE 18

➤ Lexical decision task ➤ Ran “morphology localiser” to select ROI ➤ 24 native English participants

SETUP

LEAKAGE BROTHER EXCURSION WINTER

  • isolatable stem, + congruent grammar
  • isolatable stem, - congruent grammar

+ isolatable stem, + congruent grammar + isolatable stem, - congruent grammar 53 items per condition

18
slide-19
SLIDE 19

RESULTS

➤ Hypotheses:

  • 1. Presence of a suffix morpheme
  • 2. Presence of an isolatable stem morpheme
  • 3. Presence of congruent syntax
  • 4. Combination: 2 or 3
19

CONDITION suffix isolatable stem congruent grammar combination 2 or 3 leakage 1 1 1 1 brother 1 1 1 excursion 1 1 1 winter 1

slide-20
SLIDE 20

RESULTS

➤ Analysis:

Mixed effects regression model

Ran in localised “morphology” region

Coded as binary variables

20

CONDITION suffix isolatable stem congruent grammar combination 2 or 3 leakage 1 1 1 1 brother 1 1 1 excursion 1 1 1 winter 1

slide-21
SLIDE 21

RESULTS

21

CONDITION suffix isolatable stem congruent grammar combination 2 or 3 leakage 1 1 1 1 brother 1 1 1 excursion 1 1 1 winter 1

t = 2.15, p = .03 t = 1.06, p = .105 p > .5

➤ Analysis:

Mixed effects regression model

Ran in localised “morphology” region

Coded as binary variables

not significant approaching significance

significant

slide-22
SLIDE 22

RESULTS

➤ Transition probability (TP) as an index of decomposition:

22

LEAK EXCUR- WINT-

  • ING
  • S
  • AGE

BROTH

  • S
  • ER
  • SION
  • ER
  • ER

TP < 1 TP < 1 TP = 1 TP = 1

slide-23
SLIDE 23

RESULTS

23

“excursion” “winter”

slide-24
SLIDE 24

To be recognized as a [stem] morpheme, a form must either (1) occur as a free form, making up a complete word, or (2) occur, with the same meaning, in more than one word.

  • R.M.W. Dixon
24

Making New Words, 2014: 3

EXPERIMENT 2 - TAKE AWAY

slide-25
SLIDE 25

To be recognized as a [stem] morpheme, a form must either (1) occur as a free form, making up a complete word, or (2) occur, with the same meaning, in more than one word.

  • R.M.W. Dixon
25

Making New Words, 2014: 3

EXPERIMENT 2 - TAKE AWAY

slide-26
SLIDE 26

To be recognized as a [stem] morpheme, a form must either (1) occur as a free form, making up a complete word, or (2) occur [within a complex word with grammatical wellformedness].

  • R.M.W. Dixon
26

Making New Words, 2014: 3

EXPERIMENT 2 - TAKE AWAY

slide-27
SLIDE 27

EXPERIMENT 3: REPRESENTATIONS OF NON-LINEAR ROOTS

27

Gwilliams & Marantz (2015)

slide-28
SLIDE 28

BACKGROUND

➤ In semitic languages such as Arabic and Hebrew, morphemes

are arranged in an interleaved manner:

K A T A B A

root morpheme ktb pattern morpheme

  • a-a-a
28
slide-29
SLIDE 29

QUESTION

➤ Are Arabic words processed through their constituent

morphemes, or as un-analysed wholes?

K A T A B A

root morpheme ktb pattern morpheme

  • a-a-a
29
slide-30
SLIDE 30

QUESTION

➤ The superior temporal gyrus is sensitive to how expected it is

for a sound to occur within a word

➤ We utilised this sensitivity to determine what morphological

constituents are activated during processing

K A T A B A K T B

p( B | KATA) p( B | KT)

30
slide-31
SLIDE 31

QUESTION

➤ The superior temporal gyrus is sensitive to how expected it is

for a sound to occur within a word

➤ We utilised this sensitivity to determine what morphological

constituents are activated during processing

K A T A B A K T B

frequency( KATAB) frequency(KATA) frequency( KTB) frequency(KT)

31
slide-32
SLIDE 32

QUESTION

➤ The superior temporal gyrus is sensitive to how expected it is

for a sound to occur within a word

➤ We utilised this sensitivity to determine what morphological

constituents are activated during processing

K A T A B A K T B

linear surprisal =

  • log(p( B | KATA))

morphological surprisal =

  • log(p( B | KT))
32
slide-33
SLIDE 33

linear surprisal =

  • log(p( B | KATA))

morphological surprisal =

  • log(p( B | KT))
33

Morphological Surprisal Linear Surprisal

MATERIALS

➤ 280 words with a CVCVCV structure

slide-34
SLIDE 34

QUESTION

34

/ð/ /ɒ/ /ʒ/ /i/ /ɹ/ /a/

Correlation Strength Time (ms) surprisal 1 surprisal 2

slide-35
SLIDE 35

RESULTS

35

/ð/ /ɒ/ /ʒ/ /i/ /ɹ/ /a/

slide-36
SLIDE 36

EXPERIMENT 3 - TAKE AWAY

➤ Spoken word processing in an understudied language such as

Arabic also shows morpheme specific processing

➤ Supports a morphological-driven theory of spoken word

comprehension rather than a model that assumes linear processing of phonemes (e.g., the cohort model)

36
slide-37
SLIDE 37

TODAY’S ANSWERS

37
  • 1. What is represented?
  • 2. How are representations formed?
  • 3. How are representations accessed?

Root and stem morphemes. Through the recognition of a represented stem across both visual and auditory modalities. Dependant upon grammatical wellformedness

slide-38
SLIDE 38

TODAY’S ANSWERS

➤ Data from neurophysiological techniques allow us to inform

and adjudicate between different theoretical models

38

Experimental approach informs theory Theory informs experimental approach

slide-39
SLIDE 39

THANK YOU, DANKE!

References: Gwilliams, L., & Marantz, A. (2015). Non-linear processing of a linear speech stream: The influence of morphological structure on the recognition of spoken Arabic words. Brain and language, 147, 1-13. Gwilliams, Lewis & Marantz (In Press). Functional characterisation of letter-specific responses in time, space and current polarity using magnetoencephalography. NeuroImage. Lewis, G., Solomyak, O., & Marantz, A. (2011). The neural basis of obligatory decomposition of suffixed words. Brain and language, 118(3), 118-127. Rastle, K., & Davis, M. H. (2008). Morphological decomposition based on the analysis of orthography. Language and Cognitive Processes, 23(7-8), 942-971. Solomyak, O., & Marantz, A. (2009). Lexical access in early stages of visual word processing: A single-trial correlational MEG study of heteronym recognition. Brain and language, 108(3), 191-196. Solomyak, O., & Marantz, A. (2010). Evidence for early morphological decomposition in visual word recognition. Journal of Cognitive Neuroscience, 22(9), 2042-2057. Stockall, L., & Marantz, A. (2006). A single route, full decomposition model of morphological complexity: MEG evidence. The Mental Lexicon, 1(1), 85-123. Tarkiainen, A., Helenius, P ., Hansen, P . C., Cornelissen, P . L., & Salmelin, R. (1999). Dynamics of letter string perception in the human occipitotemporal cortex. Brain, 122(11), 2119-2132. 39

contact: laura.gwilliams@nyu.edu

slide-40
SLIDE 40

RESULTS

40

Time (ms) Amplitude of Response