Motor cognition, cognition, Motor communication and and - - PowerPoint PPT Presentation

motor cognition cognition motor communication and and
SMART_READER_LITE
LIVE PREVIEW

Motor cognition, cognition, Motor communication and and - - PowerPoint PPT Presentation

Motor cognition, cognition, Motor communication and and communication the language faculty the language faculty Summer Institute, , The Origins The Origins of of Language Language Summer Institute UQAM, June June 23, 2010 23, 2010


slide-1
SLIDE 1

Motor Motor cognition, cognition, communication communication and and the language faculty the language faculty

Pierre Jacob Pierre Jacob Institut Jean Institut Jean Nicod Nicod Paris, France Paris, France http://www.institutnicod http://www.institutnicod

Summer Institute Summer Institute, , The Origins The Origins of

  • f Language

Language UQAM, UQAM, June June 23, 2010 23, 2010

slide-2
SLIDE 2

Three Three basic questions basic questions

(1) Contribution of (1) Contribution of somatotopic motor representations somatotopic motor representations of actions

  • f actions

triggered triggered by perception of action by perception of action verbs verbs to to understanding understanding of

  • f

meaning meaning of

  • f utterances

utterances? ? (2) Contribution of MN (2) Contribution of MN activity activity to to recursivity recursivity of

  • f

human human language faculty language faculty? ? (3) Contribution of MN (3) Contribution of MN activity activity to to addressee addressee’ ’s representation s representation of

  • f

speaker speaker’ ’s meaning s meaning or communicative intention?

  • r communicative intention?
slide-3
SLIDE 3

Structure Structure

  • 1.
  • 1. The human language faculty

The human language faculty

  • 2.
  • 2. Human

Human communication: an communication: an inferential inferential model model

  • 3.
  • 3. Motor representations

Motor representations of actions

  • f actions and

and lexical lexical semantics semantics

  • 4.
  • 4. The mirror

The mirror system system and the evolution and the evolution of

  • f

language language use use

  • 5. MN
  • 5. MN activity and

activity and communicative intentions communicative intentions

slide-4
SLIDE 4

The The HLF HLF

  • 1.1.

1.1. Why the core Why the core of

  • f the

the HLF HLF is syntax is syntax

  • 1.2.

1.2. Why the Why the HLF HLF includes recursive rules includes recursive rules

  • 1.3.

1.3. The evolutionary function The evolutionary function of

  • f the

the HLF HLF

slide-5
SLIDE 5

The The HLF HLF

  • 1.1.

1.1. Why the core Why the core of

  • f the

the HLF HLF is syntax is syntax

  • (i)

(i) Each Each expression expression

  • f a
  • f a natural language is

natural language is a a pairing pairing of

  • f

sound and meaning properties sound and meaning properties, i.e. < , i.e. <phonology phonology, , meaning meaning> >

  • (

(ii ii) ) The The < <phonology phonology, , meaning meaning> > mapping mapping for for any complex any complex phrase or sentence phrase or sentence depends depends on

  • n the

the < <phonology phonology, , meaning meaning> > mapping mapping for for its constituents its constituents. .

  • (

(iii iii) ) The syntax is the computational mechanism that The syntax is the computational mechanism that generates generates a a representation representation of

  • f the

the < <phonology phonology, , meaning meaning> > mapping mapping for a sentence for a sentence from the representation from the representation of

  • f the

the < <phonology phonology, , meaning meaning> > mapping mapping for for each each of

  • f its

its constituents constituents. .

slide-6
SLIDE 6

The The HLF HLF

  • 1.2.

1.2. Why the Why the HLF HLF includes recursive rules includes recursive rules

  • (1a)

(1a) Colorless Colorless green green ideas sleep furiously ideas sleep furiously

  • (1b) Chomsky

(1b) Chomsky wrote wrote ‘ ‘Colorless Colorless green green ideas sleep furiously ideas sleep furiously’ ’

  • (1c)

(1c) Fodor believes that Fodor believes that Chomsky Chomsky wrote wrote ‘ ‘Colorless Colorless green green ideas sleep furiously ideas sleep furiously’ ’

  • (1d)

(1d) Pinker doubts that Fodor believes that Pinker doubts that Fodor believes that Chomsky Chomsky wrote wrote ‘ ‘Colorless Colorless green green ideas sleep furiously ideas sleep furiously’ ’, , etc etc. .

  • (2a)

(2a) the girl the girl’ ’s s dog dog

  • (2b)

(2b) the girl the girl’ ’s friend s friend’ ’s s dog dog

  • (2c)

(2c) the girl the girl’ ’s friend s friend’ ’s cousin s cousin’ ’s s dog dog

  • (2d)

(2d) the girl the girl’ ’s friend s friend’ ’s cousin s cousin’ ’s roommate s roommate’ ’s s dog dog

slide-7
SLIDE 7

The recursivity The recursivity of

  • f the

the HLF HLF

  • (1a-d)

(1a-d) and and (2a-d) show (2a-d) show that there is that there is no grammatical no grammatical upper upper bound bound on

  • n

length length of sentences of

  • f sentences of English

English. .

  • If

If so so, , then there is then there is no grammatical no grammatical upper bound upper bound on

  • n

cardinality cardinality of set of

  • f set of English

English sentences. sentences.

  • If

If so so, , then syntax then syntax of

  • f English

English must must include recursive rules include recursive rules, , i.e. i.e. rules that can take their own rules that can take their own output as input

  • utput as input

( (indefinitely indefinitely): ):

  • (a) S —> NP VP
  • (b) VP —> V S
slide-8
SLIDE 8

The The HLF HLF cont cont. .

  • 1.3.

1.3. The evolutionary function The evolutionary function of

  • f the

the HLF HLF

  • The evolutionary function

The evolutionary function of

  • f the

the HLF HLF is is to to enable any enable any human human infant to infant to acquire her acquire her native native language language L L, i.e. , i.e. tacit tacit knowledge knowledge of

  • f the grammar

the grammar of

  • f L

L from her from her perception of perception of linguistic linguistic stimuli, i.e. stimuli, i.e. utterances utterances of sentences of

  • f sentences of L

L made made available available to to her her by speakers of by speakers of L L. .

  • Problem

Problem: : how how was the was the HLF HLF selected given that the selected given that the HLF HLF could only be could only be adaptive adaptive if if there were conspecifics around there were conspecifics around who spoke some natural language who spoke some natural language or

  • r other
  • ther?

?

slide-9
SLIDE 9

Structure Structure

  • 1.
  • 1. The human language faculty

The human language faculty

  • 2.
  • 2. Human

Human communication: an communication: an inferential inferential model model

  • 3.
  • 3. Motor representations

Motor representations of actions

  • f actions and

and lexical lexical semantics semantics

  • 4.
  • 4. The mirror

The mirror system system and the evolution and the evolution of

  • f

language language use use

  • 5. MN
  • 5. MN activity and

activity and communicative intentions communicative intentions

slide-10
SLIDE 10

Inference Inference in in human human communication communication

  • 2.1.

2.1. Decoding Decoding vs.

  • vs. inferential processes

inferential processes

  • 2.2.

2.2. The The code model vs. code model vs. the inferential the inferential model of model of communication communication

  • 2.3.

2.3. The Gricean inferential The Gricean inferential model of model of communication communication and mindreading and mindreading

  • 2.4.

2.4. The Gricean The Gricean tripartite model of tripartite model of meaning meaning

slide-11
SLIDE 11

Inference Inference in in human human communication communication

  • 2.1.

2.1. Decoding Decoding vs.

  • vs. inferential processes

inferential processes

  • A

A decoding decoding process maps a signal onto its associated process maps a signal onto its associated message by applying the rules of an underlying code. message by applying the rules of an underlying code.

  • An

An inferential inferential process derives a conclusion from a set of process derives a conclusion from a set of premises premises in such a way that the former is warranted in such a way that the former is warranted (justified) by the latter. (justified) by the latter.

  • A conclusion follows from, but is not associated with, its

A conclusion follows from, but is not associated with, its premises. premises.

  • Nor does a signal justify its message.

Nor does a signal justify its message.

slide-12
SLIDE 12

Inference Inference in in human human communication communication

  • 2.2.

2.2. The The code model vs. code model vs. the inferential the inferential model of model of communication communication

  • On the code model, most if not all of the content of a

On the code model, most if not all of the content of a speaker speaker’ ’s utterance has been coded into, and must be s utterance has been coded into, and must be decoded from, the linguistic meaning of the uttered decoded from, the linguistic meaning of the uttered sentence. sentence.

  • On an inferential model, the content of a speaker

On an inferential model, the content of a speaker’ ’s s utterance is vastly underdetermined by the coded utterance is vastly underdetermined by the coded linguistic meaning of the uttered sentence. linguistic meaning of the uttered sentence.

slide-13
SLIDE 13

Inference Inference in in human human communication communication

  • 2.3.

2.3. The Gricean inferential The Gricean inferential model of model of communication communication

  • On

On Gricean Gricean model, model, task task of

  • f addressee is

addressee is: : infer infer speaker speaker’ ’s s communicative intention communicative intention from behavioral from behavioral (verbal or (verbal or non- non- verbal verbal) ) cues cues, i.e , i.e task task of

  • f third-person mindreading

third-person mindreading. .

  • Bill:

Bill: Are Are you going you going out?

  • ut?
  • Jill

Jill: : It It’ ’s s raining raining. .

  • From

From explicit explicit meteorological meteorological content of J content of J’ ’s s utterance utterance, B , B infers infers implicit implicit content of J content of J’ ’s s response response ( (speaker speaker’ ’s meaning s meaning), ), which which depends depends on

  • n whether

whether B assumes B assumes that that J J likes likes or

  • r dislikes

dislikes to to walk walk in in rain rain! !

  • However

However, , Grice restricted role Grice restricted role of

  • f inferential mindreading

inferential mindreading mechanisms mechanisms to computation of to computation of implicit implicit content of content of utterances utterances. .

slide-14
SLIDE 14

Inference Inference in in human human communication communication

coded linguistic meaning coded linguistic meaning explicit explicit truth-conditional truth-conditional content content

  • f
  • f utterance

utterance ( (what is said what is said) ) Literal Literal Content Content

linguistically linguistically guided guided saturation saturation (e.g (e.g semantic semantic values values

  • f
  • f indexicals

indexicals) )

implicit implicit content content ( (implicatures implicatures) of ) of utterance utterance Non-literal Non-literal content content

mindreading- mindreading- based inferences based inferences

2.4. 2.4. The Gricean The Gricean tripartite model of tripartite model of meaning meaning

slide-15
SLIDE 15

Interim summary Interim summary

Human Human verbal communication verbal communication makes makes use of use of two two dissociable dissociable kinds kinds of cognitive

  • f cognitive processes

processes: : a) a) the the HLF HLF with with a a recursive syntax required recursive syntax required for for combining meanings combining meanings of

  • f constituents into sentential

constituents into sentential meanings meanings and and b) b) mindreading-based pragmatic inferential mindreading-based pragmatic inferential processes involved processes involved in in determining speaker determining speaker’ ’s s meaning meaning (i.e. communicative intention). (i.e. communicative intention).

slide-16
SLIDE 16

Structure Structure

  • 1.
  • 1. The human language faculty

The human language faculty

  • 2.
  • 2. Human

Human communication: an communication: an inferential inferential model model

  • 3.
  • 3. Motor representations

Motor representations of actions

  • f actions and

and lexical lexical semantics semantics

  • 4.
  • 4. The mirror

The mirror system system and the evolution and the evolution of

  • f

language language use use

  • 5. MN
  • 5. MN activity and

activity and communicative intentions communicative intentions

slide-17
SLIDE 17

Structure Structure

  • 1.
  • 1. The human language faculty

The human language faculty

  • 2.
  • 2. Human

Human communication: an communication: an inferential inferential model model

  • 3.
  • 3. Motor representations

Motor representations of actions

  • f actions and

and lexical lexical semantics semantics

  • 4.
  • 4. The mirror

The mirror system system and the evolution and the evolution of

  • f

language language use use

  • 5. MN
  • 5. MN activity and

activity and communicative intentions communicative intentions

slide-18
SLIDE 18

Motor representations and the lexicon Motor representations and the lexicon

  • 3.1. Evidence for

3.1. Evidence for semantic somatotopic embodied semantic somatotopic embodied representations representations of actions

  • f actions (

(SSERA SSERA) ) denoted denoted by action by action words words

  • 3.2.

3.2. Truth-conditional inferential pragmatic processes Truth-conditional inferential pragmatic processes

  • 3.3.

3.3. At which level At which level of

  • f meaning

meaning do do SSERAs make SSERAs make a a contribution to contribution to the understanding the understanding of

  • f the

the content of an content of an utterance utterance? ?

slide-19
SLIDE 19

Brain systems Brain systems for for language language & action & action

a) a) Somatotopy Somatotopy of

  • f motor

motor and premotor and premotor cortex: cortex: location of location of arm/hand arm/hand, , foot/leg representations foot/leg representations b) Connections b) Connections language/ language/ action action systems systems. . c) c) Semantic somatotopy Semantic somatotopy model of model of word processing word processing: : action action words can words can relate to relate to different different body parts to body parts to which which they they are are semantically semantically linked linked (e.g. (e.g. ‘ ‘lick lick’ ’, , ‘ ‘pick pick’ ’, , ‘ ‘kick kick’ ’) )

From Pulvermüller (2005)

slide-20
SLIDE 20

Cortical activation Cortical activation during movement during movement vs. vs. passive passive reading reading of action

  • f action words

words

a) a) Execution Execution of actions

  • f actions

involving involving distinct body distinct body parts parts b) Passive b) Passive reading reading of

  • f

words words for actions for actions involving involving distinct body distinct body parts parts ( (Pulverm Pulvermüller üller, 2005) , 2005)

« « This This “ “semantic somatotopy semantic somatotopy” ” has has provided provided a major argument a major argument supporting the idea that semantic mechanisms supporting the idea that semantic mechanisms are are grounded grounded in in action-perception systems action-perception systems of

  • f the brain

the brain » ( » (Boulenger Boulenger et al. (2008) et al. (2008)

slide-21
SLIDE 21

Subjects silently read either literal Subjects silently read either literal ( (‘ ‘J.

  • J. grasped the cup

grasped the cup’ ’) or ) or idiomatic idiomatic ( (‘ ‘J.

  • J. grasped the idea

grasped the idea’ ’) action sentences. ) action sentences. Brain metabolic Brain metabolic activity was measured activity was measured in in either either short ( short (onset

  • nset of
  • f object
  • bject NP

NP processing processing) or ) or late late (3 s (3 s after end after end of

  • f processing

processing) ) window analysis window analysis ( (Boulenger Boulenger et al., 2008) et al., 2008)

slide-22
SLIDE 22

Three Three possible possible interpretations interpretations

  • 1.

1. Semantic somatotopic embodied representations Semantic somatotopic embodied representations

  • f actions (SSERA)
  • f actions (SSERA) constitute grasping the meaning

constitute grasping the meaning

  • f action
  • f action verbs

verbs. .

  • 2.

2. SSERA SSERA causally contribute causally contribute to to grasping the grasping the meaning meaning of action

  • f action verbs

verbs. .

  • 3.

3. Grasping meaning Grasping meaning of action

  • f action verbs

verbs cause cause activation of SSERA. activation of SSERA.

slide-23
SLIDE 23
  • «

« The present results The present results support a support a compositional compositional perspective perspective

  • n
  • n semantic processing postulating that idiom meaning is

semantic processing postulating that idiom meaning is computed from the semantics computed from the semantics of constituent

  • f constituent words and from

words and from combinatorial combinatorial information.

  • information. Semantic somatotopy

Semantic somatotopy to to idioms idioms indeed suggests that meaning indeed suggests that meaning aspects of aspects of words words in in these these sentences are sentences are being re-accessed being re-accessed and and combined combined in in the the relatively late relatively late construction of sentence construction of sentence meaning meaning. . » » ( (Boulenger Boulenger et al., 2008) et al., 2008)

  • «

« According According to to the embodied the embodied cognition cognition hypothesis hypothesis, , the the motor motor system system is activated is activated because because that that activation activation is causally is causally involved involved in in the analysis the analysis of

  • f the

the sentence.

  • sentence. According

According to to the the disembodied disembodied cognition cognition hypothesis hypothesis, , the observed motor the observed motor activation activation is is due to information due to information spreading throughout the spreading throughout the system system » » (Mahon & (Mahon & Caramazza Caramazza, 2008) , 2008)

Two Two perspectives perspectives

slide-24
SLIDE 24

Next Next question question

  • What is the

What is the contribution of contribution of semantic somatotopic semantic somatotopic embodied representations embodied representations of actions (SSERA) to

  • f actions (SSERA) to

addressee addressee’ ’s understanding s understanding of

  • f

explicit ( explicit (and implicit and implicit) ) propositional propositional content content expressed expressed by by speaker speaker’ ’s s utterance utterance of

  • f the

the sentence sentence ‘ ‘John John kicked the bucket kicked the bucket’ ’? ?

slide-25
SLIDE 25

Truth-conditional pragmatic processes Truth-conditional pragmatic processes

  • Free

Free enrichment enrichment + + conceptual strengthening conceptual strengthening

  • 1.
  • 1. Bob gave Mary

Bob gave Mary his key and she opened the door his key and she opened the door

  • Explicit content:

Explicit content: Bob gave Mary Bob gave Mary his key at his key at t t and and Mary Mary opened the

  • pened the

door at door at t+1 [ t+1 [with with Bob Bob’ ’s s key key] ]

  • 2.

2. Mother Mother to to crying bruised child crying bruised child: : You You are not are not going going to die! to die!

  • Explicit content:

Explicit content: You You are not are not going going to die [ to die [from your bruise from your bruise]. ].

  • Conceptual loosening

Conceptual loosening+ +metaphor metaphor

  • My

My steak steak is raw is raw (explicit content: (explicit content: my my steak steak is undercooked is undercooked) )

  • The

The ATM ATM swallowed my card swallowed my card (explicit content: (explicit content: loosening loosening conditions for application of conditions for application of ‘ ‘swallow swallow’ ’) )

  • Transfer

Transfer

  • The ham

The ham sandwich sandwich left without paying left without paying (explicit content: (explicit content: the guy the guy who ordered who ordered a a ham ham sandwich sandwich… …) )

  • I

I’ ’m m parked parked out back

  • ut back (explicit content:

(explicit content: The owner The owner

  • f a car
  • f a car…

…) )

slide-26
SLIDE 26

encoded linguistic meaning encoded linguistic meaning explicit explicit truth-conditional truth-conditional content ( content (what is said what is said) ) literal literal meaning meaning implicatures implicatures non-literal non-literal meaning meaning Gricean Gricean minimalist minimalist picture picture encoded linguistic meaning encoded linguistic meaning explicit explicit truth-conditional truth-conditional content ( content (what is said what is said) )

  • implicatures

implicatures speaker speaker’ ’s s meaning meaning post-Gricean post-Gricean truth- truth- conditional conditional pr pragmatic agmatic picture picture inferential inferential processes processes inferential inferential processes processes saturation saturation

slide-27
SLIDE 27

Which level Which level of

  • f meaning involves SSERAs

meaning involves SSERAs? ?

  • Speculation

Speculation! !

  • The

The contribution of contribution of semantic somatotopic embodied semantic somatotopic embodied representations representations

  • f actions (
  • f actions (denoted

denoted by action by action verbs verbs) to ) to lexically encoded linguistic meanings lexically encoded linguistic meanings of action

  • f action words

words seems seems open question.

  • pen question.
  • But I

But I surmise that the mindreading-based inferential surmise that the mindreading-based inferential processes involved processes involved in in computing both the truth- computing both the truth- conditional conditional explicit content explicit content and the implicatures and the implicatures of an

  • f an

utterance containing utterance containing an action an action verb verb (e.g. (e.g. ‘ ‘I I want want to to pick pick your brain your brain’ ’, , ‘ ‘J.

  • J. kicked the bucket

kicked the bucket’ ’, , ‘ ‘A.

  • A. grasped the idea

grasped the idea’ ’) ) generate generate ‘ ‘disembodied disembodied’ ’ representations representations of

  • f speaker

speaker’ ’s s meaning meaning. .

slide-28
SLIDE 28

Structure Structure

  • 1.
  • 1. The human language faculty

The human language faculty

  • 2.
  • 2. Human

Human communication: an communication: an inferential inferential model model

  • 3.
  • 3. Motor representations

Motor representations of actions

  • f actions and

and lexical lexical semantics semantics

  • 4.
  • 4. The mirror

The mirror system system and the evolution and the evolution of

  • f language

language

  • 4.1.

4.1. Two Two distinct distinct hypotheses hypotheses

  • 4.2.

4.2. Recursivity Recursivity, , MNs and the MNs and the HLF HLF

  • 4.3.

4.3. “ “The battle The battle for Broca for Broca’ ’s area s area” ”

  • 5. MN
  • 5. MN activity and

activity and communicative intentions communicative intentions

slide-29
SLIDE 29

MN MN activity activity

Rizzolatti Rizzolatti et al. (1996) et al. (1996) Buccino Buccino et al. (2003) et al. (2003)

slide-30
SLIDE 30

Two Two rival rival views views of

  • f mirroring

mirroring

slide-31
SLIDE 31

What does What does MN MN activity activity code? code?

  • According

According to to the the direct direct matching matching model, model, MNs enable MNs enable observer

  • bserver

to to understand agent understand agent’ ’s s action by action by directly mapping agent directly mapping agent’ ’s s

  • bserved movements
  • bserved movements onto
  • nto observer
  • bserver’

’s motor repertoire s motor repertoire: « : « an an action action is understood when its is understood when its observation causes

  • bservation causes the

the

  • bserver
  • bserver’

’s motor s motor system to system to ‘ ‘resonate resonate’ ’ » ( » (Rizzolatti Rizzolatti et al., et al., 2001). 2001).

  • The

The direct direct matching matching model model was challenged was challenged by Csibra by Csibra’ ’s (2007) s (2007) dilemma dilemma: :

  • - If
  • If mirroring faithfully

mirroring faithfully duplicates duplicates agent agent’ ’s observed s observed movements movements, , then it fails then it fails to to represent the agent represent the agent’ ’s s goal goal. .

  • - If
  • If mirroring enables

mirroring enables observer to

  • bserver to represent agent

represent agent’ ’s s goal goal, , then then understanding understanding can can’ ’t t arise arise from from direct direct matching matching of

  • f agent

agent’ ’s s

  • bserved movements
  • bserved movements onto
  • nto observer
  • bserver’

’s motor repertoire s motor repertoire. .

slide-32
SLIDE 32

MNs and language-use MNs and language-use

  • «

« Our Our proposal is that the development proposal is that the development of

  • f the human lateral

the human lateral speech circuit speech circuit is is a a consequence consequence of

  • f the fact that the precursor

the fact that the precursor of

  • f

Broca Broca’ ’s area s area was endowed was endowed, , before before speech speech appearance appearance, , with with a a mechanism mechanism for for recognizing recognizing actions made by actions made by others

  • thers. This

. This mechanism was the mechanism was the neural neural prerequisite prerequisite for for the development the development of

  • f

interindividual interindividual communication communication and finally and finally of speech.

  • f speech. We thus

We thus view language view language in a more in a more general setting than general setting than one

  • ne that sees

that sees speech as speech as its complete its complete basis. basis. » ( » (Rizzolatti and Arbib Rizzolatti and Arbib, 1998) , 1998)

  • Two

Two possible possible interpretations explored interpretations explored by e.g. by e.g. Arbib Arbib (2006), (2006), Fogassi Fogassi & & Ferrarri Ferrarri (2007): (2007):

  • (1) MN

(1) MN activity activity serves as serves as phylogenetic precursor phylogenetic precursor of

  • f the

the HLF. HLF.

  • (2) MN

(2) MN activity activity serves as serves as phylogenetic precursor phylogenetic precursor of

  • f human

human mindreading inferential ability mindreading inferential ability to to represent agent represent agent’ ’s s communicative intention. communicative intention.

slide-33
SLIDE 33

Recursivity Recursivity: HLF : HLF and motor and motor system system

“ “However However, , the flow diagram given the flow diagram given by by Byrne Byrne (2003) shows (2003) shows that that the processing used the processing used by a by a mountain gorilla when preparing mountain gorilla when preparing bundles of bundles of nettle leaves nettle leaves to to eat is clearly eat is clearly recursive recursive. . Gorillas Gorillas ( (like many other species like many other species, , and and not not only mammals

  • nly mammals) have

) have the the working memory working memory to to refer their next refer their next action not action not only

  • nly to

to sensory sensory data but data but also also to to the the state of state of execution execution of

  • f some current

some current plan. plan. Hence Hence, , when we refer when we refer to to the monkey the monkey’ ’s grasping and ability s grasping and ability to to recognize similar grasps recognize similar grasps in in

  • thers
  • thers,

, it is it is a a mistake mistake to to treat the treat the individual grasps individual grasps in in isolation isolation – – the the F5 F5 system system is is part of a part of a larger larger system system that can that can direct direct those grasps those grasps as part of a as part of a recursively recursively structured structured plan plan… … From this From this point of point of view view, , recursion recursion in in language is language is a a corollary corollary of

  • f

the essentially the essentially recursive recursive nature of nature of action action and and perception perception…” …” ( (Arbib Arbib, 2006) , 2006)

slide-34
SLIDE 34

Recursivity Recursivity: : MNs and the MNs and the HLF HLF

“Based Based on

  • n these findings

these findings, , we postulated that the motor we postulated that the motor system system is organized into is organized into neuronal neuronal chains chains, , each coding each coding for a for a specific specific goal goal and combining different elements and combining different elements ( (motor acts motor acts) )

  • f
  • f the

the action.

  • action. Further

Further [ [… …] data on ] data on the monkey parietal and the monkey parietal and premotor premotor cortex have cortex have shown that this shown that this type of type of organization is

  • rganization is

valid also valid also for longer action for longer action sequences sequences in in which the same which the same element element of a

  • f a chain is

chain is recursively recursively involved involved in in different steps different steps

  • f
  • f the sequence

the sequence. . Although this organization is certainly very Although this organization is certainly very basic, in basic, in terms terms of

  • f hierarchical

hierarchical arrangement, arrangement, combinatorial combinatorial power, power, achievement achievement of

  • f meaning and predictive

meaning and predictive value [ value [… …], ], it it has has much much in in common with the syntactic common with the syntactic structure of structure of language language. .” ” ( (Fogassi Fogassi & & Ferrarri Ferrarri, 2007) , 2007)

slide-35
SLIDE 35

“ “The battle The battle for Broca for Broca’ ’s s region region” ”

Grodzinsky Grodzinsky & & Santi Santi (2008) (2008)

slide-36
SLIDE 36

Aphasic Aphasic patients patients with lesion with lesion in Broca in Broca’ ’s area s area presented with English presented with English sentences sentences and pictures and pictures: patients must point to correct : patients must point to correct picture picture. .

Evidence for SM Evidence for SM based based on Broca

  • n Broca’

’s s aphasics aphasics

slide-37
SLIDE 37

Grodzinsky Grodzinsky & & Santi Santi (2008) (2008) In Broca In Broca’ ’s s region effect region effect for for movement movement, not , not reflexive binding reflexive binding

slide-38
SLIDE 38

On On the the second second interpretation interpretation of

  • f the hypothesis

the hypothesis about about the phylogenetic role the phylogenetic role of

  • f the mirror

the mirror system in system in the evolution the evolution of

  • f human language

human language use, use, the mirror the mirror system system enables enables an an addressee addressee to to represent the represent the speaker speaker’ ’s s communicative intention. communicative intention.

slide-39
SLIDE 39

Structure Structure

  • 1.
  • 1. The human language faculty

The human language faculty

  • 2.
  • 2. Human

Human communication: an communication: an inferential inferential model model

  • 3.
  • 3. Motor representations

Motor representations of actions

  • f actions and

and lexical lexical semantics semantics

  • 4.
  • 4. The mirror

The mirror system system and the evolution and the evolution of

  • f language

language

  • 5. MN
  • 5. MN activity and

activity and communicative intentions communicative intentions

  • 5.1.

5.1. Does Does MN MN activity generate observer activity generate observer’ ’s understanding s understanding of

  • f

agent agent’ ’s s prior prior intention? intention?

  • 5.2.

5.2. Does Does MN MN activity generate observer activity generate observer’ ’s understanding s understanding of

  • f

agent agent’ ’s s social social intention? intention?

  • 5.3.

5.3. Does Does MN MN activity generate addressee activity generate addressee’ ’s understanding s understanding

  • f
  • f agent

agent’ ’s s communicative communicative intention? intention?

slide-40
SLIDE 40

The The structure of structure of human human intentions intentions

Does Does agent agent intend intend to affect to affect conspecific conspecific’ ’s behavior s behavior? ?

No! No! Yes Yes! ! non-social non-social social social intention intention intention intention to to perform perform basic action basic action non-basic non-basic =motor =motor action=prior action=prior intention intention intention intention by by conspecific conspecific’ ’s s recognition of recognition of agent agent’ ’s s intention? intention? No! No! Yes Yes! ! non-commu- non-commu- communica- communica- nicative nicative tive tive

slide-41
SLIDE 41

Do Do MNs generate understanding MNs generate understanding of

  • f

agent agent’ ’s prior s prior intention? intention?

Umiltà et al. (2001)

slide-42
SLIDE 42

Do Do MNs generate understanding MNs generate understanding of

  • f

agent agent’ ’s prior s prior intention? intention?

Iacoboni Iacoboni et al. (2005) et al. (2005)

motor motor intention intention to to grasp grasp prior prior intention intention to drink vs to drink vs prior prior intention intention to to clean clean

slide-43
SLIDE 43

Do Do MNs generate understanding MNs generate understanding of

  • f

agent agent’ ’s s social intentions? social intentions?

Dr Dr Jekyll and Jekyll and Mr Mr Hyde may Hyde may have have same motor same motor intention to intention to grasp grasp scalpel, but scalpel, but former has social intention to cure patient, latter to former has social intention to cure patient, latter to enjoy victim enjoy victim’ ’s s pain. pain. Unlikely that MNs Unlikely that MNs in Dr Watson in Dr Watson’ ’s s brain brain can can tell tell the difference between the difference between J J’ ’s s and and H H’ ’s social intentions s social intentions (Jacob & (Jacob & Jeannerod Jeannerod, 2005; Jacob, 2008). , 2005; Jacob, 2008).

slide-44
SLIDE 44

Is kinematics Is kinematics sensitive to sensitive to agent agent’ ’s s social social intention? intention?

Becchio et al. (2008) place

placing into placing into container vs. passing to container vs. passing to partner partner

slide-45
SLIDE 45

Comments Comments on

  • n Becchio

Becchio et al. et al.

  • 1.
  • 1. The experiment

The experiment shows existence of shows existence of kinematic kinematic differences differences between between ‘ ‘social social’ ’ and and ‘ ‘non-social non-social’ ’ executive executive tasks tasks, , not not that that human human observer

  • bserver can

can perceptually perceptually pick pick up up the differences the differences — — let let alone alone via via MN MN activity activity in in observer

  • bserver’

’s brain s brain. .

  • 2.
  • 2. Given that shape

Given that shape of

  • f human

human hand hand is is perceptually perceptually more more complex than ovoid complex than ovoid container, container, Fitt Fitt’ ’s s law law — — kinematics kinematics of

  • f

transitive transitive acts acts (e.g. speed (e.g. speed) ) varies varies with difficulty with difficulty of

  • f task

task— — may may explain explain data. data.

  • If

If so so, , then unclear that experiment is response then unclear that experiment is response to challenge: to challenge: could MNs could MNs in in observer

  • bserver’

’s brain discriminate between s brain discriminate between Dr Dr Jekyll Jekyll’ ’s s and and Mr Hyde Mr Hyde’ ’s distinct social intentions s distinct social intentions? ?

  • 3. A
  • 3. A good

good control: test place control: test place into into container container lying lying on a table vs.

  • n a table vs.

place place into into container container hand-held hand-held by by another another. .

slide-46
SLIDE 46

Iago Iago’ ’s s non-communicative non-communicative social social intention intention

  • Iago intends

Iago intendss

s

Othello to believe that Desdemona has Othello to believe that Desdemona has been unfaithful to Othello by displaying pictures of been unfaithful to Othello by displaying pictures of Desdemona; Desdemona;

  • Presented with

Presented with Iago Iago’ ’s s evidence, Othello acquires the evidence, Othello acquires the belief that Desdemona has betrayed him. belief that Desdemona has betrayed him.

  • But since

But since Iago Iago did not want Othello to recognize his did not want Othello to recognize his social intention social intention I Is

s (to make Othello believe that

(to make Othello believe that Desdemona has been unfaithful to him), Desdemona has been unfaithful to him), Iago Iago’ ’s s social social intention intention I Is

s is not overt and thus not a communicative

is not overt and thus not a communicative intention intention I Ic

c.

.

slide-47
SLIDE 47

Representing another Representing another’ ’s s communicative communicative intention intention

  • Forming

Forming a a commmunicative commmunicative intention intention I Ic

c: by

: by pointing her pointing her index index finger towards her wrist-watch finger towards her wrist-watch, , Jill Jill expresses expresses her her intention intention that that [Bob [Bob believes believes [ [that she believes that she believes [ [that it is that it is late late]]] ]]]

  • Jill

Jill’ ’s s I Ic

c has 3

has 3 levels levels of

  • f embedding and is thus

embedding and is thus a 3 a 3rd

rd

  • rder
  • rder

metarepresentation metarepresentation. .

  • If

If so so, , then then Bob Bob’ ’s s representation representation of Jill

  • f Jill’

’s s I Ic

c requires ability

requires ability to to form form 4 4th

th

  • rder metarepresentations
  • rder metarepresentations.

.

  • Overtness

Overtness

  • f communicative intentions:
  • f communicative intentions: the

the content of Jill content of Jill’ ’s s I Ic

c is reflexive

is reflexive in in that she intends that she intends Bob to Bob to come come to to believe believe that she believes that that she believes that it it’ ’s s late late by by virtue virtue of

  • f recognizing her

recognizing her

  • wn I
  • wn Ic

c.

.

slide-48
SLIDE 48

Conclusion Conclusion

  • It

It’ ’s s unlikely that unlikely that MN MN activity activity in in addressee addressee’ ’s brain is s brain is sufficient sufficient to to generate representation generate representation of

  • f speaker

speaker’ ’s s communicative intention. communicative intention.

  • Open question:

Open question: is is MN MN activity activity necessary necessary for for enabling addressee enabling addressee to to form form a a representation representation of

  • f

speaker speaker’ ’s s communicative intention? communicative intention?

slide-49
SLIDE 49

THANK YOU FOR YOUR THANK YOU FOR YOUR A TTENTION! A TTENTION!