F&G':&'G,'1,H1,9,#+'G%"+'G,'I#&GJ' - PowerPoint PPT Presentation

KLMNOMM''' PQ/*R' F&G':&'G,'1,H1,9,#+'G%"+'G,'I#&GJ' !"#$%"&'()' *+"+,'-,.'/"0&1"+&1.'&2'3&4#)56,'7,81&9$),#$,'"#:'/,"1#)#4' ;<=>?$=&6,1#';#95+8+,'2&1'(1")#'@,9,"1$%'' (,)A)#4'7&1B"C'D#)6,19)+.E'3%)#"' 1

Object knowledge/semantic memory/concepts “moo~” � !"#$%"! 2

&)*+!!,-.! Losing semantic knowledge ! ! Russian Literature professor in Shanghai 6 3 year old, left temporal lobe atrophy “ � A kind of animal? Often seen in my neighbourhood. Long nose, can accompany me to grocery ” � shopping ! Semantic impairment lead to difficulties in language, object recognition, object use ! !"#$%&'$%()*$%+'$%,-#$%.'$%/"$%0'$%/1-"#%!-#2$%34556%/"$%0'$%78"$%9'$%7)$%:'$%,-#$%.'$%;"-#2$%9'$%:-1-<-==-$%>'$%:*1?8@$%34556%/"$%0'$%,-#$%.'$%AB)$% ,'$%:-1-<-==-$%>'$% &'( %&8)1*CDEFB'$%344G% 3

Reductionist: to sensory/motor experience Whence comes [the mind] by that vast store, which the busy and boundless fancy of man has painted on it with an almost endless variety? ... To this I answer, in one word, From experience . /'0#!1'23+ 4567849:; cattle � !"#$%&'()$*)"+,-).//0-)1"*)2$3)1$4%'&56

Represented at the sensory/motor sites? 3$23"?+(!=@! carry/arm mv lick/tongue !"#$% & ,-)M%8?%-J'$%344N$%&8)1*#% <%=>! A"<<*#D%8?%-J'$%344G$%:818O%:*1?8@% H-1I#%8?%-J'$%5KKL$%AF"8#F8%% A"<<*#D%8?%-J'$%345P%&-?%&8)1*DF"% 5

Questions: A0)B!$*!C+>C+*+#B+D!)B!B0+!*+#*'CE!*$B+*F!! !G0)>+!'#!@+#BC)?!@$*%)?!>)B0H)E!IJKL&MN!J$*%)?!O'C=)BF! P'H!)C+!D$Q+C+#B!BE>+*!'O!3#'H?+D(+!R'%#D!B'(+B0+CF! !S#)B'=$2)?!)#D!O%#2T'#)?!#+BH'C3*N!C+U+2B!2'##+2T'#*! )2C'**!*+#*'CE"='B'C!*$B+*F! 6

Visual pathway .)#H$*0+CV!7:4:W!.C$+(+*3'CB+V!7::XW! Y)CT#V!7::9 7

Reflect visual properties &+#B+C8Z+C$>0+CE! 1'H8?+@+?!J$*%)?!^+)B%C+!ZC$#2$>?+ KC()#$[)T'#!ZC$#2$>?+ ! G2+#+8-+2T?$#+)C!G+#*$T@+#+**! -+2T?$#+)C!@*]!-'%#D ! !" !" " #% # - 1 ! !" !" " #$ # &-D1%8?%-J'$%345N ! S#$=)B+8&%C@+!G+#*$T@+#+**! O)2+ R%$?D$#(* P+?@+T2) L+BC$* &)CB''#!O)2+* Y'#3+E!O)2+* KR<+2B*!\!O)2+* X 7 87 8X !8QE%8?%-J'$%3445 A1"B-D-<%8?%-J'$%345N 8

But similar selectivity without visual experience ! G'=+!0$(0+C!'CD+C!JKL&!C+($'#!O%#2T'#!I2)B+('C$2)?!>C+O+C+#2+*M!$*! $#D+>+#D+#B!'O!@$*%)?!+g>+C$+#2+! S=+D$!+B!)?]V!7::9V!! KR<+2B*! 1KB@! _)B!_+%C'*2$! ! Y)0'#!+B!)?]V!7::`V! S#$)=B+" Y+D^aW1 _+%C'#! $#)#$=)B+! K&! A'?R+C*!+B!)?]V!7:44V!! 1+('!*2+#+! ZZS! 1)C(+!'R<+2B* L''?* S#$=)?* &%CC!b$'?! -+$20!+B!)?]V!7:44V! bC)$??+! JA^S! &%CC!b$'?! GBC$+=8S=$B!+B!)?]V! 1+c+C!*0)>+*! JA^S! 7:47V!_+%C'#! RE!GGd GBC$+=8S=$B!e! S=+D$V!7:4;V!&%CC! b'DE! -$(0B!fbS! b$'?! 7$)$*)"+,-)./89-) !-128%*OR% !!=) 1$4%':;"<$) !$$+$()$*)"+,-)./89-) ?**JD% @AB?) >'?1) 9

Function and connection: Congenitally blind vs. Sighted Measure 1: Measure 2: Task induced activation level to Resting-state functional 16 object categories: connectivity pattern human face parts, human body parts, daily scenes, tools, Vector 1-180 mammals, reptiles, birds, fishes, bugs, fruits and vegetables, flowers, preserved food, clothes, musical instruments, • Blind =/= sighted " vehicles, furniture Shaped by visual input • Blind = sighted " Not fully dependent on visual input C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56) 10

Function and connection: Congenitally blind vs. Sighted L)*3!$#D%2+D!)2T@)T'#! -+*T#(8*B)B+!O%#2T'#)?! ?+@+?!B'!45!'R<+2B! 2'##+2T@$BE!>)c+C#! 2)B+('C$+*N!! C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56) 11

Correspondence between connectional and functional fingerprints across VOTC L)*3!)2T@)T'#!*$=$?)C$BE!=)> -G^&!>)c+C#!*$=$?)C$BE!=)> C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56) 12

“Multi-modal” region1: anterior medial temporal C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56) 13

“Multi-modal” region1: anterior medial temporal C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56) 14

“Visual” regions C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56) 15

! 1$#3$#(!)#)B'=$2)?!O+)B%C+*!B'!?)C(+8*2)?+!O%#2T'#)?! =)>*!$#!B0+!@+#BC)?!B+=>'C)?!2'CB+g! 16 H%6++IJK$5*'%-)L,-)E)C$6($%-)L,J,-)./8M-)1"*)2$3)1$4%'&56)

JKL& Review Object Domain and Modality in the Ventral Visual Pathway Yanchao Bi, 1, * Xiaoying Wang, 1 and Alfonso Caramazza 2,3 The nature of domain-speci fi c organization in higher-order visual cortex (ventral Trends occipital temporal cortex, VOTC) has been investigated both in the case of visual A wave of recent studies has reported Q152"$+' Q#)B"+,' Y'C+!h$*'?)B+Di!OC'=!! Y'C+!BC)#*>)C+#B!=)>>$#(! #'#@$*%)?!>C'>+CT+*! H$B0!)2T'#"O%#2T'#!C+>C! ! +)*$?E!)22+**+D!RE!D$Q! ! ='D)?$T+*! Y'C+!h@$*%)?i! Y'C+!h=%?T='D)?i! F6)N,-)C"(<)O,)E)?"%";"DD")=,-)./8P-)B%$(Q&)?'<)J56))

P'H!2)#!H+!B+*B!$BF! ! Q152"$+' 88!$*!*0)>+!C+>C+*+#B)T'#! 0+C+!O'C!)CTO)2B*!BC%?E! Y'C+!BC)#*>)C+#B!=)>>$#(! =%?T8='D)?F! H$B0!)2T'#"O%#2T'#!C+>C! ! +)*$?E!)22+**+D!RE!D$Q! 88!$*!'%C!>+C2+>T'#!*0)>+*! ='D)?$T+*! RE!'%C!h)CTO)2Bi8?$3+!)2T'#! $#B+C)2T'#F Y'C+!h=%?T='D)?i! F6)N,-)C"(<)O,)E)?"%";"DD")=,-)./8P-)B%$(Q&)?'<)J56))

Molyneux’s problem ! L0+!j%+*T'#!H)*!'C$($#)??E!>'*+D!B'!1'23+!RE!>0$?'*'>0+C!A$??$)=!Y'?E#+%gV! H0'*+!H$O+!H)*!R?$#DN! � “ � Suppose a man born blind, and now adult, and taught by his touch to distinguish between a cube and a sphere of the same metal, and nighly of the same bigness, so as to tell, when he felt one and the other, which is the cube, which is the sphere. Suppose then the cube and the sphere placed on a table, and the blind man made to see: query, Whether by his sight, before he touched them, he could now distinguish and tell which is the globe, which the cube? ” � !"#$%&'()*+&',-'.//01'2"-#%3-4-5'6780-'9-:%3/;0-:4-5 && 20

21

Testing the shape knowledge explicitly !

Method ! Participants – Sighted visual (12 good Ss, picture input) – Sighted auditory (14 good Ss, word input) – Blind auditory (13 good Ss, word input) ! Materials – 33 everyday artifacts ! Ratings – Pixel similarity – Shape similarity – Tactile similarity – (checked both colledge Ss ratings and fMRI Ss ratings. Results were similar. Here report results with colledge Ss ratings) ! Task ! Hear object name (e.g. “key”) – judge is it larger or smaller than an average palm? � ER design: 8 runs. Each stimulus repeated twice each run.

Artifact “multimodal” shape representation Shape similarity ratings k#D+>+#D+#B!C)T#(! 0.84** 0.88** 0.84** • @'0,+G,,#'9%"H,'"#:'+"$5C,S'OLL' S88J8#$%,8$%,-#$%:-1-<-==-$%/"$%345N$%;%&8)1*DF"% 24

IT: [Multi-modal] Shape knowledge in blind and sighted -+>C+*+#B)T'#!*$=$?)C$BE! )#)?E*$*!! kL! I.C$+(+*3'CB+!+B!)?]V!7::XM! S88J8#$%,8$%,-#$%:-1-<-==-$%/"$%345N$%;%&8)1*DF"% 25

Learning: Association with different types of interactions aC)>0!J$+H$#( J$D+'!A)B20$#( 26 _)@$()T'#! Y)#$>%?)B+! G'2$)?! I?)C(+!'R<"! !I*=)??!)CTO)2BM IO)2+M 1)#D=)C3M 0-#2$%,8T%8?%-J'$%"#%C18C

-+($'#*!*0'H$#(!*+?+2T@$BE!B'!*>+2$m2!0%=)#8'R<+2B!$#B+C)2T'#! =)##+C*! _)@$()T'#!! Y)#$>%?)T'#!! G'2$)?!\!_)@$()T'#!l! \!G'2$)?lY)#$>%?)T'# \!_)@$()T'#!l!G'2$)? Y)#$>%?)T'# 1KL& ZZS ZZS _'!JKL& k#B+C+*T#(!'#!$B*!'H#] 0-#2$%,8%8?%-J'$%U#%S18C 27

Sn+C!BC)$#$#(o GYa 1KL& 1KL&!)2T@)T'#!&'CC+?)B+D!H$B0!! 1KL&!)2T@)T'#!&'CC+?)B+D!H$B0!! ?GYa8?1KL&!^&G h*=)??!)CTO)2B*i!C+2)??!)22%C)2E 6 @'X'LOYKE'H'Z'LOLM'' @'X'LOYLE'H'Z'LOLM' p!! ;!! 4 b+B)!20)#(+ b+B)!20)#(+ )#+,1"$5&# 6!! )#+,1"$5&# 7!! 2 4!! :!! 0 8:];:!! 8:]7:!! :]::!! :]7:!! :];:!! :]5:!! :]X:!! 84!! 0.6 0.8 1 87!! -2 86!! 8;!! -4 8p!! C*?=TC/UV3'W3*':81)#4'B"#)H8C"5&#'6):,&TG"+$%)#4 -6 *B"CC'&0A,$+'1,$"CC'"$$81"$. 0-#2$%,8%8?%-J'$%U#%S18C 0-#2$%,8%8?%-J'$%U#%S18C 28

A0)B!$*!C+>C+*+#B+D!)B!B0+!*+#*'CE!*$B+*F!! !G0)>+!'#!@+#BC)?!@$*%)?!>)B0H)E!IJKL&MN!J$*%)?!O'C=)BF! qfG!O'C!)#$=)?*W!_K!O'C!)CTO)2B*!I+@'?%T'#)C$?E! >C'(C)==+D!B'!=)>!H$B0!O%#2T'#M! P'H!)C+!D$Q+C+#B!BE>+*!'O!3#'H?+D(+!R'%#D!B'(+B0+CF! 29

&'#2+>B*!R+E'#D!JKL&! /"#V81%8?%-J'$%344K$%:818O1-J%:*1?8@% >%H8?-W-#-JED"D%*X%534%XHYU%D?)V"8D%*X%D8<-#IF%C1*F8DD"#2% P'H!)C+!B0+E!2'##+2B+DF!ZC+D$2T'#*F! A'%?D!B0+!2'##+2T'#!>)c+C#!C+U+2B!B0+!R$#D$#(!)2C'**!='D)?$T+*F 30