Pre-stimulus endogenous activity modulates category tuning and - - PowerPoint PPT Presentation

▶
pre stimulus endogenous activity modulates category
SMART_READER_LITE
LIVE PREVIEW

Pre-stimulus endogenous activity modulates category tuning and - - PowerPoint PPT Presentation

Jul 29, 2023 364 likes •976 views

Pre-stimulus endogenous activity modulates category tuning and influences behavior Yuanning Li 1,2,3 , Michael Ward 3 , R. Mark Richardson 2,3 , Max GSell 4 , Avniel Singh Ghuman 2,3 1 Joint PhD program in Neural Computation and Machine

slide-1
SLIDE 1

Pre-stimulus endogenous activity modulates category tuning and influences behavior

1 Joint PhD program in Neural Computation and Machine Learning,

Carnegie Mellon University

2 Center for the Neural Basis of Cognition, Carnegie Mellon University and

University of Pittsburgh

3 Dept. of Neurological Surgery, University of Pittsburgh 4 Dept. of Statistics and Data Science, Carnegie Mellon University

Yuanning Li1,2,3, Michael Ward3, R. Mark Richardson2,3, Max G’Sell4, Avniel Singh Ghuman2,3

slide-2
SLIDE 2

Perception depends on not only the input

1/14

slide-3
SLIDE 3

Perception depends on not only the input but also the ongoing endogenous activity in the brain

1/14

slide-4
SLIDE 4

Perception depends on not only the input but also the ongoing endogenous activity in the brain

The mechanism by which endogenous activity modulates perception is unknown

1/14

slide-5
SLIDE 5

Endogenous activity correlates to po post-st stim activity and perceptual behavior

Evoked response Endogenous activity Behavioral perception

Arieli et al., 1996; Kisley and Gerstein, 1999; Basar, 1980; Brandt et al., 1991; Nikulin et al., 2007;Henriksson et al., 2015

2/14

slide-6
SLIDE 6

Endogenous activity correlates to post-stim activity and pe perceptua ual be beha havior

Evoked response Endogenous activity Behavioral perception

Thut et al., 2006; Busch et al., 2009; VanRullen et al., 2011; Ng et al., 2012; Henry et al., 2012, 2014; Kayser et al., 2016

2/14

slide-7
SLIDE 7

Endogenous activity correlates to post-stim activity and perceptual behavior

  • It is not clear if the endogenous activity modulates

neural tuning to affect perception.

Evoked response Endogenous activity Behavioral perception

?

2/14

slide-8
SLIDE 8

Experiments

  • Intracranial Electroencephalography (iEEG)
  • Total number subjects: 30

(Photo Credit: Adeen Flinker)

3/14

slide-9
SLIDE 9

Experiments

  • Task:
  • 6 categories (faces, bodies, words, houses, tools,

scrambled non-objects)

  • 1-back task to detect repetitions

+ + + + +

3/14

slide-10
SLIDE 10

Experiments

  • Category-selective electrodes: 246
  • faces, bodies, words, houses, tools, scrambled non-
  • bjects

L R

3/14

slide-11
SLIDE 11

Questions

  • Does pre-stimulus activity modulate the degree of

category tuning in response to visual stimuli?

4/14

slide-12
SLIDE 12

Questions

  • Does pre-stimulus activity modulate the degree of

category tuning in response to visual stimuli?

  • If so, does the same aspect in pre-stimulus activity

that modulates tuning also predict behavioral perception?

4/14

slide-13
SLIDE 13

Pre-stimulus activity as proxy for ongoing endogenous activity

stim-onset time

!

"#$%

= '#() + +#,-. + /′

!

"#$%

5/14

slide-14
SLIDE 14

Pre-stimulus activity as proxy for ongoing endogenous activity

stim-onset time

!

"#$%

= '#() + +#,-. + /′

!

"#$%

5/14

slide-15
SLIDE 15

Pre-stimulus activity as proxy for ongoing endogenous activity

stim-onset time

!

"#$%

= '#() + '%"# + +′

!

"#$%

5/14

slide-16
SLIDE 16

What about category tuning?

time stim-onset

!

"#$%

= '#() + '%"# + +′

!

"#$%

5/14

slide-17
SLIDE 17

What about category tuning?

time stim-onset

!

"#$%

= '#() + '%"# + +′

!

"#$%

5/14

slide-18
SLIDE 18

!

"#$%

= '#() + '%"# + +′

What about category tuning?

time stim-onset

!

"#$%

5/14

slide-19
SLIDE 19

How does pre-stimulus activity modulate category tuning?

time stim-onset

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

7

0+8/

5/14

slide-20
SLIDE 20

How does pre-stimulus activity modulate category tuning?

time stim-onset

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

7

0+8/

5/14

slide-21
SLIDE 21

Train a classifier using only the posterior activity

time stim-onset

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

7

0+8/

5/14

slide-22
SLIDE 22

Fix the posterior discriminant component

time stim-onset

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

7

0+8/

5/14

slide-23
SLIDE 23

Conditioning on the pre-stimulus activity

time stim-onset

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

7

0+8/

5/14

slide-24
SLIDE 24

Trial-by-trial metric of category-tuning

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

  • Define:
  • (post-stimulus) category tuning

#4*+,-

6/14

slide-25
SLIDE 25

Trial-by-trial metric of pre-stimulus modulation

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

  • Define:
  • (post-stimulus) category tuning
  • (pre-stimulus) modulation index (MI)

#4*+,- 54*/0+

6/14

slide-26
SLIDE 26

Trial-by-trial metric of pre-stimulus modulation

! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

  • Define:
  • (post-stimulus) category tuning
  • (pre-stimulus) modulation index (MI)

#4*+,- 54*/0+

behavior

?

6/14

slide-27
SLIDE 27

bodies faces words tools places scrambled 0.5 1 1.5

sensitivity index (d')

Does the inclusion of pre-stimulus activity improve categorical classification accuracy?

7/14

slide-28
SLIDE 28

bodies faces words tools places scrambled 0.5 1 1.5

sensitivity index (d')

evoked only evoked + endogenous

Does the inclusion of pre-stimulus activity improve categorical classification accuracy? * *** *** *** **

* p < 0.05 ** p < 0.01 *** p < 0.001 Paired t-test

***

7/14

slide-29
SLIDE 29

bodies faces words tools places scrambled 0.5 1 1.5

sensitivity index (d')

evoked only evoked + endogenous

Does the inclusion of pre-stimulus activity improve categorical classification accuracy?

  • YES. Conditioning on pre-stimulus activity

functionally improves category classification. * *** *** *** **

* p < 0.05 ** p < 0.01 *** p < 0.001 Paired t-test

***

7/14

slide-30
SLIDE 30

Does the sa same e asp spec ects ts of pre-st stimulus activity also correlate with behavior performance?

Preferred Non-preferred 600 650 700

Reaction time (ms)

high MI low MI

Preferred category Non-preferred category 8/14

slide-31
SLIDE 31

Does the sa same e asp spec ects ts of pre-st stimulus activity also correlate with behavior performance?

Preferred Non-preferred 600 650 700

Reaction time (ms)

high MI low MI

Preferred category Non-preferred category

* p < 0.05 Permutation test

* n.s.

8/14

slide-32
SLIDE 32

Does the sa same e asp spec ects ts of pre-st stimulus activity also correlate with behavior performance?

Preferred Non-preferred 600 650 700

Reaction time (ms)

high MI low MI

Preferred category Non-preferred category

* p < 0.05 Permutation test

* n.s.

8/14

slide-33
SLIDE 33

Does the sa same e asp spec ects ts of pre-st stimulus activity also correlate with behavior performance?

  • YES. The same aspects in pre-stimulus activity that

influences post-stimulus category tuning also predict perceptual behavior performance.

Preferred Non-preferred 600 650 700

Reaction time (ms)

high MI low MI

Preferred category Non-preferred category

* p < 0.05 Permutation test

* n.s.

8/14

slide-34
SLIDE 34

Main questions

  • Does pre-stimulus activity modulate the degree of

category tuning in response to visual stimuli?

YES

  • If so, does the same aspect in pre-stimulus activity

that modulates tuning also predict behavioral perception?

YES

9/14

slide-35
SLIDE 35

What are the pre-stimulus features that contributing to the modulation? ! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

10/14

slide-36
SLIDE 36

What are the pre-stimulus features that contributing to the modulation? ! "#$%&'() *+,-, */0+ = 2(#4*+,-, 54*/0+)

50 100 150

  • Freq. (Hz)

0.05 0.1 0.15 0.2 0.25

  • Prob. of non-zero

Phase

  • 500
  • 400
  • 300
  • 200
  • 100

Time (ms)

0.01 0.02 0.03 0.04 0.05

  • Prob. of non-zero

Broadband power

  • 500
  • 400
  • 300
  • 200
  • 100

Time (ms)

0.01 0.02 0.03 0.04 0.05

  • Prob. of non-zero

Event-related potential

10/14

slide-37
SLIDE 37

What are the pre-stimulus features that contributing to the modulation?

  • Phase around 15-30 Hz demonstrated consistent

pattern.

50 100 150

  • Freq. (Hz)

0.05 0.1 0.15 0.2 0.25

  • Prob. of non-zero

Phase

  • 500
  • 400
  • 300
  • 200
  • 100

Time (ms)

0.01 0.02 0.03 0.04 0.05

  • Prob. of non-zero

Broadband power

  • 500
  • 400
  • 300
  • 200
  • 100

Time (ms)

0.01 0.02 0.03 0.04 0.05

  • Prob. of non-zero

Event-related potential

10/14

slide-38
SLIDE 38

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

11/14

slide-39
SLIDE 39

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

Significant cross-electrode correlation?

11/14

slide-40
SLIDE 40

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

Significant cross-electrode correlation?

same category

  • diff. category

0.05 0.1 0.15

Mean (abs) corr. coeff.

* * n.s.

11/14

slide-41
SLIDE 41

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

Significant cross-electrode correlation? It is restricted to neural circuits of the same category-selectivity.

same category

  • diff. category

0.05 0.1 0.15

Mean (abs) corr. coeff.

* * n.s.

11/14

slide-42
SLIDE 42

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

  • A reflection of infra-slow fluctuations seen in resting

state?

12/14

slide-43
SLIDE 43

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

  • A reflection of infra-slow fluctuations seen in resting

state?

Significant auto-correlation across consecutive trials?

12/14

slide-44
SLIDE 44

2 4 6 8 10

lags

  • 0.2

0.2 0.4 0.6 0.8 1

auto-correlation

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

  • A reflection of infra-slow fluctuations seen in resting

state?

Significant auto-correlation across consecutive trials?

12/14

slide-45
SLIDE 45

2 4 6 8 10

lags

  • 0.2

0.2 0.4 0.6 0.8 1

auto-correlation

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

  • A reflection of infra-slow fluctuations seen in resting

state?

Significant auto-correlation across consecutive trials?

~15% of the total electrodes (p < 0.05 uncorrected) 12/14

slide-46
SLIDE 46

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

  • A reflection of infra-slow fluctuations seen in resting

state?

13/14

slide-47
SLIDE 47

What’s the nature of the pre-stimulus modulation?

  • A reflection of fluctuations in global cognitive state

(e.g. arousal/attention)?

  • A reflection of infra-slow fluctuations seen in resting

state? No, the effects are only correlated within category-selective neural circuits. Only a very small portion of the electrodes show trial-by-trial auto-correlation in endogenous modulation of tuning. The majority are transient.

13/14

slide-48
SLIDE 48

Conclusion

  • Pre-stimulus activity influences the degree of

category tuning in response to visual stimuli.

14/14

slide-49
SLIDE 49

Conclusion

  • Pre-stimulus activity influences the degree of

category tuning in response to visual stimuli.

  • The same aspects in pre-stimulus activity that

influences post-stimulus category tuning also correlates with perceptual behavior performance.

14/14

slide-50
SLIDE 50

Conclusion

  • Pre-stimulus activity influences the degree of

category tuning in response to visual stimuli.

  • The same aspects in pre-stimulus activity that

influences post-stimulus category tuning also correlates with perceptual behavior performance.

  • The pre-stimulus modulation effect is a reflection of

local processes within neural circuit.

14/14

slide-51
SLIDE 51

Conclusion

  • Pre-stimulus activity influences the degree of

category tuning in response to visual stimuli.

  • The same aspects in pre-stimulus activity that

influences post-stimulus category tuning also correlates with perceptual behavior performance.

  • The pre-stimulus modulation effect is a reflection of

local processes within neural circuit.

  • The majority of the pre-stimulus modulation effect

are transient, but ~15% of the channels show trial- by-trial auto-correlation in endogenous modulation

  • f tuning.

14/14

slide-52
SLIDE 52

Conclusion

  • Pre-stimulus activity influences the degree of

category tuning in response to visual stimuli.

  • The same aspects in pre-stimulus activity that

influences post-stimulus category tuning also correlates with perceptual behavior performance.

  • The pre-stimulus modulation effect is a reflection of

local processes within neural circuit.

  • The majority of the pre-stimulus modulation effect

are transient, but ~15% of the channels show trial- by-trial auto-correlation in endogenous modulation

  • f tuning.

14/14

slide-53
SLIDE 53

Acknowledgements

  • Matthew Boring
  • Brett Bankson
  • Shahir Mowlaei
  • Arish Alreja
  • Ellyanna Kessler
  • Nicolas Brunet
  • Vince Destefino
  • Witold Lipski

Special thanks:

  • Epilepsy Patients
  • EMU Staff and Nurses

Institutions: Funding support:

slide-54
SLIDE 54

Thank you!

Contact: Yuanning Li ynli@cmu.edu

slide-55
SLIDE 55

Results: category tuning

  • Pre-stim activity modulated the category-tuning in

the evoked-responses

∆CT

Non-preferred condition Preferred condition

Neural response Probability density

Different levels of pre-stimulus modulation activity

8/14

slide-56
SLIDE 56

Results: category tuning

  • Pre-stim activity modulated the category-tuning in

the evoked-responses

!CT p-value Preferred condition 0.1101 < 0.001 Non-preferred condition

  • 0.0126

0.092

∆CT

Non-preferred condition Preferred condition

Neural response Probability density

8/14

slide-57
SLIDE 57

Model

x1 x2

βT

1 xpost

β0 = 0

slide-58
SLIDE 58

Model

x1 x2

βT

1 xpost

β0 = 0

x1 x2

βT

1 xpost

β0(xpre) = βT

2 xpre

slide-59
SLIDE 59

Model

x1 x2

βT

1 xpost

β0 = 0

x1 x2

βT

1 xpost

β0(xpre) = βT

2 xpre