Cholinergic Modulation of the Hippocampus Computational Models of - - PowerPoint PPT Presentation
Cholinergic Modulation of the Hippocampus Computational Models of - - PowerPoint PPT Presentation
Cholinergic Modulation of the Hippocampus Computational Models of Neural Systems Lecture 2.5 David S. Touretzky September, 2007 A Theory of Hippocampus Suppose CA1 is a hetero- associator that learns: to mimic EC patterns, and to
09/20/07 Computational Models of Neural Systems 2
A Theory of Hippocampus
- Suppose CA1 is a hetero-
associator that learns:
– to mimic EC patterns, and – to map CA3 patterns to
learned EC patterns
- Imagine a partial/noisy
pattern in EC triggering a partial/noisy response in CA3, cleaned up by auto- association in CA3 recurrent collaterals
- CA1 could use the EC
response to call up the complete, correct EC pattern What happens if recall isn't turned off during learning?
09/20/07 Computational Models of Neural Systems 3
Acetylcholine Effects (1)
Acetylcholine (ACh) has a variety of effects on HC:
- Suppresses synaptic transmission in CA1:
– Mostly at Schaffer collaterals in stratum radiatum – Less so for perforant path input in
stratum lacunosum-moleculare
patch clamp recording
09/20/07 Computational Models of Neural Systems 4
Effect of Carbachol
- Carbachol is a
cholinergic agonist.
- Can use carbachol to
test the effects of ACh.
- It only activates
metabotropic ACh receptors.
- Brain slice recording
experiments show that carbachol suppresses synaptic transmission in CA1.
46.0% suppression 90.7% suppression 54.6% suppression 87.6% suppression
Experiment 1 Experiment 2
09/20/07 Computational Models of Neural Systems 5
Effect of Atropine
- Atropine affects
muscarinic-type ACh receptors, not nicotinic type.
- Blocks the suppression of
synaptic transmission by carbachol.
- Therefore, cholinergic
suppression in s. rad. and
- s. l.-m. is by muscarinic
ACh receptors.
same same
09/20/07 Computational Models of Neural Systems 6
Summary of Blockade Experiments
09/20/07 Computational Models of Neural Systems 7
Acetylcholine Effects (2)
Acetylcholine also:
- Reduces neuronal adaptation in CA1 by suppressing
voltage and Ca2+ dependent potassium currents.
– This keeps the cells excitable.
- Enhances synaptic modification in CA1
– possibly by affecting NMDA currents.
- Activates inhibitory interneurons
– but decreases inhibitory synaptic transmission.
09/20/07 Computational Models of Neural Systems 8
Hasselmo's Model: Block Diagram
EC CA1 CA3
Medial Septum ACh fimbria/fornix pp Sch
09/20/07 Computational Models of Neural Systems 9
Hasselmo's Model
09/20/07 Computational Models of Neural Systems 10
Initial CA1 Activation Function
ait = ∑
j=1 n
Lij − EC H ij⋅gEC a jt
∑
k=1 n
Rik − CA3 Hik⋅gCA3 akt
−∑
l=1 n
CA1 Hil⋅gCA1 alt
ait is activation of unit i at time t gx is a threshold function: maxx−0.4, 0 Lij is feedforward synaptic strength for s. lacunosum (EC input) Rij is feedforward synaptic strength for s. radiatum (CA3 input)
xx Hi _ is feedforward or feedback inhibition of CA1 from layer xx
g(x)
09/20/07 Computational Models of Neural Systems 11
- S. Radiatum Learning Rule
- Note: the only learning in this model is in Rik,
the weights on the CA3→CA1 connections. T wo factors:
– Linear potentiation when pre- and post-synaptic cells are
simultaneously active.
– Exponential decay whenever the postsynaptic cell is active.
Rikt1 = Rikt ⋅[CA1 ait−⋅gCA3 akt − CA1 ait− ⋅Rikt] is the synaptic modification threshold for LTP to occur. is the overall learning rate. is the synaptic decay rate.
09/20/07 Computational Models of Neural Systems 12
Learning Rule: Hebbian Facilitation Plus Synaptic Decay 1 1
Presynaptic Postsynaptic
↓ ↓↑
09/20/07 Computational Models of Neural Systems 13
Exponential Weight Decay
dx dt = − x x t1 = xt − xt = xt ⋅ 1− x tn = xt ⋅ 1−n Example: = 0.04 x t1 = 0.96 x t
09/20/07 Computational Models of Neural Systems 14
Control of Cholinergic Modulation
- Cholinergic modulation Ψ was controlled by the amount
- f activity in CA1:
- This is an inverted sigmoid activation function of form
1 - 1/(1+exp(x)):
– With no CA1 activity, Ψ is close to 1. – With maximal CA1 activity, Ψ is close to 0.
= [1 exp∑
i=1 n
gCA1 ai−]
−1
is a gain parameter is a threshold value
09/20/07 Computational Models of Neural Systems 15
ACh Modulation of Recall
ait =
∑
j=1 n
1−C LLij−1−C H Hij⋅gEC a jt
∑
k=1 n
1−C R Rij−1−C HHik⋅gCA3 akt
−∑
l=1 n
1−C HH il⋅gCA1 alt C L ,C R ,C H are coefficients of ACh modulation.
09/20/07 Computational Models of Neural Systems 16
ACh Modulation of Learning
Rikt1 = ⋅ [1−C1−] ⋅
[CA1 ait − 1−C
⋅gCA3 ait − CA1 ait − 1−C ⋅Rikt] Rikt C ,C are coefficients of ACh modulation. Note: output threshold in g⋅ is also reduced by 1−C. This simulates ACh suppression of neuronal adapation.
09/20/07 Computational Models of Neural Systems 17
What Do These T erms Look Like?
1− C1− 1−C1−
09/20/07 Computational Models of Neural Systems 18
T rain T est Recovery from weight decay caused by recall
- f pattern 2.
09/20/07 Computational Models of Neural Systems 19
Weak suppression in s. rad. and none in s. l.-m. Result: unwanted learning causes memory interference. Strong suppression in s. rad. and also in s. l.-m. Result: retrieval fails.
09/20/07 Computational Models of Neural Systems 20
Larger Simulation
Learned 5 patterns. After learning, CA3 input is sufficient to recall the patterns.
09/20/07 Computational Models of Neural Systems 21
Memory Performance
Ais CA1 output, B is corresponding EC pattern (teacher). For perfect memory, A=B. Recall that A ⋅ B = ∥A∥ ∥B∥ cos Normalized dot product: A⋅B ∥A∥ ∥B∥ = cos = 1 for perfect memory Ci is some other training pattern Performance P = A⋅B ∥A∥ ∥B∥ − 1 M ∑
i=1 M
A⋅Ci ∥A∥ ∥Ci∥
Average overlap with all stored patterns.
09/20/07 Computational Models of Neural Systems 22
CL vs. CR Parameter Space
- Performance is
plotted on z axis.
- Grey line shows C
L = CR.
- White line shows dose-
response plot from carbachol experiment.
09/20/07 Computational Models of Neural Systems 23
Comparison with Marr Model
- Distinguishing learning vs. recall:
– Marr assumed recall would always use small subpatterns,
perhaps one tenth the size of a full memory pattern. Not enough activity to trigger learning.
– Hasselmo assumes that unfamiliar patterns only weakly
activate CA1, and that leads to elevated ACh which enhances learning.
- Input patterns:
– Marr assumes inputs are sparse and random, so nearly
- rthogonal.
– Hasselmo's simulations use small vectors so there is substantial
- verlap between patterns. Uses ACh modulation to suppress
interference.
09/20/07 Computational Models of Neural Systems 24
A Model of Episodic Memory
09/20/07 Computational Models of Neural Systems 25
ACh Prevents Overlap w/Previously Stored Memories from Interfering with Learning
09/20/07 Computational Models of Neural Systems 26
Simulation of ACh Effects
10 input neurons 2 inhibitory neurons 1 ACh signal
09/20/07 Computational Models of Neural Systems 27
Episodic Memory Simulation
- Each layer contains both
Context and Item units.
- T
rain on list of 5 patterns.
- During recall, supply ony
the context.
- An adaptation process
causes recalled items to eventually fade so that another item can become active.
09/20/07 Computational Models of Neural Systems 28
“Consolidation”
T rain model on set
- f 6 patterns.
During consolidation, use free recall to train slow-learning recurrent connections in EC layer IV. After training, a partial input pattern (not shown) recalls the full pattern in layer cortex.
poor good
09/20/07 Computational Models of Neural Systems 29
Summary
- Unwanted recall of old patterns can interfere with storing
new ones.
- The hippocampus must have some way of preventing
this interference.
- Cholinergic modulation in CA1 (and also CA3) affects
both synaptic transmission and L TP .
- Acetylcholine may serve as the “novelty” signal:
– Unfamiliar patterns → high ACh → learning – Familiar patterns → low ACh → recall
- CA1 might serve as a comparator of current EC input