Daily Run: Neuroscience of Learning
Subtopic change: Initial wave introducing Hebbian plasticity, spike-timing dependent plasticity, and memory consolidation.
Day 1
Subtopics: Hebbian weight updates, STDP curve, literature on memory consolidation.
Hebbian plasticity
- Simulated two binary neurons with update $\Delta w=\eta xy$ and $\eta=0.1$.
- Ran ten random input pairs, tracking the weight.
- Stored the trajectory in
hebbian.csv
.
- Observed monotonic growth when spikes co-occurred.
- Considered adding normalization to bound $w$.
Spike-timing dependent plasticity
- Adopted $\Delta w=\pm e^{-\lvert\Delta t\rvert/\tau}$ with $\tau=20$\,ms.
- Evaluated $\Delta w$ for $\Delta t=-20,-10,0,10,20$\,ms.
- Saved the table to
stdp.csv
.
- Confirmed potentiation for $\Delta t<0$ and depression for $\Delta t>0$.
- Noted the exponential decay away from coincidence.
Memory consolidation
- Reviewed a summary article on hippocampal replay during sleep.
- Highlighted evidence linking slow-wave activity to long-term storage.
- Related replay to experience replay in reinforcement learning.
- Identified candidate models for future simulation.
- Planned to test a simple replay algorithm next wave.
Subtopic assessment: The Hebbian and STDP simulations produced concrete data, while the consolidation review charted directions for upcoming computation.