| layout | title | date | author | summary | references | weight | |||
|---|---|---|---|---|---|---|---|---|---|
notes |
29. Hebbian Learning |
2017-05-06 |
OctoMiao |
Simplest learning rule, aka, correlation based learning |
|
29 |
- Hebbian learning: correlation-based learning
- Long-term potentiation: persistent increase in the efficacy.
- Strong high-frequency pulses which evokes spikes will increase the efficacy.
- The change in synaptic weight will persist many hours, thus long-term potentiation.
- Joint activity of pre- and post-synaptic, i.e., correlated activity, could increase the synaptic weight.
- Presynaptic has to precede the postsynaptic in order to increase the rate.
-
Locality: change of synaptic efficacy depends only local variables, pre- and post- firing rates, and efficacy.
$$ \frac{d}{dt}w_{ij} = F(w_{ij};\nu_i,\nu_j). $$
-
Cooperativity: timing of the pre- and post-synaptic activity. Naively we would simply implement a correlation function into
$F$ . But the book used Taylor expansion. However, I think we should expand over some kind of contant activity that we could have instead of 0's that the book is using. They should give us the same results. In Taylor expansion, the second order is bilinear which contains the property we need. By keeping only the second order expansion, we have$$ \frac{d}{dt} w_{ij} = c^{\text{corr}}(w_{ij}) \nu_i \nu_j. $$
-
We could choose
$c^{\text{corr}}(w_{ij}) = \gamma (w_{ij}^{\text{max}} - w_{ij})$ . As$w_{ij}$ approaches its max, the learning will saturate. -
Weigth decays, so we need the first term of Taylor expansion,
$c_0(w_{ij})$ . We could choose$c_0(w_{ij}) = - \gamma_0 w_{ij}$ . -
Final form: Eqn. 10.6
-
Competition: growth of synaptic weight is at the expense of weakening of other weights.
-
Other learning rules are possible. Eqn. 10.7
- If spike trains are applied, we would expect the effect to be a summation of the single spike rules. Eqn. 10.13 and Eqn. 10 14