We are happy our new paper “Improving equilibrium propagation (EP) without weight symmetry through Jacobian homeostasis,” led by Axel accepted at ICLR 2024. Preprint: https://arxiv.org/abs/2309.02214Code: https://github.com/Laborieux-Axel/generalized-holo-ep EP prescribes a local learning rule and uses recurrentContinue reading
Tag: paper
Paper: Implicit variance regularization in non-contrastive SSL
New paper from the lab accepted at NeurIPS: “Implicit variance regularization in non-contrastive SSL.” In our article, first-authored by Manu and Axel, we add further understanding to how non-contrastive self-supervised learning (SSL) methods avoid collapse.Continue reading
New preprint: Improving equilibrium propagation without weight symmetry
I am happy to announce our new preprint on “Improving equilibrium propagation (EP) without weight symmetry through Jacobian homeostasis,” led by Axel. https://arxiv.org/abs/2309.02214 EP prescribes a local learning rule and uses recurrent dynamics for creditContinue reading
Paper: Burst-dependent synaptic plasticity can coordinate learning in hierarchical circuits
We’re excited to see this published. A new take on spatial credit assignment in cortical circuits based on Richard Naud’s idea on burst multiplexing. A truly collaborative effort lead by Alexandre Payeur and Jordan GuerguievContinue reading
Paper: Finding sparse trainable neural networks through Neural Tangent Transfer
New paper led by Tianlin Liu on “Finding sparse trainable neural networks through Neural Tangent Transfer” https://arxiv.org/abs/2006.08228 (and code) which was accepted at ICML. In the paper we leverage the neural tangent kernel to instantiate sparse neuralContinue reading
SuperSpike: Supervised learning in spiking neural networks — paper and code published
I am happy to announce that the SuperSpike paper and code are finally published. Here is an example of a network with one hidden layer which is learning to produce a Radcliffe Camera spike trainContinue reading
Special Issue: “Integrating Hebbian and Homeostatic plasticity”
I recommend taking a look at the special issue on ‘Integrating Hebbian and Homeostatic plasticity’ which was just published in Phil Trans of the Royal Society B. You can find the table of contents atContinue reading