I am happy to announce our new preprint on “Improving equilibrium propagation (EP) without weight symmetry through Jacobian homeostasis,” led by Axel. https://arxiv.org/abs/2309.02214 EP prescribes a local learning rule and uses recurrent dynamics for creditContinue reading
Tag: plasticity
Hebbian plasticity could be the brain’s trick to make self-supervised learning work
Please take a look at our new preprint “The combination of Hebbian and predictive plasticity learns invariant object representations in deep sensory networks.” https://biorxiv.org/cgi/content/short/2022.03.17.484712v2 In this work led by Manu Srinath Halvagal we argue thatContinue reading
Paper: Brain-Inspired Learning on Neuromorphic Substrates
I’m happy to share our new overview paper (https://ieeexplore.ieee.org/document/9317744, preprint: arxiv.org/abs/2010.11931) on brain-inspired learning on neuromorphic substrates in (spiking) recurrent neural networks. We systematically analyze how the combination of Real-Time-Recurrent Learning (RTRL; Williams and Zipser,Continue reading
Preprint: The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks
We just put up a new preprint https://www.biorxiv.org/content/10.1101/2020.06.29.176925v1 in which we take a careful look at what makes surrogate gradients work. Spiking neural networks are notoriously hard to train using gradient-based methods due to theirContinue reading
Preprint: The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks
We just put up a new preprint https://www.biorxiv.org/content/10.1101/2020.06.29.176925v1 in which we take a careful look at what makes surrogate gradients work. Spiking neural networks are notoriously hard to train using gradient-based methods due to theirContinue reading
Hiring: Cortical models of predictive processing and learning
We are looking for an intrepid Ph.D. candidate to work on theoretical models of predictive processing and learning. This collaborative project with the Keller Lab is based on the hypothesis that cortical circuits build modelsContinue reading
Role of complex synapses in continual learning
Excited that our preprint “Improved multitask learning through synaptic intelligence” just went life on the arXiv (https://arxiv.org/abs/1703.04200). This article, by Ben Poole, Surya and myself, illustrates the benefits of complex synaptic dynamics on continual learningContinue reading