I’m happy to share our new overview paper (arxiv.org/abs/2010.11931) on brain-inspired learning on neuromorphic substrates in (spiking) recurrent neural networks. We systematically analyze how the combination of Real-Time-Recurrent Learning (RTRL; Williams and Zipser, (1989)) withContinue reading
Category: publications
Paper: Finding sparse trainable neural networks through Neural Tangent Transfer
New paper led by Tianlin Liu on “Finding sparse trainable neural networks through Neural Tangent Transfer” https://arxiv.org/abs/2006.08228 (and code) which was accepted at ICML. In the paper we leverage the neural tangent kernel to instantiate sparse neuralContinue reading
Preprint: Training spiking multi-layer networks with surrogate gradients on an analog neuromorphic substrate
We are happy to share our new preprint “Training spiking multi-layer networks with surrogate gradients on an analog neuromorphic substrate” (https://arxiv.org/abs/2006.07239). This work led by Benjamin Cramer and Sebastian Billaudelle and is a joint effortContinue reading
Paper: Surrogate Gradient Learning in Spiking Neural Networks
“Bringing the Power of Gradient-based optimization to spiking neural networks” We are happy to announce that our tutorial paper on Surrogate Gradient Learning in spiking neural networks now appeared in the IEEE Signal Processing Magazine.Continue reading
Perspective: A deep learning framework for neuroscience
Our perspective paper on how systems neuroscience can benefit from deep learning was published today. In work led by Blake Richards, Tim Lillicrap, and Konrad Kording, we argue that focusing on the three core elements usedContinue reading
Preprint: The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks
A range of exciting developments around surrogate gradient methods has put researchers in the position to build sophisticated functional spiking neural networks that compute specific functions. A major hurdle to further accelerate this line ofContinue reading