ActInf MorphStream 003.1 ~ Anand Subramoney "Principles of scalability and biological inspirations"

Anand Subramoney Principles of scalability and biological inspirations"

In the talk I will discuss how current models scale and what we can learn from the efficiency of biological brains. One of the central themes will be sparsity, its significant role in scalable systems and its synergies with neuromorphic hardware. I will present existing ideas based on spiking neural networks and recent work from my group focussed on using various forms of sparsity and distributed learning to improve the scalability and efficiency of our learning models.

Anand Subramoney is a Lecturer (Assistant Professor) in the Department of Computer Science at Royal Holloway, University of London. He is broadly interested in learning and intelligence, both algorithmic and biological. His current research focuses on understanding the principles of scalability in deep learning. He aims to use this to build models that are more efficient and can scale up seamlessly. His research draws inspiration from neuroscience and biology in his quest to build a better and more general artificial intelligence. Website: https://anandsubramoney.com/

Active Inference Institute information: Website: https://activeinference.org/ Twitter: https://twitter.com/InferenceActive Discord: https://discord.gg/8VNKNp4jtx YouTube: https://www.youtube.com/c/ActiveInference/ Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams ... https://www.youtube.com/watch?v=T5nG_5UZ_yk