Cognition, Adaptation and Learning (CAandL) Lab
@caandl_lab
A theoretical machine learning and computational neuroscience lab at the University of the Witwatersrand.
ID: 1899592744697319424
https://caandl.org/ 11-03-2025 22:46:33
4 Tweet
12 Followers
18 Following
Our paper, “A Theory of Initialization’s Impact on Specialization,” has been accepted to ICLR 2025! openreview.net/forum?id=RQz7s… We shows how neural network can build specialized and shared representation depending on initialization, this has consequences in continual learning. (1/8)
I'm excited to announce that I have received the Thuthuka Research Grant from the National Research Foundation of South Africa! I will use this grant to start my own lab focused on comp neuro and ML theory at Wits University: the Cognition, Adaptation and Learning (CAandL) Lab! This is a joint effort with Victoria Williams, Stefano Sarao Mannelli and Geraud Nangue Tasse.
Our paper, “Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks” will be presented at ICLR 2025 this week (openreview.net/forum?id=27SSn…)! We derive closed-form dynamics for some, remarkably linear, feature learning ReLU networks (1/9)
CAandL Lab is at ICLR this week with 3 poster presentations. Come by and chat if you are interested! Congrats to all of the authors🥳 Francesco Mori Stefano Sarao Mannelli Francesca Mignacco Devon Jarvis Richard Klein Benjamin Rosman Andrew Saxe Sebastian Lee Clémentine Dominé 🍊
Great news! This work has also been accepted into RLC for the Journal to Conference Track. Congrats Geraud Nangue Tasse and teams for the great result 🦾