Linara
@linaraadylova
ELLIS PhD student in machine learning, in particular in theory of deep learning. My home university is Ruhr Uni Bochum.
ID: 1442843667383865355
28-09-2021 13:28:40
69 Tweet
139 Followers
112 Following
Proud of my collaboration with EPFL, Maksym Andriushchenko and Martin Jaggi in particular 😎
If you want to visit me at Know Center to work in the fields of information theory for deep learning or physics- informed neural networks, this might be a great opportunity. Drop me a line if you are interested!
Stop discarding your old gradients! Introducing AdEMAMix, a novel (first-order) optimizer capable of outperforming Adam. Let’s have a thread on momentum and the surprising relevance of very old gradients. A joint work with David Grangier and Pierre Ablin #ml #optimization 1/🧵
I was happy to present the initial results from the research about information-theoretic view on generalization, conducted together with Bernhard Geiger in the frame of the #enfield grant. The #enfield second call is already open! enfield-project.eu