Wanna know how finetuning makes a foundation model forget and how to avoid it? Have a look at our paper accepted Transactions on Machine Learning Research! 📜 Paper: arxiv.org/abs/2308.13320 Work done with amazing co-authors: Yarin philip Puneet Dokania OATML_Oxford Oxford Torr Vision Group!

Francisco Girbal Eiras and Aleks Petrov presenting our new Open Source position paper in #ICML24. The paper is accepted as Oral and the talk is today at 4.30PM in Hall A1.

The poster session for this work is today, 3:30 - 4:30pm in Hall A1 at #icml2024! x.com/fgirbal/status…

#ICML2024 was great! 🇦🇹 I had the opportunity to present our oral position paper on open-source Gen AI! And it was fantastic to connect with so many talented people working on important problems related to trustworthy and safe ML 🥳

Improving AI's academic abilities may not markedly improve user experience as in the past. In LMSYS rankings, GPT-4o and GPT-4o mini rank 6th and 7th, despite a large academic gap (MMLU: 88.7% v. 82%). o1 may have underwhelmed because most people can't appreciate Olympiad skills.