👶 BabyLM Challenge is back! Can you improve pretraining with a small data budget? BabyLMs for better LLMs & for understanding how humans learn from 100M words New: How vision affects learning Bring your own data Paper track babylm.github.io 🧵

BabyLM is back for round two! This time we have: 1. Multimodal track 2. Bring your own data and 3. Paper track! See the CfP for all the juicy details!

Congratulations to Stefania Milan stefania milan and Don Weenink UvA Maatschappij & Gedrag, Tobias Blanke UvA Faculty of Science UvA Geesteswetenschappen, Max Nieuwdorp Amsterdam UMC, and Linda Amaral Zettler of NIOZ Linda Amaral Zettler IBED – all recipients of European Research Council (ERC) Advanced Grants 🎉 go.uva.nl/3Jcwy5M

Some very cool recent work from Chengxu Zhuang on visually grounded language learning. Surprisingly, standard text/image repr learning gives great image reprs but doesn't change behavior much on language tasks---how can we use image data for better learning of *language*?

Humans often use non-literal language to communicate –like hyperboles for added emphasis or sarcasm to offer polite criticism with humor AI systems should be able to decipher the real intent behind these words, and respond appropriately! 📜arxiv.org/abs/2405.08760 #ACL2024 main🎉

🔥Proud supervisor moment 🔥 Congratulations, doctor Ece Takmaz, for this great achievement! 🤩 You rock! (but also folk, blues, jazz, and more 😅) 🎸🎸 Ad maiora!!

Reposting just because these pics are beautiful ❤️ congrats, Dr. Ece Takmaz!!

Check out Gecko 🦎: Google DeepMind's latest work looking at how to evaluate text-to-image technology with: 📊 a new benchmark 🕵️ 100K+ human ratings of state-of-the-art T2I models 🤖 a better human-correlated auto-eval metric arxiv.org/abs/2404.16820

Consider applying for these positions! Great opportunity at UvA Amsterdam

Sandro Pezzelle ELLIS Dark mode for this paper for night readers 🌚 synthical.com/abs/2406.18403…

A few months ago, Sandro Pezzelle and I were awarded a grant by the University of Amsterdam. We proposed a method to bridge #AI representations to human-readable explanations. Our method can be applied to #NLP, #ComputerVision, and #aiinhealthcare .

Happening now! 🚀🇹🇭

Great invited talk by Edoardo Ponti at the #RepL4NLP workshop at #ACL2024 on eliminating fixed tokenizers and compress #LLMs memory for efficiency! 🚀 Thanks, Edo, for being with us! Seraphina Goldfarb-Tarrant SIGREP Marius Mosbach Pepa Atanasova Chen Zhao Peter Hase

Time for the first #RepL4NLP at #ACL2024 poster session of the day! 🔥 Come to poster boards 66 to 100 to learn more about the accepted papers! SIGREP Seraphina Goldfarb-Tarrant @ ACL 🇦🇹 Chen Zhao

It was great! Thanks to the #CMCL organizers for having me 🙏

Third keynote with Dieuwke Hupkes SIGREP #RepL4NLP is now!

Our fourth and final keynote of SIGREP #RepL4NLP with Mor Geva is now!

Time for panel discussion! At #RepL4NLP at #ACL2024, Dieuwke Hupkes Edoardo Ponti Mor Geva and Hassan Sajjad exchange ideas on the importance of representation analysis, data, and generalization in the era of #LLMs! Kudos to our own Seraphina Goldfarb-Tarrant for moderating! 🚀 SIGREP #NLProc

I'll be at Conference on Language Modeling until Thursday, presenting this paper—check it out at the Wednesday 4:30-6:30 poster session! Would also love to chat with folks about (mechanistic) interpretability, and how it can be useful for cog sci / linguistics