Close your books, test time! The evaluation pipelines are out, baselines are released and the challenge is on. There is still time to join and we are excited to learn from you on pretraining and the gaps between humans and models. *Don't forget to fast-eval on checkpoints

The cognitive side of babyLMs is up for the reading

🎉 Our paper DOVE 🕊️ has been accepted to #ACL2025 Findings! DOVE 🕊️ is a massive collection (250M!) of LLM outputs across different prompts, domains, and models, aimed at democratizing LLM evaluation research! Thanks to all collaborators! Paper: slab-nlp.github.io/DOVE/

LLM community has finally caught up with NMT community in 2019. almost there. cc Leshem (Legend) Choshen 🤖🤗 :)

Deep research, where does inspiration for research come from (at least reported to be) and how can LLMs suggest new research topics? + a large dataset

Have you been following the intricate behaviors shown by AI when playing diplomacy with each other?

Who captures all of Europe?