the debate around "can LLMs generate novel ideas" is why we also need *minimal* settings where we can - evaluate novelty/diversity w little room for doubt, - have cheaper iterations to test algorithmic/architectural ideas & - most importantly, think clearly about LLM behavior!

Does test-time scaling help in open-ended problem domains? And by how much & why? This is quite a bit of a nuanced question to answer fully. To begin studying this, w/ Taeyoun Kim & Aditi Raghunathan we trained LLMs to scale test-time compute for safety. …g-adaptive-reasoners-safety.github.io

Join us at the AI Safety Social at #ICML2025! We'll open with a panel on the impacts of reasoning & agency on safety with Aditi Raghunathan, Anca Dragan, David Duvenaud, & Siva Reddy. Come connect over snacks & drinks. 🗓️ Thursday, July 17, from 7-9 PM in West Ballroom A

Today Chen Wu and I will be presenting our #ICML work on creativity in the Oral 3A Reasoning session (West Exhibition Hall C) 10 - 11 am PT Or please stop by our poster right after @ East Exhibition Hall A-B #E-2505 11am-1:30pm. (Hope you enjoy some silly human drawings!)

Huge congratulations to Vaishnavh, Chen and Charles on the outstanding paper award 🎉 We will be presenting our #ICML2025 work on creativity in the Oral 3A Reasoning session (West Exhibition Hall C) 10 - 11 am PT. Or please stop by our poster right after @ East Exhibition

We make a very intriguing observation that more pre-training data can worsen downstream performance. Come visit our poster at #ICML2025 on Thursday at East Exhibition Hall A-B #E-2508 to learn more about when and why we see such catastrophic overtraining.

We got so tired of the cat 🐱 and mouse 🐭 game in LLM unlearning. What if we just made unlearning possible *by design*? This #ICML2025 work is a cool amalgamation of various findings around LLM training dynamics and memorization, all while keeping an eye towards scalability in

If you are attending #ICML2025, check out our DataWorld workshop on Sat July 19. We have updated the website with more info on speakers & accepted papers! dataworldicml2025.github.io Also happy to chat offline about all things ✨ data ✨

Congratulations to the authors of "Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction", which won an #ICML2025 Outstanding Paper Award! arxiv.org/abs/2504.15266

Heading to Conference on Language Modeling in Montreal? So is WiML! 🎉 We are organizing our first ever event at #CoLM2025 and we want you to choose the format! What excites you the most? Have a different idea? Let us know in the replies! 👇 RT to spread the word! ⏩