Announcing Transluce, a nonprofit research lab building open source, scalable technology for understanding AI systems and steering them in the public interest. Read a letter from the co-founders Jacob Steinhardt and Sarah Schwettmann: transluce.org/introducing-tr…

Feeling spooked👻🎃? Get grounded...introducing "Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval." Meet LeReT (Learning to Retrieve by Trying), a RL-based framework that improves LLM’s ability to use retrieval tools by up to 29%. sherylhsu.com/LeReT/

NNN is super simple and works surprisingly well! By suppressing the influence of "outlier" embeddings that contrastive models are biased towards, we're able to get consistent retrieval accuracy gains without any training. We also find that NNN has gender debiasing effects!

In our #EMNLP2024 paper, we present a fast and incredibly simple approach to consistently improving multimodal retrieval by tackling the hubness problem. It's training-free, and integrates easily with existing vector search methods—go check it out!

I'll be at #NeurIPS2024! Would love to chat with folks about LLM reasoning/RL, interpretabilty, speculative decoding, or anything else (feel free to DM!) Will be presenting the following paper at the FITML workshop on Saturday, come swing by!

Applications for iQuHACK 2025, the MIT quantum hackathon, are open at iquhack.mit.edu!

🧬 Meet Lyra, a new paradigm for accessible, powerful modeling of biological sequences. Lyra is a lightweight SSM achieving SOTA performance across DNA, RNA, and protein tasks—yet up to 120,000x smaller than foundation models (ESM, Evo). Bonus: you can train it on your Mac. read

🏃🏃🏃

🧵Can we understand vision language models by interpreting linear directions in their latents? Yes! In our new paper, Line of Sight, we use probing, steering, and SAEs as useful tools to interpret image representations within VLLMs.

1/N I’m excited to share that our latest OpenAI experimental reasoning LLM has achieved a longstanding grand challenge in AI: gold medal-level performance on the world’s most prestigious math competition—the International Math Olympiad (IMO).

Today, we at OpenAI achieved a milestone that many considered years away: gold medal-level performance on the 2025 IMO with a general reasoning LLM—under the same time limits as humans, without tools. As remarkable as that sounds, it’s even more significant than the headline 🧵

Watching the model solve these IMO problems and achieve gold-level performance was magical. A few thoughts 🧵

1/n I’m thrilled to share that our OpenAI reasoning system scored high enough to achieve gold 🥇🥇 in one of the world’s top programming competitions - the 2025 International Olympiad in Informatics (IOI) - placing first among AI participants! 👨‍💻👨‍💻