I'm in Austria for #ICLR2024! Please stop by poster 287 on WebArena (webarena.dev) this morning and chat about benchmarking or building web agents!

The videos for the spring semester of CMU 11-711 Advanced NLP are now all available 📺 youtube.com/playlist?list=… Thanks to the TAs, students in the class, and everyone who followed along. We're doing it again in the Fall!

Life updates: Excited to share that I have graduated from Masters of Science in Engineering AI at Carnegie Mellon. It's been a hell of ride and I am very grateful to have been part of the program over the past two years. I have got the chance to work with truly amazing people on

I very much love those "let's series": let's build GPT{model, tokenizer}, let's reproduce GPT-2... Thanks for the efforts and relentless will to educate the world, Andrej 🫡🫶

Very cool to see Chatbot Arena adding image uploads capability. Human preferences and vibe are the ultimate evals. They have a made a clear distinction between LLMs and it's nice to see that happening for multimodal models as well. Vibe-Eval(arxiv.org/abs/2405.02287) shows a nice

Linear Algebra for Computer Vision, Robotics, and Machine Learning cis.upenn.edu/~cis5150/linal…

Announcement: Robert Brennan, Xingyao Wang, and I have formed a company! Our name is All Hands AI 🙌 all-hands.dev And our mission is to build the world’s best AI software development agents, for everyone, in the open. Here’s why I think this mission is important 🧵

Vector Calculus mecmath.net

TIL: If you can make cool concepts visualizations, people can use them in their works(and generously quote you) :-)

AI is a huge boost for software development, but there are different form factors for AI dev tools. What types of tools are available? Following the famous autonomy levels in self driving, I created levels for AI-enhanced dev tools, w/ examples for each: all-hands.dev/posts/20240801…

It’s that time of the year again…!! I am excited to be in Senegal, attending Deep Learning Indaba :-)

🚀 Introducing MMMU-Pro: A more robust version of MMMU arxiv.org/pdf/2409.02813… After launching MMMU, we received valuable feedback from the community: 1️⃣ Some questions were answerable without even seeing the images. 2️⃣ Models didn’t always "know" the answer but found shortcuts

We started the Fall 2024 version of CMU CS11-711 Advanced NLP🎓 Follow along to learn about the latest in NLP, LLMs, Agents, etc. * Materials: phontron.com/class/anlp-fal… * Videos: youtube.com/playlist?list=…