the pace of progress blows my mind

🎉 Happy to have contributed a bit to this with my PhD student Shaokai Ye, where we use DeepLabCut 🦄 #SuperAnimal foundation model for pose to do fully end-to-end unsupervised behavioral analysis with #keypointMoSeq. Huge congrats to first author Caleb Weinreb, and Scott

🎉 introducing the 2024 AI Residents!!! We welcome Anna Stuckert Marc Canela and DikraMasrour 👏 Read about them on the blog: deeplabcut.medium.com/exploring-the-…

I rewatch this once a month for motivation

DLC Residency 2024 Recap! 🎓💜 🎉Check out the awesome video from DLC Community Manager, Timokleia Kousi, and the 2024 Residents! youtu.be/lyJ2NDKng3g?si…

How does sensorimotor (S1/M1) cortex support adaptive motor control?  Come find out in our latest preprint, which spans the development of a full adult forelimb model + physics simulations, neural-modeling for control, complex 🐭behavior 🕹️, large-scale imaging, and of course

Come check this really cool paper if you are at ECCV!

🚨adversarial robustness is becoming even more critical as AI systems are deployed in the real-world, but how can we detect outliers (adversarials) without having trained on them 👀?  In our new preprint, we introduce AROS💍: It leverages neural ODEs and Lyapunov stability

Really cool!

🚀 DLC AI Residents call for 2025! This year, we are doing something a little different to support even more underrepresented individuals 🥰 We are having in-person workshops again 🙌, & we are taking the 2025 AI Residency on the Road! 🛤️ App open now! deeplabcutairesidency.org

Automating the Search for Artificial Life with Foundation Models Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: pub.sakana.ai/asal/ abs: arxiv.org/abs/2412.17799

So sweet to see them standing together

I am on the job market! Contact me if you are interested in building multi-modal agentic systems that understand behaviors!

openai.com/index/thinking… About two years ago, we started building V* to bring visual search into a multimodal LLM and show that it's a key part of how these models can understand the world. I still remember talking with my friend Bowen Cheng about why this kind of multimodal

Insightful! I have been thinking about "thinking in video" too