I’m excited to share a project I’ve been working on for over a year, which I believe will fundamentally change our approach to language models. We’ve designed a new architecture, which replaces the hidden state of an RNN with a machine learning model. This model compresses

Cannot believe this finally happened! Over the last 1.5 years, we have been developing a new LLM architecture, with linear complexity and expressive hidden states, for long-context modeling. The following plots show our model trained from Books scale better (from 125M to 1.3B)

📢 Som is now presenting his work on "Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models" at #ICML2024 ICML Conference icml.cc/virtual/2024/p…

Job Alert: I am hiring a postdoc in Robot Learning! 💡 For my lab at Arizona State University I am looking for a postdoc to work on LLMs, Diffusion, Humanoid Robotics etc. The lab has strong ties and projects with Intrinsic, DeepMind, P&G etc. Interested? Drop me a message. #ASU

My talk on foundation model-powered robots that know when they don't know at the Princeton University #OLC workshop: youtu.be/23mepB-kkyg?fe… I'm very excited about this work on uncertainty quantification for perception and language.

I am happy to announce that TripletCLIP got accepted at #NeurIPS2024. Congrats to all the authors! Stay tuned for more details. 🎶 ASU School of Computing and Augmented Intelligence UMBC

Latest work from my lab "Stateful Diffusion Policies" - a combination of deep state-space models and diffusion. The result isa powerful policy representation for Lon-horizon and multimodal policies. #ASU #IROS2024

Just updated my Tips for CS Faculty Applications. Best of luck to everyone applying! yisongyue.medium.com/checklist-of-t…

When teleoperating a robot, humans often look at the target objects, obstacles or the moving parts of the robot. So their gaze carries saliency information and can help us identify what is important in the task. We show this information improves sample-efficiency in RL and IL.

Missing NeurIPS Conference this year 😔

Can #LLMs Express Information Implicitly? ExpressivityAreana, a framework for testing this, will be presented today at the NeurIPS Conference Behaviour ML Workshop from 2-3.30pm. arxiv.org/pdf/2411.08010 Work lead by Josh Tint et. al.

LLM-Assisted #RedTeaming of Diffusion Models through "Failures Are Fated, But Can Be Faded" Som will be presenting his poster #NeurIPS2024. 📍 Red Teaming GenAI Workshop 🕛 12:00 PM – 1:50 PM 🏢 West Meeting Room 301 📝 arxiv.org/pdf/2410.16738

How to explain robot decisions? LENS Lab will be presenting "Trustworthy Conceptual Explanations for Neural Networks in Robot Decision-Making" at #NeurIPS2024 Towards Safe & Trustworthy Agents Workshop. arxiv.org/pdf/2409.10733

Nvidia's next move: powering humanoid robots | TechCrunch tcrn.ch/4gTjqS7 #Nvidia $NVDA #AI #humanoid #robotics #GenAI #FutureOfWork #IoT #CES2025 #DigitalTwins #ML #Telepresence #Web3

Amazing 2024! My incredible students have developed methods to #characterize, #explain, and #mitigate undesirable behaviors in #GenAI, #Robots , etc., staying true to our tagline: "𝗙𝗮𝗶𝗹𝘂𝗿𝗲𝘀 𝗮𝗿𝗲 𝗙𝗮𝘁𝗲𝗱 𝗕𝘂𝘁 𝗖𝗮𝗻 𝗕𝗲 𝗙𝗮𝗱𝗲𝗱." ransml.github.io/lens-lab/publi…

We do a lot of cutting edge research at the Stanford AI Lab, but really our main job is educating students. Here is a list of great SAIL Graduates of 2025, who are variously looking for academic and industry jobs! 💪 ai.stanford.edu/blog/sail-grad… Compiled by Nikil Selvam Alex Nam

I'm thrilled to share our first release as the AGI SF Lab. Meet Nova Act -- the most effortless way to build agents that can reliably use browsers, giving agents access to much of our digital world. It brings us closer to building universal agents in both digital and physical