Google and Microsoft are going all in with generative AI as core to their future. There is no “we are still early” here, trillion dollar companies are shifting their whole strategy and focus. I can’t ever recall a technology and strategy shift as fast and meaningful as this.

Google announces Dreamix: a model that generates videos when given: - video + prompt (Video editing) - input images + prompt (Subject Driven Generation) - input image + prompt (Image-toVideo

To the extent that prompt engineering remains a thing, it might be the Era of the Humanities Major. oneusefulthing.substack.com/p/magic-for-en…

LLMs just hit a major milestone with the release of the new "Generative agents" paper. By using LLMs, generative agents were able to simulate human-like behavior in an interactive sandbox inspired by The Sims. The agent architecture extends Language Models to store a complete

Ai code writing side by side “Write pong in HTML” Grok: 11 lines Writes the word pong lol ChatGPT: 89 lines Doesn’t finish paddles, controls or collisions “You would need to add…” Grimoire: 129 lines Fully implemented. Download link with .zip file

Announcing StripedHyena 7B — an open source model using an architecture that goes beyond Transformers achieving faster performance and longer context. It builds on the lessons learned in past year designing efficient sequence modeling architectures. together.ai/blog/stripedhy…

🚀🚀🚀We are thrilled to present Open-Sora-Plan v1.0.0, which can generate 10 seconds of 1024×1024 video with 24 FPS. And it is also able to generate high resolution images. If you like our project, please give us a star ⭐ on GitHub for latest update. github.com/PKU-YuanGroup/…

I was playing with a new robotics framework called Dora-rs today. A super impressive replacement of ROS (the Robot Operating System), for those who know, one of the pain-point to lower the entry barrier in robotics imo Dora-rs is much much easier to install and fully integrate

Hugging Face launches LeRobot open source robotics code library venturebeat.com/automation/hug…

Google has moved away from big chips to swarms of smaller, cheaper chips with huge interconnect & datacenter connect (Jupiter) to scale to millions in a run Trillium has 32GB VRAM per chip but pods are 256 so 8.2 TB per pod (great for long context), likely each chip 1/3 H100

Convolutional Neural Networks in action

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo - cRc for helping me understand the pragma magic. I hope

Superintelligence is within reach. Building safe superintelligence (SSI) is the most important technical problem of our​​ time. We've started the world’s first straight-shot SSI lab, with one goal and one product: a safe superintelligence. It’s called Safe Superintelligence

OpenAI Strawberry (o1) is out! We are finally seeing the paradigm of inference-time scaling popularized and deployed in production. As Sutton said in the Bitter Lesson, there're only 2 techniques that scale indefinitely with compute: learning & search. It's time to shift focus to

We are very excited to announce Kinetix: an open-ended universe of physics-based tasks for RL! We use Kinetix to train a general agent on millions of randomly generated physics problems and show that this agent generalises to unseen handmade environments. 1/🧵

Stargate will invest $500B to build AI data centers for OpenAI! $500B for OpenAI alone?!! 🤯 Google, X, Anthropic, MSFT, and Meta will also need $500B each. So that's a $3T investment in hardware!! I am just buying more $NVDA 😂

My thoughts on China, export controls and two possible futures darioamodei.com/on-deepseek-an…

🚀 Fellowship applications are OPEN for Encode: AI for Science. What if you could use AI to - Design shape-shifting robots - See through solid materials - Decode language of the brain - Create advanced materials

Humanoid robot using reinforcement learning policies, where robot learns tasks by interacting with their environment through trial and error. The combination of agentic and physical (robotaxis, drones and humanoids) AI is a multi-trillion dollar market.

Wow