JARVIS-1: Open-Ended Multi-task Agents with Memory-Augmented Multimodal Language Models abs: arxiv.org/abs/2311.05997 project page: craftjarvis-jarvis1.github.io "We introduce JARVIS-1, an open-ended agent that can perceive multimodal input (visual observations and human

1/n: We are excited to share that our paper on Chroma, a general purpose diffusion model for proteins, is out today in nature! nature.com/articles/s4158… A couple of my favorite highlights in the 🧵below 👇

Very nice analysis of Claude-200K's true long context capability! I recommend all papers that claim long-context to present a visualization like this. The scripts are open-source: github.com/gkamradt/LLMTe…

Before we have a million robots in the physical world, we will first see a billion embodied agents in virtual worlds. Gaming is the second major area I'm dedicated to in 2024. AI and Gaming are born for each other, and their happy marriage is just getting started. On one hand,

Happy that we finally closed our seed funding round! I’m honored to be supported by Lux, Khosla, NTT, KDDI, Sony, and other great investors who share our values. We’re building a world class AI lab in Tokyo. If you’re interested in joining us, please visit sakana.ai/careers

I have spent quite some time reading recent AI publications. Based on this, I have made some predictions where AI will develop in 2024. You can find links to most interesting articles in the blogpost: recombee.com/blog/ai-news-a…

Announcing Sora — our model which creates minute-long videos from a text prompt: openai.com/sora

The BIOSIGNAL CHALLENGE 2024 to detect sleep apnoe is open for all Czech university students bsch.fel.cvut.cz

I’m excited to announce Craftax, a new benchmark for open-ended RL! ⚔️ Extends the popular Crafter benchmark with Nethack-like dungeons ⚡Implemented entirely in Jax, achieving speedups of over 100x 1/

Read my posts about latest AI developments (OpenAI SORA, EMO, World models, Q* and path towards AGI), Part 1: pavelkordik.substack.com/p/latest-ai-de… and Part 2: pavelkordik.substack.com/p/latest-ai-de…

Excited to share Penzai, a JAX research toolkit from Google DeepMind for building, editing, and visualizing neural networks! Penzai makes it easy to see model internals and lets you inject custom logic anywhere. Check it out on GitHub: github.com/google-deepmin…

Meet us at Recsys 2024 recombee.com/meet-us-at-rec… and check out our new beeFormer LLM foundational model for recommender systems linkedin.com/posts/kordik_b…

Great report ai.meta.com/static-resourc… text2video from meta ... with 50 core contributors and insane compute resources ... this research project was top priority

Heads up! Mosaic dropped a pretty wild dataset of 1.26 million 360° images of Prague 🤯 If you're a researcher, creator or developer into 3D/AI/Geo, I think you're gonna wanna play with this Here's the scoop on this 15 TERAPIXEL dataset & the crazy things you can do with it 🧵

Vibe Coding: AI Generated Research Paper Repository with Search and Personalized Recommendations: open.substack.com/pub/pavelkordi…

How can we collect the best stepping stones for open-ended discovery? I am excited to share Learned Quality-Diversity — a family of algorithms meta-optimized to be efficient stepping stone collectors! 📄: arxiv.org/abs/2502.02190 🌟: github.com/maxencefaldor/… work done in

📣 Competition Launch Alert! Image Matching 2025 hosted by ČVUT v Praze 🎯 Construct 3D scenes from real-world image sets. 💰 $50,000 Prize Pool ⏰ Entry Deadline: June 2, 2025 kaggle.com/competitions/i…

Our new paper (first one of my PhD!) on cooperative AI reveals a surprising insight: Environment Diversity > Partner Diversity. Agents trained in self-play across many environments learn cooperative norms that transfer to humans on novel tasks. shorturl.at/fqsNN🧵

nice recent article ... cell.com/trends/genetic…

From: huggingface.co/blog/driaforal… For more on AlgoTune, see: algotune.io