Why are world models important? AKA "the simulator," "continually hallucinated reality," or "the Holodeck." The founders of wayfarerlabs.ai go in depth about what it all means. Grok, in reply below, tells you what you will learn by watching this.

Wayfarer Labs is building open-source Genie3 with mind-blowing early results. One problem: they need an infrastructure that generates data to scale the training. The data they need (video + player input) is very scarce and is quoted at $100/hour. Meanwhile, Shaga nodes in

So as expected, when we tried to generate higher resolutions, the flickering got worse! Fun to pause and look at the little details the model decides to generate. Temporal consistency and a better "weak" decoder are definitely needed!

.Shahbuland just engineered a new VAE. Is it better than the old one?

Tfw u get to play halo for work

I'm currently working on building out the optimization stuff and even before quantization/proper compile we're hitting 30fps on a 5070, so this will run on consumer GPUs! While we get distillation and quantization sorted it's fun to look at base model samples for motivation :D

open world models

they yearn for the holodeck 😔