Very happy to see such a cool application of VQ-VAEs by our friends OpenAI! Congrats!

One of my favorites from OpenAI's jukebox: 'Lose Yourself' re-rendered by Kanye soundcloud.com/openai_audio/j…

Hot Tub Christmas (with GPT-2 lyrics selected by rewon ) is my own favorite -- even though the model can't figure out what's going on in the completely terrible intro. Our weird but fun new holiday tradition! soundcloud.com/openai_audio/j…

Excited to share what I've been working on with Alec Radford, rewon, Ilya Sutskever and others!

I keep seeing all kinds of crazy reports about people's experiences with GPT-3, so I figured that I'd collect a thread of them.

Posted my first paper on arXiv💥🙌 GPT-f is a Transformer-based automated theorem prover. We show that Transformer + Search is suitable to formal reasoning and continuous self-improvement 🦾 arxiv.org/abs/2009.03393

It breaks my 💚 when researchers tell me that VAEs don't work. My first typical question is "did you try hierarchial VAE or vanilla VAE?", the answer is usually vanilla VAE. VAEs work much better with hierarchical structures. NVAEs and this work take this to the extreme!

Really thought-provoking work -- congrats to the authors Ben Poole @YSongStanford Durk Kingma and more!

It is easy to write a program but it is difficult to create a machine that will read those lines. (Was looking through my journal, found this gpt-3 generation conditioned on haikus)

Congrats to Aditya and the rest of the team for an awesome release!

IMO, best empirical proof to date that AI can be creative. After this sinks in, will there be any naysayers left?

My post on SotA image generative models was released 🥳 Featured 7 notable recent papers with emphasis on: - VD-VAE - VAE + discriminator (e.g. VQGAN, DC-VAE) - Diffusion models (e.g. DDPMv2) Plus some notes on scaling (e.g. DALL-E) and evaluation. arankomatsuzaki.wordpress.com/2021/03/04/sta…

I've ported rewon's very deep VAE (arxiv.org/abs/2011.10650) from PyTorch to JAX/Flax! Hope other JAX users find this SOTA VAE useful as a forkable baseline... github.com/j-towns/vdvae-….

Kullback-Leibler divergence is not the same as Leibler-Kullback divergence

We have amazing results to announce! Inflection-1 is our new best-in-class LLM powering Pi, outperforming GPT-3.5, Llama and PALM-540B on major benchmarks commonly used for comparing LLMs. inflection.ai/inflection-1

Excited to announce that we’ve raised $1.3B to build one of the largest clusters in the world and turbocharge the creation of Pi, your personal AI. forbes.com/sites/alexkonr…

It’s a big week! We’ve raised $1.3 billion and are building the world’s largest AI cluster (22k H100s). We’re grateful for our investors and new funding that will help us accelerate our mission to make personal AI available to every person in the world. inflection.ai/inflection-ai-…