Transformers are all the rage today. But neither DALLE nor Stable Diffusion uses Transformer for image generation. Instead, they rely on a 7-year-old, Jurassic-era neural architecture. Why? 🤷🏾‍♀️⁉️ It’s finally time for Transformer and Diffusion to join forces! Quick 🧵👇:

Adding alkalinity to the ocean surface can absorb CO2, but the rate of CO2 absorption depends on where you add it. Results from an ocean GCM: bg.copernicus.org/articles/20/27… #CDR

Hinman Glacier in Washington state: gone kuow.org/stories/rip-wa…

I've used Vizier: it's quite robust. Recommended.

For DECADES we've assumed the surface code uses 4 couplers per qubit. But change perspective a bit, and it's clear it works just as well with 3 couplers per qubit. Same distance, same # of gate layers, same footprint. Also 23 other circuit variations: arxiv.org/abs/2302.02192

People are asking if there are alternatives to RL in RLHF. Yes, imitation with DAGGER (tutorial: ri.cmu.edu/publications/a… ). The user provides feedback with corrections, e.g. when the agent says “that” the user tells the agent that instead of saying “that”, it should say “this”.

Teaching students how to use generative AI as a tool oneusefulthing.substack.com/p/my-class-req…

A review of the exciting work in 2022 on natural science at Google Research ai.googleblog.com/2023/02/google…

First step down the road to error-correxted quantum computing quantumai.google/qecmilestone?u…

We’re proud to share promising new research published in Springer Nature’s Nature Communications journal. Along with our partners at 核融合科学研究所 in Japan, TAE has conducted the first-ever hydrogen-boron fusion experiments in a magnetically confined fusion plasma. rdcu.be/c52Ym

I got really excited that the LLaMA paper calculates and reports their carbon footprint! 🦙🌬️🌎 But upon looking at the paper itself, it has this table, which completely misconstrues the emissions of OPT and BLOOM, while not actually reporting LLaMA's own. How? A thread 🧵

From a techno-economic grid study, fusion needs to reach relatively modest capital cost goals to take off.

Is Elden Ring an existential risk to humanity? That is the question I consider in my new blog post. Yes, it is a comment on the superintelligence/x-risk debate. Read the full thing here: togelius.blogspot.com/2023/04/is-eld… Or follow along for a few tweets first, if you prefer.

Nicely cleaning up an ugly thresholding hack in diffusion models.

Looks like a very sensible way of encoding v long contexts in transformers with 2 length scales of learning arxiv.org/abs/2305.07185

🥳 We've launched support for Google children's accounts! Children under the age of 13 are now able to access Colab for learning Python programming and machine learning. 🧐

✨ Today we're launching AI coding features to our Pro+ subscribers located in the United States, including natural language to code generation, code completion, and an integrated chatbot. We'd love to hear from you with positive examples of AI coding in Colab: please share! 1/

Electricity use at data centers did NOT skyrocket. In fact, despite massive growth in computation and data storage provided, total electricity use barely budged. #EfficiencyFTW

We've shown (in a live trial) that we have a statistically significant method for avoiding contrails. blog.google/technology/ai/… #climatechange