Got a colour printer and a laminator to make some DIY cards with images for our toddler. Me: "hmmm, what sort of images should I use..." A whisper in the back of my mind: "ImageNet, use ImageNet" Ok then...

🖤 Thanks for the paper award, ICML2024 MFM-EAI

If a 1.5yo walks into a wall and bumps his head while playing with a Rubik's cube, is that a gain or a loss in smarts? Asking for a friend

That's what I get for teaching my 1.5yo about all the "animals" in Minecraft... I was randomly trying to sing a low note, and the kiddo goes "ZOMBIE!"

ChatGPT o1 still fails the classic polar bear anti-riddle :(

Gemini Advanced kept hallucinating a quote in a well known scientific paper. At some point I got a feeling that it wasn't actually listening to what I said... (g.co/gemini/share/6…)

Just noticed that the VPT technique (used to train OpenAI's Minecraft agent) was patented early this year. "Minecraft" is not mentioned once in the document. patents.google.com/patent/US11887…

I like my research code how I like my factories... Spaghetti! #satisfactory

This GPU usage pattern is much harder to sleep to than a constant hum of full usage... Ideas?

2yo peels off this Halloween sticker, brings it to me, and says "crafting table!". The training is going well.

The true test of intelligence. Gemini 2.0 still fails it. I wonder if o3 will pass.

One day, we will achieve this true feat of intelligence. Surprised they haven't hard-coded it by now.

Come and have a look! In the 2nd half of the talk I'll be showing the first public sneak peek of a 3Blue1Brown style video on VPT interpretability I've been working on.

I've been working on a Grant Sanderson style video explaining our research on attention patterns of OpenAI's Minecraft agent VPT. 1min teaser below. You can see a longer WIP version in my recent talk at cohere (from 24:55): youtube.com/watch?v=p_vwKf…

We are looking to appoint a Research Associate in Reinforcement Learning. Closing date: 18 Sep 2025. bath.ac.uk/jobs/Vacancy.a…

We've seen OpenAI VPT attack villagers thinking they're trees. Now we have Google DeepMind SIMA 2 thinking forge bellows are "a dark spiky creature", what's next? :) Jeff Clune have you noticed this one?