Future Matters has done great work in climate change and they are increasingly expanding into AI Safety and biosecurity. Consider applying. The CEO, Justus, is a good friend of mine; I think it'd be hard to find a better boss than him. careers.future-matters.org/30797

Great opportunity for AI and governance experts. AI office role, deadline on September 6. You need to be a EU citizen, but the role is in SF. …ternational-partnerships.ec.europa.eu/jobs/policy-of…

Another amazing contribution from Owain et al!

Wuestion: According to R1, the magic sauce for reasoning models is simply RL on certain types of tasks with hardcoded reward. But why did it take us so long to get this to work? We've been doing RLHF on LLMs for 4 or so years, and that seems technically a lot harder.

Some personal news: After four years working on safety across @openai, I left in mid-November. It was a wild ride with lots of chapters - dangerous capability evals, agent safety/control, AGI and online identity, etc. - and I'll miss many parts of it.

The European Commission is setting up a scientific panel of 60 independent experts to support the implementation and enforcement of the EU AI Act. This is a great opportunity to contribute to AI governance in Europe. More details below ⤵️ digital-strategy.ec.europa.eu/en/news/commis…

Plot twist I just realised after 10 years: Michael Gutmann invented noise-contrastive estimation, a precursor to GANs. Ian Goodfellow invented GANs. Gutmann is German for 'Goodfellow.'

The EU's Code of Practice for General-Purpose AI is out. As one of the co-chairs who drafted the Safety & Security Chapter, focused on frontier AI, I'm proud of what we've put together. It’s a lean but effective framework for frontier AI companies to comply with the AI Act.

They just keep on delivering. How do they do it?

Good post by the AI-2027 team on the role of the EU Code of Practice in the AI-2027 scenario (short timelines, US dominance, intelligence explosion)

The AI Safety Unit of the EU AI Office is looking for an admin assistant to the Head of Unit. It's a high-impact job opportunity for the right person. Deadline 30th September. eu-careers.europa.eu/en/job-opportu…

Quite the lineup! Seems worth checking out if you're in Oxford.