How should we handle the risks of AI agents? In a paper at FAccT 2024, Alan Chan and a multi-institutional team of co-authors argue that we need information about how they will be used.

Our 2024 Winter Fellowship recently ended. Here we share summaries of the projects our Winter Fellows worked on during their three months with us:

governance.ai/post/winter-fe…

We are looking for a Research Manager to join our team! The Research Manager will be responsible for managing and continually improving the systems that underlie our research pipeline.

For information and how to apply: governance.ai/post/research-…

Is it possible to, and should we, evaluate actors on how well they can predict real-world model behaviour? Alan Chan explores this question in this GovAI blog post:

governance.ai/post/evaluatin…

What should we be evaluating besides model capabilities?

What about: how well we can predict what models will do in the real world? I explore this question in a new Centre for the Governance of AI (GovAI) blog post 🧵

Today, we publish “Governing Through the Cloud: The Intermediary Role of Compute Providers in AI Regulation.”
We propose compute providers as an important node for AI safety, both in providing secure infrastructure and acting in an intermediary role for AI regulation, leveraging

In January 2024, GovAI hosted a live webinar featuring Paul Scharre in discussion with Markus Anderljung: 'Power in the Age of Artificial Intelligence'.

Click below for the video recording of the event:

governance.ai/post/paul-scha…

New GovAI blog post:

Ben Garfinkel Markus Anderljung Lennart Heim Robert Trager Ben Clifford & Elizabeth A. Seger consider how the next AI Safety Summit can reinforce the world's commitment to an ambitious summit series.

governance.ai/post/goals-for…

We are looking for a Policy Team Project Manager to join our team.

As Policy Team Project Manager, you will facilitate our policy engagement, boost the Policy Team’s research output, & support its smooth functioning. See below for info. and to apply:

governance.ai/post/policy-te…

GovAI is searching for an Operations Associate to join our team.

*Applications close Wednesday, March 6*.

For more information about the role and to apply, please follow the link below:

governance.ai/post/operation…

Our paper 'How to design an AI ethics board' got published in AI and Ethics (with Anka Reuel and Alexis Carlier) 🥳

Read the paper: doi.org/10.1007/s43681…

GovAI is searching for a Research Management Associate to join our team. For more information about the role and to apply, please follow the link below:

governance.ai/post/research-…

Today, we’re publishing “Computing Power and the Governance of AI”. We argue that compute is a particularly promising node for AI governance. We also highlight the risks of compute governance and offer suggestions for how to mitigate them. 1/