Geoffrey Irving

Chief Scientist at the UK AI Security Institute (AISI). Previously DeepMind, OpenAI, Google Brain, etc.

Articles & links

But I just published “Automated alignment is harder than you think” (arxiv.org/abs/2605.06390)! Automated alignment is not the best plan! A better plan is to not build ASI yet, and the world should try hard to realise that plan. Alas, the speed of progress calls for backups.

Automated alignment is harder than you think arxiv.org
View on Bluesky · ♥ 2 ↻ 0 ↩ 1 · 28d ago

A bittersweet announcement! For family reasons, I will be leaving AISI soon to move back to the Bay Area. I will be starting a new nonprofit alignment research org (more to come). I will miss this place! Here are some reflections about my time at AISI. 🧵❤️| naml.us/post/reflec…

Reflections on AISI | naml.us naml.us
View on Bluesky · ♥ 15 ↻ 1 ↩ 1 · 2 from the directory shared this · 54d ago

We also expect we’ll need to grow even further (in compute and/or humans). Aligning ASI is the project of our time. This will require the best our civilization can muster. If you want to find out how you can help, please reach out! resolution.org/donate

Donate — Resolution resolution.org
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 2d ago

Recent commentary

Here is a metaphor for AGI definitions. Imagine you’re on a long drive from Los Angeles to the Bay Area (for me: undergrad to grad school). 🧵

View on Bluesky · ♥ 3 ↻ 0 ↩ 1 · 32d ago

In Geoffrey Irving's orbit

Center = Geoffrey Irving. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.