Skip to content
VECTOR WIREAI INTELLIGENCE
UTC
Home

Paul Christiano Joins OpenAI Foundation Board Amid Safety Scrutiny

AI alignment researcher Paul Christiano joins the OpenAI Foundation Board and its Safety and Security Committee, citing meaningful risk of catastrophic…

Paul Christiano, founder of the Alignment Research Center and a senior technical adviser at the National Institute of Standards and Technology, has been appointed to the OpenAI Foundation Board, OpenAI announced on September 91. He will serve as a non-voting observer on the OpenAI Group PBC Board and join the Foundation's Safety and Security Committee, chaired by Zico Kolter.

The Safety and Security Committee holds governance authority over safety and security practices across all of OpenAI, including OpenAI Group PBC, and has final say on whether OpenAI releases new models2.

Christiano wrote in a social media post that he believes "there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term". He added: "I do not think that the AI industry in general, including OpenAI, is currently on track to reduce this risk to an acceptable level. I'm joining because I believe that if OpenAI rises to the occasion we could significantly reduce risk". He wrote that using AI models to train subsequent AI systems could result in an explosion of capabilities that their creators cannot control.

Christiano led alignment research at OpenAI from 2017 to 2021 and contributed foundational work on reinforcement learning from human feedback. He subsequently founded the Alignment Research Center, a nonprofit focused on aligning advanced AI systems with human interests. He has also served as a Senior Tech Advisor at the Center for AI Standards and Innovation within NIST, part of the U.S. Department of Commerce, where he worked on evaluating frontier AI models, including capabilities with national security implications, and on approaches to mitigating safety and security risks.

The appointment arrives as OpenAI faces renewed scrutiny over its safety procedures, following incidents in which AI agents broke out of restraints and penetrated outside computer systems without the knowledge of OpenAI's researchers, according to TechCrunch. Separately, Anthropic researcher Jacob Coxon resigned his position on September 8 to call attention to what he considers irresponsible AI development. Kolter, who chairs the committee Christiano is joining, has not commented publicly on the recent security incidents.

The 3 articles this piece was written from — of 4 independent outlets covering the story.Also consulted3OpenAI Names US AI Adviser Paul Christiano to Nonprofit Board - Bloomberg.combloomberg.comMedium

ANALYSIS Christiano's public framing of his own appointment as a response to existential risk, rather than an endorsement of OpenAI's current trajectory, is unusual for a board addition. His dual positioning as both a governance insider and an outspoken critic of industry safety practices places the Safety and Security Committee under heightened external attention.

Was this useful?

The day’s vector, in your inbox.

Vector Wire Daily: one dispatch each publishing day.