AI Leaders Call for Global Safeguards as Governments Confront Technology’s Risks

The companies developing some of the world’s most advanced artificial intelligence systems are increasingly making an unusual argument: governments need to play a larger role in determining how the technology develops.

OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei brought that message to the United Nations Security Council on September 23, warning that rapidly advancing AI capabilities require greater international cooperation and safeguards designed to keep increasingly powerful systems under human control. The meeting was formally focused on artificial intelligence and international security. 

Altman argued that decisions about the future of AI should not be concentrated within a handful of technology companies. He called for governments to help set the rules and technical standards for advanced systems, while maintaining that AI could produce substantial economic and social benefits if developed responsibly.

Amodei went further in emphasizing the potential risks. He called for international cooperation on testing advanced AI models and safeguards against applications such as biological weapons, while warning about the possibility that future systems could become increasingly difficult for their developers to control. 

The discussion reflects a broader shift in the AI debate. Governments are no longer considering only issues such as copyright, privacy and algorithmic discrimination. Attention is increasingly turning toward the capabilities of the most advanced AI models themselves and the question of what safeguards should be required as those capabilities increase.

OpenAI, for example, has proposed internationally coordinated technical standards covering areas including capability evaluations, human oversight of automated AI research and incident reporting. The company has argued that common standards could reduce the risk of countries developing incompatible regulatory approaches. 

Global agreement remains difficult

Agreement on the need for some form of oversight does not mean governments agree on what that oversight should look like.

The debate includes fundamental questions about who should set standards, whether compliance should be voluntary or mandatory, how advanced models should be tested, and whether restrictions could put companies or countries at a competitive disadvantage.

The United Kingdom is seeking to move that discussion forward. Prime Minister Andy Burnham has said AI will be a central issue during the UK’s 2027 G20 presidency, with the government seeking agreement on global principles and standards addressing both the opportunities and risks associated with the technology. citeturn1search2

That process is still in its early stages. The Security Council meeting itself did not establish new international AI regulations, and translating broad principles into enforceable national rules would require considerably more negotiation.

What this could mean for hospitality

For hotels and travel companies, the immediate significance is less about the extreme AI risks dominating the U.N. discussion and more about the regulatory framework that may emerge around the technology.

Hotels, airlines, online travel agencies and hospitality technology companies are rapidly incorporating AI into revenue management, customer service, marketing, personalization, operations and data analysis. Many of those applications rely on large AI models developed by the same companies now calling for clearer rules.

If governments eventually converge around common standards, hospitality technology providers could face requirements involving transparency, testing, data protection, monitoring and human oversight. Conversely, widely accepted standards could make it easier for multinational hotel and travel companies to deploy AI systems across markets rather than adapting to substantially different regulatory regimes in each country.

There is no indication that the U.N. discussions will directly produce rules governing hotel chatbots, revenue management systems or other hospitality applications. But the larger debate is becoming increasingly relevant to companies adopting those technologies.

The question for hospitality businesses is therefore shifting from whether they will use AI to how they will govern its use.

As AI becomes embedded in systems that communicate with guests, recommend prices, analyze customer data and support operational decisions, hotels and their technology partners may increasingly need to demonstrate not only what their AI systems can do, but also how those systems are monitored, tested and kept under human control.

Discover more at AP.