Artificial Intelligence4 min read

Interested parties, countries can come together to launch AI incident reporting pilot: PM Wong

By · Published by Everything Blog

In short

The voluntary framework seeks to gather crucial operational failure data from public and private entities rather than depending exclusively on developers' self-reported findings. Recent vulnerabilities, including breach attempts targeting an Australian healthcare database and the Hugging Face platform, emphasize the urgency of coordinated vigilance. Singapore Prime Minister Lawrence Wong emphasized that this trial should leverage established bodies, including the Independent Scientific Panel on AI, to prevent duplicate oversight efforts.

Key points

  • Global AI safety standards should leverage lessons from aviation oversight by routinely s…: Global AI safety standards should leverage lessons from aviation oversight by routinely sharing data on failures and near misses.
  • International governance mechanisms must incorporate insights from real-world deployers r…: International governance mechanisms must incorporate insights from real-world deployers rather than relying solely on safety data provided by developers.
  • A voluntary pilot enables participating nations to align on threat classifications and se…: A voluntary pilot enables participating nations to align on threat classifications and secure data sharing prior to constructing formal international architecture.

Sources checked by our analysis pipeline: 1

Mr Wong suggested that countries start with a "practical and flexible approach" to AI governance.

SINGAPORE: In developing an artificial intelligence (AI) incident reporting pilot, interested parties and countries can learn from international aviation, where incidents and near misses are reported and studied, with lessons shared, said Prime Minister Lawrence Wong.

Speaking at the Virtual Leaders' Meeting on Frontier AI Safety on Wednesday (Oct 28), Mr Wong suggested that such a pilot could be a first step in AI governance.

“We can start by agreeing on a common set of incident categories and information to be shared,” he said.

“We can explore how participating countries can collect and exchange this information securely. And this will allow us to test what works, identify the practical difficulties, and build confidence before considering a wider framework.”

Given that countries might have different approaches to AI governance but have a common interest in making AI safer, Mr Wong suggested that meaningful cooperation can begin by taking a "practical and flexible approach".

Rather than seek to establish an “elaborate new international architecture” from the outset, countries can organise their cooperation around specific workstreams, with smaller cross-regional groups of interested countries taking the lead in developing practical tools and frameworks.

"The participation and adoption can remain voluntary, so countries can contribute according to our interests and capabilities," said Mr Wong.

Co-hosted by Norwegian Prime Minister Jonas Gahr Støre and Finnish President Alexander Stubb, the meeting involved 22 countries and the European Commission.

It was a follow-up to the joint declaration for the control of frontier AI models at the United Nations General Assembly in September.

Mr Wong and more than 20 other world leaders had signed a joint statement calling for stronger safeguards for frontier AI amid greater scrutiny of the technology's risks.

Concerns over the safety of frontier AI models have recently made headlines, including in September, when a rogue AI agent from OpenAI breached an Australian national healthcare database.

In response to the breach, Australian leaders said they were considering possible "law enforcement and legislative responses".

In July, about 700 AI agents created by OpenAI hacked the open-source platform Hugging Face. The company said in October that it had resumed training of its most advanced AI models after tightening security and barring internet access.

BUILDING ON EXISTING EFFORTS

Singapore stands ready to do its part in advancing initiatives on the safe and responsible use of AI, Mr Wong said on Wednesday.

AI safeguards should build on existing efforts, rather than duplicate what is already being done, he added.

Singapore convenes an International Scientific Exchange on AI Safety that brings together researchers, developers and governments. This has produced the Singapore Consensus on Global AI Safety Research Priorities.

“We can also draw on the work of the Independent Scientific Panel on AI, which supports the UN Global Dialogue on AI Governance,” said the prime minister.

Mr Wong highlighted AI incident reporting as one specific area for practical cooperation, adding that lessons should not be confined to one country or one company when serious AI incidents happen.

"We should be able to learn from what went wrong, identify the emerging risks, and take steps to prevent similar incidents happening elsewhere," said Mr Wong.

He added that current knowledge about the safety of frontier models mostly comes from developers.

"But in fact, all of us – governments, businesses and other organisations – are using these models. And as users, we ourselves encounter serious failures or near misses that reveal significant risks, even if no actual harm has occurred," said Mr Wong.

Although these cases may not trigger existing reporting requirements, they can still offer valuable lessons for everyone, he said, adding that these lessons can be shared more systematically, while respecting any legitimate security and commercial sensitivities.

Original source: www.channelnewsasia.com

Artificial Intelligence