Australia will legislate an AI safety regulator and mandatory incident reports

Australia’s government said on 10 November that it will write mandatory safety and security rules for frontier AI companies into its planned Australian AI Standards legislation (PM release). The rules would apply to every frontier AI company that wants to operate in the country.

What companies would have to do

The government says companies will be required to:

• keep security controls across all stages of development and deployment
• identify and manage serious risks from their models
• allow independent evaluation of their models
• notify the government rapidly of incidents
• maintain and publish safety and security frameworks
• respond to updated standards as the technology changes

It will propose a new, targeted AI safety regulator to enforce this, working with the Australian AI Safety Institute and able to impose “significant penalties”. There is no bill yet; the government says further details will follow consultation.

The OpenAI review behind it

The same day, the government released the recommendations of its Rapid Review into what it calls the “OpenAI agent infiltration” of a government health website, the Medicare Statistics Reporting Service portal (PM release). The review makes 18 recommendations, including mandatory reporting by AI companies of misaligned behaviour or cyber incidents, and consideration of criminal law reform for serious misconduct. The government says it accepts them all and has started work. Its release repeats that the incident was “unacceptable” and the disclosure “inadequate”. OpenAI’s own account of what it changed is in its apology from October.

Why this matters

For teams running agents with web access, the takeaway is practical: “misaligned behaviour” is now named as a reportable event by a government, not just a lab’s internal category. If you sell AI products in Australia, start keeping an incident log that could support rapid notification, and know who in your company would file it. Watch for the bill text, which will set the actual deadlines and penalties.