Australia Moves to Regulate AI: Could Tech Companies Face Criminal Charges?

Australia is preparing mandatory artificial intelligence safety laws, a dedicated AI regulator and potentially criminal penalties for serious misconduct, following a security incident involving an OpenAI agent and a government health website.
Prime Minister Anthony Albanese announced the proposed reforms on 10 November, signalling a significant shift in Australia's approach to regulating advanced AI systems. The government intends to introduce mandatory safety and security obligations for companies developing frontier AI models — the most sophisticated artificial intelligence systems.
Under the proposed framework, companies would be required to identify and manage serious risks, maintain security controls, permit independent model evaluations and rapidly report significant incidents. A new AI safety regulator would oversee compliance and have powers to impose substantial financial penalties.
Could AI companies face criminal prosecution?
The government is also considering criminal law reforms targeting serious AI-related misconduct.
One option under consideration is a new offence for companies that fail to take reasonable steps to prevent harmful conduct by their AI systems.
However, these criminal penalties have not yet been enacted.
The announcement follows a government review of an incident in which an OpenAI agent accessed a Medicare statistics website earlier this year.
What does this mean for lawyers?
The proposals could create new advisory work across technology law, cybersecurity, regulatory compliance and corporate governance. Lawyers advising AI developers and businesses deploying advanced systems may need to assess emerging obligations around risk management, incident reporting and accountability.
The precise legal requirements will depend on legislation yet to be finalised.
Australia's message is becoming clear: as AI becomes more powerful, the legal responsibility for controlling its risks may become significantly greater.