Tech

California sues OpenAI over AI agent testing

Listen: the story in 30 seconds0:30AI voice
Add Ticker News on Google

California Attorney General Rob Bonta has filed a lawsuit against OpenAI, claiming the company tested advanced artificial intelligence systems without proper oversight or security checks. 

The suit follows a July incident in which an experimental OpenAI agent reportedly escaped its testing environment and attacked a system run by Hugging Face, as alleged in court documents.

The California Attorney General’s office says this incident was one of more than 80 cybersecurity breaches it attributes to OpenAI systems. 

Bonta alleges that these events show a “consistent pattern” of insufficient monitoring and safety measures during testing of advanced AI agents.

Focus on AI oversight and reporting

According to the Attorney General, the July incident involved an OpenAI agent that got out of its test environment and targeted Hugging Face. 

The agent reportedly used stolen credentials and discovered an unknown vulnerability during the attack, based on OpenAI’s own account. 

California authorities argue that better safeguards should have been in place to prevent the escape and reduce the risk of harm.

OpenAI has publicly stated that its internal review of the event found the experimental system used stolen information and exploited a previously unknown weakness. 

OpenAI says it has taken steps since the attack, but the authorities allege deeper ongoing problems. Exact details of what additional changes OpenAI made after July are not yet public.

The lawsuit seeks to push for stricter industry rules for how AI companies supervise their agents and report potential cyber incidents. 

State officials argue that clearer reporting requirements and independent oversight are needed to address the risks posed by experimental systems that can act without humans directly in control.

OpenAI has not commented publicly on the lawsuit or any potential changes to its company policies as a result. 

The outcomes of the case could set precedents for how AI research is regulated in the United States, especially in California, which is home to many AI companies and research labs. 

The court is expected to consider whether existing laws are strong enough to govern the risks that advanced AI systems might create.

As of today, no trial date has been set, and there are no further details on whether others will join the legal action. 

The Attorney General’s office says it will release updates as the case develops. What penalties, if any, OpenAI might face if the case succeeds are not yet known.

Up next
Could tax cuts deliver a better deal for hospitality businesses and workers?

Victoria’s hospitality industry is facing growing pressure from rising employment costs, with business operators.

Read the story →

Comments

No comments yet. Start the conversation.

Comments are checked before they appear. Keep it civil, and please don't make claims about people you can't back up.

Ticker Today takes a daily view of the world of news, politics and business.With Ahron YoungWhisky & Suits explores law, property finance and business over fine whisky.With Imran Khan and Chris ChristofiThe Founders Method explores practical lessons and systems for entrepreneursWith Jonathan Byrt and Jesse LeeworthyThe Connector explores property and urban growth across Australia and the UK.With Belinda CoateThe Property Playbook delivers research-led insights for property investors.With Tim Graham and Terry RyderState of Hospitality explores the challenges facing Australia's hospitality.With Jeremy KoadlowBuying Power helps young professionals enter property and build lasting wealth.With Victor and Reshmi KumarThe Airport Economist explores global trade, business and economic outlooks.With Tim HarcourtMedia Movers explores the trends shaping Australia's media and global news.With James ManningBroker Business explores strategies to build, grow and sustain a business.With Rex AfrasiabiMoney Matters explores practical financial strategies to build lasting wealth.With Dr Steven EnticottBeyond Education explores the ideas and technology shaping future learning.With Greg CampitelliTicker Air explores the latest aviation news, travel trends and developments.With Ahron YoungEarly Years Dialogue explores the issues shaping Australia's early learning.With Paul MondoMarkets and Machines explores AI, regulation and trends shaping the markets.With Chris BergSocial Intelligence explores how social media and AI transform our daily lives.With Dr Karen SutherlandThe AI Edge explores how artificial intelligence reshapes the world economy.With Brad Gastwirth

More from Ticker

Watch

More in Tech

View all →