Google has filed a lawsuit against an alleged Chinese cybercrime operation accused of turning the company's own artificial intelligence tool against its users. According to TechCrunch, the group — identified in the suit as "Outsider Enterprise" — used AI to scam hundreds of thousands of victims, sending 2.5 million text messages over the span of just two weeks.
According to Ars Technica, the fraudsters used Google's Gemini AI to automate the creation of scam websites, targeting hundreds of thousands of people with Gemini-coded pages designed to deceive them. Bloomberg reports that Gemini was specifically used to help build the spam messages themselves — accelerating the scale and sophistication of the operation far beyond what a human-run scheme could achieve manually.
The lawsuit marks a notable escalation in how tech companies are responding to the misuse of their own generative AI platforms. Rather than simply banning accounts or issuing warnings, Google is taking the alleged perpetrators to court — a move that signals the company is willing to pursue legal accountability when its tools are weaponized for fraud.
The case also highlights a growing tension in the AI industry: the same tools built to boost productivity can be repurposed to industrialize crime. When a scam operation can generate millions of fraudulent messages and spin up convincing fake websites at the click of a button, the harm to ordinary people scales just as fast as the technology does — and that's the real stakes here.