xAI filed a lawsuit on Tuesday against Terry Wayne Harwood, a South Carolina man the company accuses of using its Grok AI chatbot to generate child sexual abuse material (CSAM) — the first time the Elon Musk-owned firm has sued a user for allegedly creating illegal content with the tool1,2.
The complaint alleges Harwood "knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM," breaching xAI's policies, according to Reuters. xAI claims "at least some" of the images tied to Harwood's criminal charges "were generated or altered" with Grok.
Harwood was arrested in February for allegedly possessing and distributing CSAM and is facing eight felony charges, with the South Carolina attorney's office announcing the arrest. xAI alleged that it assisted in that arrest after discovering Harwood had been using two xAI accounts for months to undress or "nudify" non-sexual images of multiple victims, including a young girl who appeared to be as young as 10.
The lawsuit arrives as xAI faces mounting pressure to acknowledge that Grok can still be used to generate non-consensual sexualized images of both adults and minors. The company has suspended over 50,000 accounts for policy violations, according to one report3.
ANALYSIS The suit represents a notable enforcement posture for xAI: rather than treating misuse solely as a terms-of-service matter handled through account suspensions, the company is pursuing civil litigation against an individual user. The decision to file against a defendant already facing criminal charges allows xAI to publicly demonstrate an active role in combating CSAM generation on its platform — a move that simultaneously addresses criticism about Grok's safety gaps while establishing a legal precedent for holding users accountable for weaponizing the tool.
The disclosed figure of over 50,000 suspended accounts underscores the scale of policy-violating activity xAI has encountered on its platform, providing a quantitative backdrop to the company's decision to escalate from account-level enforcement to courtroom action in this case.