xAI filed suit in federal court on Monday against Minnesota Attorney General Keith Ellison, challenging the state's first-in-the-nation law banning nudification technology on websites and apps1,2. The law, signed in May, is set to take effect on Saturday.
The lawsuit arrives days before Minnesota would become the first state to outlaw the increasingly proliferating technology that lets people use AI to create fake nude images of real people. xAI argues that the statute violates the First Amendment.
xAI claims the law's punitive provisions leave the company with "no practical choice but to restrict Grok Imagine's image-editing features in various ways". The case could provide a test for how far states can go in constitutionally regulating the use of artificial intelligence.
The legal challenge follows a January incident in which Grok generated millions of sexually explicit deepfakes, including images of minors. The Verge noted that in a prior era, a content moderation failure of that magnitude would have prompted an immediate product shutdown.
ANALYSIS The lawsuit sets up a direct collision between state-level AI content regulation and First Amendment claims by an AI company. The outcome could shape the legal landscape for other states considering similar measures targeting AI-generated nonconsensual imagery.
The case also adds to a growing docket of AI-related litigation. A federal judge recently gave final approval to Anthropic's $1.5 billion class action settlement with authors and book publishers over copyright claims ctx. While that case centered on training data, the Minnesota suit raises a distinct question: whether states can regulate the outputs of generative AI systems by criminalizing specific categories of generated content.
ANALYSIS xAI's framing of the dispute as a speech issue — rather than a product safety or consumer protection matter — places the burden on Minnesota to demonstrate that the law survives constitutional scrutiny. The company filed days before the law's effective date, leaving a narrow window for judicial intervention before enforcement begins.