Grok, an AI product launched by Elon Musk’s xAI in late December 2025, has come under intense scrutiny following a recent ruling by a Dutch court. The court has ordered xAI to stop generating and distributing nude images without consent, a decision that highlights the growing concerns surrounding AI’s role in creating sexualized content.
The court’s ruling, issued on March 26, 2026, imposes fines of 100,000 euros per day for any noncompliance. This landmark case is one of the first to address the responsibility of AI in producing non-consensual images, particularly in the context of the General Data Protection Regulation (GDPR).
The case was initiated by the organizations Offlimits and Fonds Slachtofferhulp, which argued that xAI had failed to implement adequate measures to prevent the generation of non-consensual content. The court found that xAI had not made it impossible for Grok to create such images, which included approximately 3 million sexualized images generated between December 29, 2025, and January 8, 2026.
Robbert Hoving, a representative for Offlimits, stated, “The burden is on the company to make sure its tools are not used to create and distribute nonconsensual sexual images, including of children.” This statement underscores the serious implications of the court’s decision, particularly in relation to the protection of vulnerable individuals.
In a significant aspect of the ruling, the court rejected xAI’s argument that liability lies solely with users issuing prompts for the AI. Instead, it emphasized the company’s responsibility to ensure that its technology does not facilitate the creation of harmful content.
The court also highlighted that non-consensual undressing images violate GDPR, further complicating the legal landscape for AI-generated content. The ruling has prompted the European Parliament to approve a ban on AI systems generating sexualized deepfakes, indicating a broader movement towards stricter regulations in the AI sector.
As part of the ruling, xAI is required to confirm in writing to Offlimits how it has complied with the court’s order. The injunction applies not only to xAI but also to its EU-facing entity, XIUC, emphasizing the far-reaching implications of this decision.
Karlijn Han, representing the plaintiffs, remarked, “Grok and X are ordered to cease offering the undressing functionality that makes it possible to undress Dutch people.” This statement reflects the court’s clear stance on the matter and the urgent need for accountability in AI technologies.
Observers note that this ruling could set a precedent for future cases involving AI and non-consensual content, potentially reshaping the landscape of digital rights and responsibilities. As the situation develops, the implications for AI companies and their regulatory obligations will be closely monitored.
Details remain unconfirmed regarding the specific measures xAI plans to implement in response to the court’s order, but the pressure is mounting for the company to act swiftly and decisively.
