Dutch court bans Grok from generating fake nudes, threatens €100K daily penalties
https://www.politico.eu/article/netherlands-grok-x-ban-generative-pictures-penalties/
Posted by Wagamaga
Dutch court bans Grok from generating fake nudes, threatens €100K daily penalties
https://www.politico.eu/article/netherlands-grok-x-ban-generative-pictures-penalties/
Posted by Wagamaga
13 Comments
An Amsterdam court on Thursday ordered Elon Musk’s Grok to stop generating non-consensual nude pictures and child sexual abuse material.
The company xAI, which owns the artificial intelligence chatbot, is ordered to pay damages of €100,000 per day for each day it fails to comply, up to a maximum of €10 million.
The Dutch judge said the generation and spread of sexualized footage is banned “when the functionality to undress people partially or fully is being used without these people giving their explicit consent.” The judge also prohibited the generation of footage “that, according to Dutch law, qualifies as child sexual abuse material.”
Good thing that Grok’s image generation was paywalled recently anyway (and from what I heard, even the paid option is heavily enshittificated with strict limits and heavy moderation, so such deepfakes are even less likely).
[deleted]
Does anyone use Grok? I tried it once, and it did some really stupid things, so I haven’t used it since.
There is a maximum? If so why? Shouldn’t a fine snowball to be a proper deterrent?
I would’ve ban Grok .
That’s it, just ban it, it is not like it is needed, there’s so many much better options, the only thing that thing excels at is precisely the things it shouldn’t do
That’s a laughable fine, aka cost of doing business
**A judge says it’s not clear whether the changes made by Elon Musk’s X were effective.**
March 26, 2026 7:13 pm CET
By [Pieter Haeck](https://www.politico.eu/author/pieter-haeck/)
An Amsterdam court [on Thursday ordered](https://www.rechtspraak.nl/organisatie-en-contact/organisatie/rechtbanken/rechtbank-amsterdam/nieuws/rechter-verbiedt-uitkleedbeelden-op-grok) Elon Musk’s Grok to stop generating non-consensual nude pictures and child sexual abuse material.
The company xAI, which owns the artificial intelligence chatbot, is ordered to pay damages of €100,000 per day for each day it fails to comply, up to a maximum of €10 million.
The Dutch judge said the generation and spread of sexualized footage is banned “when the functionality to undress people partially or fully is being used without these people giving their explicit consent.” The judge also prohibited the generation of footage “that, according to Dutch law, qualifies as child sexual abuse material.”
While the ban only applies in the Netherlands, the groups that brought the case said it could have wider repercussions since Grok can’t determine where a user is resident.
X didn’t respond to a request for comment.
The platform [took steps to restrict](https://www.politico.eu/article/not-over-regulators-tell-grok-elon-musk-deepfakes-nude-non-consensual/) features in January after Grok was found to be generating pictures of real people in bikinis or nude. Estimates have said that [around 3 million pictures were generated](https://counterhate.com/research/grok-floods-x-with-sexualized-images/) in 11 days.
At the time, [X said](https://x.com/safety/status/2011573102485127562?s=46): “We remain committed to making X a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content.”
The judge acknowledged that X and xAI have taken a range of measures to counter the spread of fake nudes and child sexual abuse material, but said it could not be certain that the measures that were taken are effective.
The case was brought by Offlimits, which fights online abuse, and Fonds Slachtofferhulp, which helps victims of crimes. They filed a complaint at the end of February.
Offlimits President Robbert Hoving called the ruling “fantastic news,” telling POLITICO that “technology can never be the reason for casualties.”
The European Commission [launched](https://digital-strategy.ec.europa.eu/en/news/commission-investigates-grok-and-xs-recommender-systems-under-digital-services-act) an investigation into X at the end of January.
Both European Parliament lawmakers and EU countries have pushed for a ban on AI nudification apps as part of an effort to [amend the EU’s AI rules](https://pro.politico.eu/bills/753382/overview). A ban could be in place by this summer.
Does anybody know of any other crimes where you’re told to stop committing them or otherwise get a fine? Instead of, you know, having to face consequences for the crimes you’ve already committed.
Toothless, cowardly justice system. Strong and scary with the regular person, weak and gutless with the biggest criminals of us all.
Absolute joke, how about an international arrest warrant for Musk for facilitating child porn and generating deep fakes without consent?
Oh, wait …. it’s the Netherlands so companies are more important than individual rights.
Like giving Jeff Bezos a $70 speeding ticket
What a joke.
So now we know the legal fine cost to run an AI generated kiddy porn site in the Netherlands. I don’t know what such a site would make, but it feels like this judge made the business case.