{"schema_version":"0.10.0","id":"LR-2026-0485","record_version":1,"title":"Dutch court orders Grok to stop generating non-consensual nude images","verification":{"human_verified":false,"method":"automated_gate","auto_verified":true,"score":52.1,"score_breakdown":{"source_authority":12.1,"independent_corroboration":7.0,"implicated_party_confirmed":0.0,"citation_integrity":14.0,"specificity":6.0,"completeness":5.44,"unhedged_language":5.0},"checks":{"schema_valid":true,"every_field_cited":true,"quotes_verbatim":true,"source_fetched":true,"distinct_incident":true,"dates_plausible":true,"sources_agree":true,"source_describes_incident":true,"severe_backed_by_source":true,"record_integrity":true,"eligible":true,"about_this_case":true},"gate_version":"gate-2026-10-18.7","cross_check_model":null,"cross_check_agreement":null,"duplicate_of":null,"verified_by":null,"verified_at":"2026-11-01","extraction_run_id":null,"evidence_level":{"level":"preliminary","reason":"Publisher not yet named · subject to change","original_document":null,"reports_total":1,"reports_independent":0,"reports_derivative":0,"developing":false,"disputed":false,"rules_version":"evidence-2026-10-29.1","computed_at":"2026-11-01","history":[{"date":"2026-11-01","from_level":null,"to_level":"preliminary","reason":"Publisher not yet named · subject to change"}]},"sources_hash":"5e016008b66cc6bc6b80fbdc48019b86df3e7506100f254281c1be0168f4e696"},"system":{"model_name":"Grok","model_version":null,"developer":"xAI","harness":null,"tools_granted":[],"permissions_scope":null,"autonomy_level":"unknown","guardrails_present":[],"deployment_context":"unknown","tier":null,"lifecycle_stage":null,"integration_type":null,"intended_use":null,"safeguard_state":null,"production_intended":null},"event":{"date_occurred":null,"date_disclosed":"2026-03-26","incident_class":"harmful_output","failure_class":null,"agent_involved":null,"secondary_failure_classes":[],"trigger":"unknown","duration":null,"detection_method":"third_party","summary":"Grok, the AI chatbot developed by xAI and offered on the X platform, included an image editing feature that could generate sexualized images of real people without their consent, including child sexual abuse material. Offlimits, an expertise center on online sexual abuse, sent a formal notice on 4 February 2026 demanding the functionality stop. At a 12 March hearing, xAI's lawyers argued that stringent safeguards had been in place since 20 January 2026. Offlimits presented evidence that on 9 March 2026 it could still generate a sexualized video of an existing person from a single photograph without consent verification. The Amsterdam District Court issued a binding injunction, with daily penalties of €100,000 per defendant for non-compliance, ordering xAI, X Corp and X Internet Unlimited Company to stop the prohibited generation and distribution in the Netherlands.","tags":["non-consensual-imagery","child-sexual-abuse-material","court-injunction"],"date_detected":null,"near_miss":null,"root_cause":null,"root_cause_detail":null,"failure_class_detail":null,"responsible_party":"provider","adversarial_actor":null,"input_provenance":null,"time_to_contain":null,"operations_paused":null,"remediation":null,"precursor_events":"Formal notice to xAI and X on 2026-02-04 demanding they cease the functionality; reports to Offlimits had surged after the feature launched","primary_risk":"RK12","secondary_risks":["RK15"]},"impact":{"direct_loss_usd":null,"remediation_hours":null,"records_exposed":null,"third_parties_affected_count":null,"severity":"major","severity_because":"Regulator-involved test met: Ireland's Data Protection Commission, the European Commission and Ofcom have opened enforcement actions.","harm_class":["privacy"],"affected_description":"Persons residing in the Netherlands depicted in sexual imagery without explicit consent, and children depicted in child pornographic material","protected_class_involved":null,"data_categories_exposed":[],"loss_range_usd":null,"reversibility":null,"downstream_exposure_count":null},"evidence":{"sources":[{"url":"https://techpolicy.press/dutch-court-orders-x-grok-to-stop-aigenerated-sexual-abuse-content","publisher":"Tech Policy Press","date":"2026-03-26","type":"press","title":"Dutch Court Orders X, Grok to Stop AI-Generated Sexual Abuse Content - Tech Policy Press","archived_url":null,"attachment":"first_report"}],"per_field_confidence":{"system.model_name":"C","system.developer":"C","event.incident_class":"C","event.detection_method":"C","event.responsible_party":"C","event.precursor_events":"C","event.tags":"C","impact.harm_class":"C","impact.affected_description":"C","context.country":"C","impact.severity":"D","impact.severity_because":"D","event.primary_risk":"D","event.secondary_risks":"D","event.summary":"C","system.autonomy_level":"D","system.deployment_context":"D","event.trigger":"D","event.date_disclosed":"D","context.denominator_available":"D"},"field_citations":{"system.model_name":[{"source_index":0,"quote":"A Dutch court has ordered X and its AI chatbot Grok to immediately stop generating non-consensual sexualized imagery and child pornographic material in the Netherlands, imposing a penalty of €100,000 per day on each defendant for non-compliance."}],"system.developer":[{"source_index":0,"quote":"The court ordered xAI (operating as Grok) to stop generating and distributing sexual imagery of persons residing in the Netherlands without their explicit consent, and to stop producing, distributing, or publicly displaying content that qualifies as child pornographic material under Dutch law."}],"event.incident_class":[{"source_index":0,"quote":"A Dutch court has ordered X and its AI chatbot Grok to immediately stop generating non-consensual sexualized imagery and child pornographic material in the Netherlands, imposing a penalty of €100,000 per day on each defendant for non-compliance."}],"event.detection_method":[{"source_index":0,"quote":"The case was brought by Offlimits, an expertise center on online sexual abuse, and Fonds Slachtofferhulp, a victim support organization, after Offlimits concluded that regulatory enforcement was moving too slowly relative to the pace of harm."}],"event.responsible_party":[{"source_index":0,"quote":"As an internet intermediary with control over Grok's functionalities, the court held, xAI is the appropriate party to prevent the generation and distribution of unlawful images — regardless of whether it is independently liable alongside users."}],"event.precursor_events":[{"source_index":0,"quote":"After Grok's image editing feature launched in late December 2025 and reports to Offlimits surged, the organization sent a formal notice to xAI and X on February 4, 2026, demanding they cease the functionality."}],"event.tags":[{"source_index":0,"quote":"A Dutch court has ordered X and its AI chatbot Grok to immediately stop generating non-consensual sexualized imagery and child pornographic material in the Netherlands, imposing a penalty of €100,000 per day on each defendant for non-compliance."}],"impact.harm_class":[{"source_index":0,"quote":"The court ordered xAI (operating as Grok) to stop generating and distributing sexual imagery of persons residing in the Netherlands without their explicit consent, and to stop producing, distributing, or publicly displaying content that qualifies as child pornographic material under Dutch law."}],"impact.affected_description":[{"source_index":0,"quote":"The court ordered xAI (operating as Grok) to stop generating and distributing sexual imagery of persons residing in the Netherlands without their explicit consent, and to stop producing, distributing, or publicly displaying content that qualifies as child pornographic material under Dutch law."}],"context.country":[{"source_index":0,"quote":"The judgment, issued Thursday by the Amsterdam District Court, is the first European court ruling to impose a binding injunction on an AI image generator over non-consensual sexualized content."}],"impact.severity":[{"source_index":0,"quote":"Thursday's ruling arrives alongside parallel enforcement actions from Ireland's Data Protection Commission, which opened a GDPR investigation in February; the European Commission, which launched DSA proceedings against X in January; and Ofcom, which opened an Online Safety Act investigation in the UK."}],"impact.severity_because":[{"source_index":0,"quote":"Thursday's ruling arrives alongside parallel enforcement actions from Ireland's Data Protection Commission, which opened a GDPR investigation in February; the European Commission, which launched DSA proceedings against X in January; and Ofcom, which opened an Online Safety Act investigation in the UK."}],"event.summary":[{"source_index":0,"quote":"After Grok's image editing feature launched in late December 2025 and reports to Offlimits surged, the organization sent a formal notice to xAI and X on February 4, 2026, demanding they cease the functionality."},{"source_index":0,"quote":"At the March 12 hearing, xAI's lawyers argued the company had implemented stringent safeguards as of January 20, 2026, categorically rejecting any suggestion that Grok still permitted non-consensual intimate imagery or child sexual abuse material."},{"source_index":0,"quote":"The court found that claim difficult to reconcile with evidence submitted by Offlimits showing that on March 9, 2026 — the same day the defendants sent that categorical denial — Offlimits was still able to generate a video of an existing person in a sexualized context, from a single uploaded photograph, without Grok verifying consent."},{"source_index":0,"quote":"A Dutch court has ordered X and its AI chatbot Grok to immediately stop generating non-consensual sexualized imagery and child pornographic material in the Netherlands, imposing a penalty of €100,000 per day on each defendant for non-compliance."}]},"notes_on_gaps":"No source states a single date of occurrence; the harm period is a CCDH estimate range and the feature launch is given only as late December 2025. The judgment date 2026-03-26 is inferred from the article date and the word Thursday. No agent, autonomy, tools, harness or permissions are stated, so agent fields and failure_class are omitted and agent_involved is not set. The trigger and adversarial actor are not stated and are omitted. Deployment_context production is inferred from the public feature launch. The CCDH counts are estimates reported by a press source and are not verified. The control D1 link is a judgement: the sources describe safeguards generally and do not name a control, and the court found consent verification absent. The remediation is a court order rather than a change xAI reported, so it is recorded as advice and not as a fix; no xAI or X response was given. The industry is not stated and is omitted. Severity major rests on the regulator test, as the source names regulators opening enforcement actions. Affected party counts are not stated, so third_parties_affected_count is omitted. [case created by the backfill: read by claude-haiku-5-5, backfill-2026-11-01.2, 2026-11-01; not yet reviewed] [2026-11-01: evidence level set: Preliminary (Publisher not yet named · subject to change)]"},"context":{"industry":null,"org_size_band":null,"country":"NL","denominator_available":false,"denominator":null,"related_incident_ids":[],"systemic_exposure":null,"shared_model_id":null,"upstream_incident_id":null,"incident_evidence":null,"regulatory":null,"coverage":null},"narrative":{"steps":[{"step":"doing","text":"Grok's image editing feature launched in late December 2025, and reports of sexualized imagery to Offlimits surged.","quote":"After Grok's image editing feature launched in late December 2025 and reports to Offlimits surged, the organization sent a formal notice to xAI and X on February 4, 2026, demanding they cease the functionality.","source_index":0,"grade":"C"},{"step":"went_wrong","text":"On 9 March 2026 the court found that a sexualized video of an existing person could still be generated from one photo without consent verification.","quote":"The court found that claim difficult to reconcile with evidence submitted by Offlimits showing that on March 9, 2026 — the same day the defendants sent that categorical denial — Offlimits was still able to generate a video of an existing person in a sexualized context, from a single uploaded photograph, without Grok verifying consent.","source_index":0,"grade":"C"},{"step":"reached","text":"A CCDH report estimated about 3 million sexualized images generated between December 29, 2025 and January 8, 2026.","quote":"The case was brought following a report by the Center for Countering Digital Hate estimating that Grok generated approximately 3 million sexualized images between December 29, 2025, and January 8, 2026, including an estimated 23,000 appearing to depict children.","source_index":0,"grade":"C"},{"step":"caught","text":"Offlimits and Fonds Slachtofferhulp brought the case after concluding that regulatory enforcement was too slow.","quote":"The case was brought by Offlimits, an expertise center on online sexual abuse, and Fonds Slachtofferhulp, a victim support organization, after Offlimits concluded that regulatory enforcement was moving too slowly relative to the pace of harm.","source_index":0,"grade":"C"},{"step":"done","text":"The Amsterdam District Court ordered an immediate stop to the prohibited generation in the Netherlands, with daily penalties for non-compliance.","quote":"A Dutch court has ordered X and its AI chatbot Grok to immediately stop generating non-consensual sexualized imagery and child pornographic material in the Netherlands, imposing a penalty of €100,000 per day on each defendant for non-compliance.","source_index":0,"grade":"C"}],"model":"claude-haiku-5-5","prompt_version":"backfill-2026-11-01.2","extracted_at":"2026-11-01","source_urls":["https://techpolicy.press/dutch-court-orders-x-grok-to-stop-aigenerated-sexual-abuse-content"]},"analysis":{"sections":{"timeline":[{"text":"Grok's image editing feature launched.","quote":"After Grok's image editing feature launched in late December 2025 and reports to Offlimits surged, the organization sent a formal notice to xAI and X on February 4, 2026, demanding they cease the functionality.","source_index":0,"when":"late December 2025"},{"text":"CCDH estimated Grok generated approximately 3 million sexualized images in this period, including an estimated 23,000 appearing to depict children.","quote":"The case was brought following a report by the Center for Countering Digital Hate estimating that Grok generated approximately 3 million sexualized images between December 29, 2025, and January 8, 2026, including an estimated 23,000 appearing to depict children.","source_index":0,"when":"December 29, 2025 to January 8, 2026"},{"text":"Offlimits sent a formal notice to xAI and X demanding they cease the functionality.","quote":"After Grok's image editing feature launched in late December 2025 and reports to Offlimits surged, the organization sent a formal notice to xAI and X on February 4, 2026, demanding they cease the functionality.","source_index":0,"when":"2026-02-04"},{"text":"The European Commission launched DSA proceedings against X.","quote":"Thursday's ruling arrives alongside parallel enforcement actions from Ireland's Data Protection Commission, which opened a GDPR investigation in February; the European Commission, which launched DSA proceedings against X in January; and Ofcom, which opened an Online Safety Act investigation in the UK.","source_index":0,"when":"January 2026"},{"text":"Ireland's Data Protection Commission opened a GDPR investigation.","quote":"Thursday's ruling arrives alongside parallel enforcement actions from Ireland's Data Protection Commission, which opened a GDPR investigation in February; the European Commission, which launched DSA proceedings against X in January; and Ofcom, which opened an Online Safety Act investigation in the UK.","source_index":0,"when":"February 2026"},{"text":"xAI's lawyers later said stringent safeguards had been implemented as of this date.","quote":"At the March 12 hearing, xAI's lawyers argued the company had implemented stringent safeguards as of January 20, 2026, categorically rejecting any suggestion that Grok still permitted non-consensual intimate imagery or child sexual abuse material.","source_index":0,"when":"2026-01-20"},{"text":"At the hearing, xAI's lawyers argued that safeguards were in place and categorically rejected any suggestion that Grok still permitted such content.","quote":"At the March 12 hearing, xAI's lawyers argued the company had implemented stringent safeguards as of January 20, 2026, categorically rejecting any suggestion that Grok still permitted non-consensual intimate imagery or child sexual abuse material.","source_index":0,"when":"2026-03-12"},{"text":"Offlimits was still able to generate a sexualized video of an existing person from a single uploaded photograph without Grok verifying consent.","quote":"The court found that claim difficult to reconcile with evidence submitted by Offlimits showing that on March 9, 2026 — the same day the defendants sent that categorical denial — Offlimits was still able to generate a video of an existing person in a sexualized context, from a single uploaded photograph, without Grok verifying consent.","source_index":0,"when":"2026-03-09"},{"text":"Civil suits were filed in the United States, including by three Tennessee teenagers.","quote":"Civil suits have also been filed in the United States this month, including by three Tennessee teenagers on March 16 and the city of Baltimore on Wednesday.","source_index":0,"when":"2026-03-16"},{"text":"The defendants have ten working days from service of the judgment to confirm compliance in writing.","quote":"The defendants have ten working days from service of the judgment to confirm in writing to Offlimits how they have complied.","source_index":0,"when":null}]},"model":"claude-haiku-5-5","prompt_version":"backfill-2026-11-01.2","extracted_at":"2026-11-01","source_urls":["https://techpolicy.press/dutch-court-orders-x-grok-to-stop-aigenerated-sexual-abuse-content"]}}