Meta ran 300+ CSAM ads with AI-manipulated child images, probe finds

Share:
Audio Loading voice…
Meta ran 300+ CSAM ads with AI-manipulated child images, probe finds

Synopsis

A Tech Transparency Project investigation found Meta's platforms ran over 300 paid ads featuring AI-manipulated child sexual abuse material — including an image of a European royal family minor — many placed by Chinese advertising partners. Meta only acted after being directly confronted with the findings, and had previously miscategorised the ads under adult content policies, not child exploitation ones.

Key Takeaways

Meta's Facebook and Instagram hosted more than 300 paid advertisements featuring child sexual abuse material ( CSAM ), according to a Tech Transparency Project (TTP) investigation.
Advertisements used real children's photographs sourced from social media and websites, then manipulated with generative AI to produce explicit imagery.
Several ads were placed by Meta's Chinese advertising partners , including at least one Chinese state-controlled company , and directed users to AI 'nudification' apps.
Meta removed approximately 150 ads and reclassified more than 100 others as child-exploitation violations only after TTP shared its findings with the company.
The ads had previously been categorised under adult content policies , not child-exploitation policies — raising concerns about systemic undercounting of AI-generated CSAM on the platform.

Meta's Facebook and Instagram platforms hosted more than 300 paid advertisements featuring child sexual abuse material (CSAM) in 2024, including AI-manipulated images of real children, according to an investigation by the Tech Transparency Project (TTP). The findings have intensified scrutiny of Meta's advertising safeguards and its ability to detect AI-generated child exploitation content at scale.

What the Investigation Found

According to TTP, investigators identified photographs of real children — sourced from social media posts and public websites — that had been processed through generative AI tools to fabricate explicit sexual imagery. Most of the advertisements followed a disturbing pattern: they opened with a clip of adult pornography before transitioning to an AI-manipulated image of a child.

In one particularly egregious case flagged by the investigation, a publicly released photograph of a minor member of a European royal family was digitally transformed into a video depicting the child in a graphic sex act. That advertisement promoted a Chinese AI application and was reportedly targeted at adult male users on both Facebook and Instagram. The children depicted ranged from toddlers and preteens to young teenagers, the investigation noted.

Links to Chinese Advertising Partners

The investigation further found that several of the advertisements had been placed by Meta's advertising partners based in China, including at least one Chinese state-controlled company. The vast majority of the ads directed users toward AI applications developed in China, with many of those apps offering or enabling so-called 'nudification' capabilities — tools that digitally remove clothing from images or generate sexually explicit versions of photographs.

Notably, the recurring use of similar captions, voiceovers, and background music across multiple advertisements suggested a coordinated or templated distribution effort, raising questions about whether the content was being systematically produced and distributed rather than uploaded by isolated bad actors.

Meta's Response and Policy Gaps

Meta did not initially respond to TTP's request for comment. After the organisation shared its findings directly with the company, Meta conducted a rapid cleanup of its advertising ecosystem. Approximately 150 advertisements that were still accessible in Meta's Ad Library were removed, according to TTP.

Meta also updated records for more than 100 advertisements that had already been taken down, reclassifying them as violations of its child-exploitation policies. Critically, those advertisements had previously been categorised under Meta's adult-oriented content policies — without any explicit identification of children's involvement — raising concerns that Meta's enforcement systems may be systematically undercounting child sexual exploitation cases, particularly where AI-generated or AI-manipulated imagery is involved.

A Meta spokesperson said the company does not tolerate 'nudify apps or any kind of child exploitation, whether real or AI-generated,' adding that many of the advertisements flagged by the investigation had already been removed and that the company continues to strengthen its detection and enforcement systems.

Broader Implications for Platform Safety

The TTP investigation arrives at a moment of heightened regulatory pressure on major platforms over child safety. This comes amid ongoing legislative debates in multiple jurisdictions — including the United States and the European Union — over platform liability for AI-generated harmful content. Critics argue that Meta's reactive cleanup, rather than proactive detection, underscores a structural failure in how large platforms police paid advertising, where financial incentives can inadvertently subsidise harmful content distribution.

The case also highlights a growing vulnerability: as generative AI tools become more accessible, the barrier to producing synthetic CSAM is falling, while detection systems at major platforms have not kept pace. Whether Meta's updated enforcement classifications will translate into a meaningful reduction in such content — or merely a reclassification exercise — remains to be seen.

Point of View

Just under the wrong policy bucket. Labelling AI-generated CSAM as generic 'adult content' is not a minor classification error; it means child exploitation goes unmeasured, unreported, and potentially unpunished under the platform's own enforcement metrics. Meta's reactive cleanup after being contacted by researchers is a pattern the company has repeated across multiple safety failures — acting on external pressure rather than internal detection. With Chinese state-linked entities among the ad buyers, this also raises questions that go beyond platform policy into the territory of foreign misuse of American social media infrastructure to distribute child exploitation material.
NationPress
9 Sept 2026

Frequently Asked Questions

What did the Tech Transparency Project investigation find about Meta?
The Tech Transparency Project found that Meta's Facebook and Instagram platforms carried more than 300 paid advertisements featuring child sexual abuse material in 2024, including AI-manipulated images of real children. Many of the ads were placed by Chinese advertising partners and directed users to AI 'nudification' applications.
How did Meta respond to the CSAM advertising investigation?
Meta did not initially respond to TTP's request for comment, but after the organisation shared its findings directly with the company, Meta removed approximately 150 advertisements still available in its Ad Library and reclassified more than 100 previously removed ads as violations of its child-exploitation policies. A Meta spokesperson stated the company does not tolerate 'nudify apps or any kind of child exploitation, whether real or AI-generated.'
Why is the miscategorisation of these ads significant?
The ads had previously been categorised under Meta's adult-oriented content policies rather than its child-exploitation policies, meaning cases involving AI-generated or AI-manipulated CSAM may be systematically undercounted in Meta's own enforcement data. Critics argue this represents a structural gap in how the platform detects and reports child sexual exploitation.
Who placed the CSAM advertisements on Meta's platforms?
According to TTP, several of the advertisements were placed by Meta's advertising partners based in China, including at least one Chinese state-controlled company. The vast majority of the ads promoted AI applications developed in China that offered 'nudification' capabilities.
What does this investigation mean for AI-generated child exploitation content online?
The investigation highlights a growing threat: generative AI tools are making it easier to fabricate explicit imagery of real children using publicly available photographs, while major platform detection systems have not kept pace. The case is expected to fuel legislative debates in the US and EU over platform liability for AI-generated harmful content.
Nation Press
The Trail

Connected Dots

Tracing the thread behind this story — newest first.

8 Dots
  1. Latest 6 days ago
  2. 1 week ago
  3. 2 weeks ago
  4. 3 weeks ago
  5. 2 months ago
  6. 2 months ago
  7. 2 months ago
  8. 4 months ago
Google Prefer NP
On Google