Is the Centre Taking Action Against X for AI-Driven Obscenity?
Synopsis
Key Takeaways
- The Ministry of Electronics and Information Technology has taken action against X Corp for failing to manage obscene content.
- X Corp must submit an Action Taken Report within 72 hours.
- Non-compliance could result in severe legal repercussions.
- Grok AI has been identified as a source of misuse for generating offensive content.
- The move emphasizes the need for stricter regulations on AI technologies.
New Delhi, Jan 2 (NationPress) The Ministry of Electronics and Information Technology (MeitY) has taken decisive action against X Corp for its inability to prevent the creation and dissemination of obscene, nude, and indecent content on its platform.
The government has mandated X Corp to submit an Action Taken Report (ATR) within 72 hours, detailing immediate measures for the prevention of hosting, generation, publication, transmission, sharing, or uploading of obscene, nude, and other explicit content arising from the misuse of AI-based services like 'Grok' and other offerings from xAI.
The directive emphasizes that failure to comply will be viewed seriously and may lead to stringent legal actions against the platform, its responsible officers, and users violating the law, without further notice, as stipulated under the IT Act, IT Rules, BNSS, and other relevant legislations.
The ministry has instructed X to carry out an extensive review of Grok's technical and governance frameworks to avert the generation of illegal content.
It stresses that Grok must implement strict user policies, including the suspension and termination of offenders. Immediate removal of all offending content is required, with no alteration of evidence.
The MeitY highlighted that non-compliance could lead to a loss of safe harbor under Section 79 of the IT Act and could trigger penalties under various laws, including the BNS, the Indecent Representation of Women Act, and the Protection of Children from Sexual Offences Act.
In its communication to X, the ministry expressed concern that the regulatory provisions under the Information Technology Act are not sufficiently adhered to, particularly regarding obscene, indecent, vulgar, pornographic, paedophilic, or otherwise illegal content that could violate existing laws.
These acts and omissions are viewed with significant concern, as they infringe upon the dignity, privacy, and safety of women and children, normalizing sexual harassment and exploitation in digital platforms, while undermining the required due diligence framework for intermediaries operating in India.
The letter also notes that it has been particularly observed that the service Grok AI, developed by X and made available on its platform, is being misused by users to create accounts for hosting, generating, publishing, or sharing obscene images or videos of women in derogatory or vulgar manners, aiming to degrade them indecently.
Importantly, this misuse is not confined to creating fake accounts but targets women who share or publish their images or videos using prompts, image manipulation, and synthetic outputs. Such behavior indicates a serious failure of platform-level safeguards and enforcement mechanisms, amounting to a gross misuse of artificial intelligence technologies in violation of applicable laws, the letter states.
A copy of the notice has also been disseminated to key ministries, commissions, and state authorities, signaling a coordinated effort to address the obscenity propagated through AI.