Should X Implement Safeguards for Minors Using the AI Chatbot Grok?
Synopsis
Key Takeaways
- KMCC urges X to implement protective measures for minors.
- Concerns over deepfake sexual content are on the rise.
- Compliance with South Korean laws is mandatory for social media platforms.
- X has acknowledged the presence of obscene content generated by Grok.
- Indian government demands a review of Grok's governance frameworks.
Seoul, Jan 14 (NationPress) The media regulatory body of South Korea announced on Wednesday that it has urged the U.S.-based social media platform X to devise protective measures for its minor users against sexual content produced by the artificial intelligence (AI) model Grok.
The Korea Media and Communications Commission (KMCC) stated it has conveyed this request to X's operator amid rising concerns regarding deepfake sexual materials that AI systems can generate, as reported by Yonhap news agency.
"We have requested X's operator to take steps to avert potential illegal activities on Grok and to present strategies for shielding teenagers from harmful content, which may include restricting or managing their access," KMCC said in an official statement.
According to South Korean legislation, operators of social networking platforms, such as X, must appoint a dedicated official responsible for minor protection and submit an annual report, the commission highlighted.
The KMCC emphasized that the request aligns with regulatory guidelines, noting that the creation, distribution, or storage of sexual deepfake content produced without consent is punishable under criminal law.
"We are committed to actively fostering the healthy and secure advancement of emerging technologies," said KMCC Chairperson Kim Jong-cheol in the release.
"Regarding adverse effects and negative implications, we aim to introduce reasonable regulations and update policies to curb the distribution of illegal information, including content related to sexual abuse, while mandating AI service providers to safeguard minors," Kim added.
Meanwhile, X Corp, under Elon Musk's leadership, has acknowledged the existence of inappropriate imagery on its platform, primarily generated by its Grok AI, and has vowed to comply with Indian legal standards by removing such content.
The Indian government has instructed X to perform a thorough evaluation of Grok's technical and governance frameworks to avert the generation of illicit content. It has mandated that Grok enforce stringent user policies, including the suspension and termination of violators, and that all offending content be promptly removed without manipulating evidence.