NHRC Raises Alarm on Children's Data Privacy Amid AI Collaboration Between US Firm and NGO
Synopsis
Key Takeaways
New Delhi, Feb 27 (NationPress) The National Human Rights Commission (NHRC) has taken action by sending notices to the Union Ministry of Electronics and Information Technology, the Department of School Education and Literacy, the Department of Higher Education, and all states and union territories regarding serious concerns about the safeguarding of children’s personal data in a new Artificial Intelligence educational program.
A Bench led by NHRC Member Priyank Kanoongo acknowledged a complaint from the NAMO Foundation, a Section 8 non-profit organization, which raised alarms about the potential privacy risks to children stemming from a partnership between a US-based AI firm, Anthropic, and the NGO Pratham.
The complaint highlights that this collaboration utilizes an AI-driven system called the “Anytime Testing Machine (ATM)” to analyze children’s handwritten answers and academic information.
The complainants expressed concerns that this initiative might subject minors to risks related to the collection, processing, storage, and possible international transfer of their personal data, potentially violating the Digital Personal Data Protection (DPDP) Act, 2023.
Furthermore, the complaint referenced a report titled “Children’s Privacy at Stake? Assessing Data Breach Risks in the Pratham-Anthropic AI Collaboration under India’s DPDP Act”, which claims that insufficient security measures might endanger children’s safety and data integrity.
Requesting intervention, the complainants urged for a thorough investigation into the data protection risks and the establishment of necessary safeguards to protect children.
Based on the allegations, if substantiated, the NHRC indicated that there could be violations of human rights related to the privacy and protection of minors. Consequently, it issued a notice under Section 12 of the Protection of Human Rights Act, 1993.
The apex human rights authority instructed all Chief Secretaries and Union Territory Administrators to investigate the claims and ensure that data gathered by Pratham, Central Square Foundation, or any NGO collaborating with government entities is not misused and complies with the DPDP Act, 2023 or any other applicable Indian legislation.
Additionally, state governments have been directed to reassess any Memoranda of Understanding (MoUs) or partnerships formed with such organizations.
Separate notices have been sent to the Secretaries of the Union Ministry of Electronics and Information Technology, the Department of Higher Education, and the Department of School Education and Literacy, requesting reports on the safeguards surrounding the application of AI systems in education.
The Commission has requested Action Taken Reports (ATRs) from all relevant authorities within a two-week timeframe for review.