AI homework tools slash exam scores 20%, study of 26,000 students finds
Synopsis
Key Takeaways
A large-scale study tracking more than 26,000 middle and high school students across a county in central China has found that generative AI tools boost homework scores by 18 per cent but cause exam results to fall by 20 per cent within six months — a 'brain drain' effect that takes two years to fully materialise. The research, conducted by scholars from Stockholm University and the University of Hong Kong, offers one of the most quantified assessments yet of AI's double-edged impact on student learning.
What the study measured
Researchers tracked academic performance from September 2022 to June 2025 — a period of 30 months — monitoring homework grades, completion times, monthly test scores, and high-stakes entrance exam results. By comparing AI users with non-users within the same cohort, the team isolated a consistent pattern: short-term efficiency gains traded against measurable long-term cognitive costs.
Around 80 per cent of the students reported using generative AI for schoolwork. The most popular tools were Doubao, DeepSeek, ChatGLM, Ernie Bot, and Qwen — all products of major Chinese technology firms. Qwen is developed by the cloud computing arm of Alibaba.
The productivity trap
On the surface, AI use delivered clear efficiency gains: homework scores rose by 18 per cent and average homework completion time fell from 64 minutes to 45 minutes. For students and parents, these metrics likely read as unambiguous improvements. But the study's longer timeline tells a starkly different story.
Within six months, monthly exam scores among AI users had dropped by 20 per cent. Over two years, the damage compounded: scores on the zhongkao — China's high school entrance examination — fell by 24 per cent, while results on the gaokao, or National Higher Education Entrance Examination, declined by 18 per cent. Both exams are pivotal determinants of students' academic futures in China.
Why it matters
The findings arrive as generative AI tools spread rapidly through classrooms worldwide, with students increasingly using chatbots to draft essays and solve problem sets. This study is notable for its scale, its longitudinal depth, and its focus on high-stakes outcomes rather than self-reported learning quality. The researchers describe the phenomenon as a 'brain drain' — a gradual erosion of independent problem-solving capacity that only becomes visible over time.
The implications extend beyond China. As AI homework assistants proliferate globally, educators and policymakers face a fundamental question: whether the productivity metrics that make these tools appealing in the short term mask a slower-acting harm to deep learning.
The competitive backdrop
The five AI tools identified in the study — Doubao, DeepSeek, ChatGLM, Ernie Bot, and Qwen — represent the front line of China's consumer AI market, each backed by a major technology conglomerate. Their rapid adoption among students under the age of 18 raises regulatory questions that authorities in Beijing and elsewhere have yet to fully address.
What's next
The study, which has been circulated on the Social Science Research Network and involved researchers affiliated with the Institute of Psychology of the Chinese Academy of Sciences, is expected to intensify debate among education ministries and AI developers over guardrails for student-facing AI products. Whether platform operators will voluntarily introduce friction — such as hints-only modes or usage limits — or whether regulators will mandate them, remains the key question to watch.