Posted on — 1 Comment

AI and Independent Learning: What a 1,222-Person Study Found

University student studying independently in a library, illustrating the relationship between AI assistance and learning without support.

Research · Education · Practice

An AI assistant can help someone solve a problem correctly in seconds. But does that mean the person has learned how to solve it? A set of three randomized experiments involving 1,222 US-based adults suggests that the answer depends on what the AI does for the learner—and what happens when the help disappears.

The paper, “AI Assistance Reduces Persistence and Hurts Independent Performance” by Grace Liu, Brian Christian, Tsvetomira Dumbalska, Michiel A. Bakker and Rachit Dubey, was first submitted to arXiv on 6 April 2026 and last revised on 3 October 2026. It is a research preprint, so its findings should be treated as important but not yet as a settled verdict about AI-assisted education.

The central distinction: performance is not the same as learning

When a learner uses AI, the immediate task score can improve because the system supplies an explanation, a hint or even the answer. That score alone cannot tell us whether the learner has built knowledge they can retrieve independently later. To test this distinction, the researchers measured performance both while AI was available and after it was removed.

The paper reports three randomized experiments: two using fraction problems and one using reading-comprehension questions. In total, 1,222 people were recruited through the online research platform Prolific. Participants were adults in the United States—not a sample of schoolchildren—and each task session lasted roughly 10–15 minutes.

What the experiments found

In the first experiment, participants worked on fraction problems with or without an AI assistant. The AI condition used GPT-5 in a sidebar, with the system pre-prompted with each problem and its solution so that participants could request direct answers. After the practice phase, the assistant was removed and participants attempted three further problems independently.

  • While AI was available: participants with AI solved more problems correctly and skipped fewer questions.
  • After AI was removed: the analysed AI group solved a lower share of the final fraction problems than the control group—57% versus 73%. The difference was statistically significant, with a reported Cohen’s d of −0.42.
  • Persistence also mattered: in that first experiment, the AI group skipped more of the final questions—20% versus 11%. This difference was statistically significant, though the effect was smaller than the performance difference.

The researchers then repeated the fraction experiment with methodological changes intended to address a potential confound in the first experiment. The independent solve rate was again lower in the AI condition: 71% versus 77%, a smaller but statistically significant difference (Cohen’s d = −0.19). The overall difference in skipping questions was not statistically significant in this second experiment.

A third experiment tested reading comprehension. After the AI assistant was removed, the analysed AI group answered fewer of the final questions correctly than the control group—76% versus 89%—and skipped more questions. Both differences were statistically significant in this experiment.

These are not proof that AI permanently damages skills. They are evidence that, in these short experimental tasks, access to a system that readily supplies answers was followed by weaker performance on a small set of unaided questions.

Why the type of AI help may matter

One of the paper’s most educationally relevant analyses examined how participants used the assistant. In the second fraction experiment, 61% of AI-condition participants said they mainly used it to obtain direct answers, 27% said they mainly sought hints or clarifications, and 12% reported not using it. The authors found that poorer independent performance and some of the persistence differences were concentrated among those who sought direct solutions.

This comparison needs careful interpretation: participants were not randomly assigned to “answer-seeking” or “hint-seeking” styles, so this part of the analysis cannot establish that one prompt style caused the difference. People who chose different styles may also have differed in other ways. Nevertheless, it offers a useful hypothesis for educators to test: AI that completes the cognitive work may have different consequences from AI that prompts learners to do the work themselves.

How strong is the evidence—and what are its limits?

The study has several strengths. It uses randomized comparisons, includes a replication of the fraction task with improved controls, and tests a second domain—reading comprehension. The findings therefore go beyond a survey asking people whether they feel more or less capable after using AI.

But the boundaries of the evidence are just as important:

  • Short exposure and short follow-up: the experiments measured performance immediately after brief AI-assisted sessions. They do not establish whether any difference persists over weeks or months.
  • Adult online participants: the findings cannot be transferred directly to children, teenagers, classroom teaching or every educational subject.
  • A specific form of assistance: the AI was configured to make direct answers readily available. This is not a test of every AI tutor, guided practice system or classroom implementation.
  • Small final test sets: the unaided outcome was measured using only a few questions after the assistance phase, so the size and generality of the effect require further study.
  • Not every result was consistent: the overall persistence difference was not statistically significant in the second fraction experiment, even though the performance difference was.

The right conclusion is therefore narrower than “AI makes students less intelligent.” The study suggests a risk: when a learner repeatedly receives solutions instead of practising the reasoning, immediate success may not translate into independent performance once the support is gone. A language-learning example is explored in our guide to AI vocabulary learning and independent word use.

How this fits with the wider research

The result is consistent with a more directly educational field experiment published in Proceedings of the National Academy of Sciences in 2025. In a study involving nearly 1,000 high-school mathematics students, Bastani and colleagues compared an unrestricted GPT-4 interface with a tutor designed with learning safeguards. Access to AI improved performance during practice, but students using the unrestricted version performed worse on a subsequent unaided test than students who had not received that assistance. The scaffolded tutor produced a different pattern, underscoring that the design of the help matters. Read the PNAS study.

The OECD’s Digital Education Outlook 2026 makes a related point: general-purpose generative AI can improve task performance without necessarily producing learning gains when it is used without pedagogical guidance. Taken together, these sources do not show that AI is inherently harmful. They point to a more practical question: is the tool designed to finish the task, or to help the learner become able to do it?

For a broader overview of cognitive offloading and critical thinking, see Prowad’s earlier analysis of AI and critical thinking. For classroom routines that protect retrieval and independent recall, see Prowad’s guide to AI and student memory. For the product-design side of this question, read our analysis of AI tutors and study agents. This article focuses more narrowly on the evidence from randomized tests of what happens after assistance is removed.

What educators can do now

The evidence supports cautious design principles rather than a blanket ban on AI. Teachers and learning designers can test the following approaches:

  1. Ask for an attempt before revealing the answer. Have learners write down a first step, prediction or explanation before asking AI for help.
  2. Prefer graduated hints to complete solutions. Start with a question or small clue, and reveal more only when the learner is genuinely stuck.
  3. Fade the assistance. After a worked example, give learners a similar problem to solve without AI. This checks whether they can transfer the method independently.
  4. Make reasoning visible. Ask learners to explain why a step works, identify a possible error, or compare two solution paths—not simply submit the final answer.
  5. Assess learning without the tool as well as with it. Use short retrieval questions, oral explanations, or a brief unaided task alongside AI-assisted work. The goal is to measure both supported performance and independent competence.
  6. Evaluate the intervention, not just satisfaction. If a school introduces an AI tutor, compare learning outcomes and retention against an appropriate alternative, rather than relying only on usage, speed or student enthusiasm.

These are design implications informed by the evidence, not interventions all directly tested by the 1,222-person study. Their effectiveness should be evaluated in the relevant classroom, subject and age group.

The takeaway: design AI around the learner’s next independent step

The most useful question is not whether AI can produce a correct answer. It is whether the interaction leaves the learner better prepared to reason when the answer is no longer available. The new experiments provide a warning about immediate-answer assistance, while the wider evidence suggests that guided, pedagogically purposeful use may lead to different outcomes.

For schools and universities, this means judging educational AI not only by what students accomplish with it, but also by what they can explain, remember and do independently afterwards.

Sources and further reading

  • Liu, G., Christian, B., Dumbalska, T., Bakker, M. A., & Dubey, R. (2026). AI Assistance Reduces Persistence and Hurts Independent Performance. arXiv preprint, submitted 6 April 2026; version 5 revised 3 October 2026. https://arxiv.org/abs/2604.04721
  • Bastani, H., et al. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26), e2422633122. https://doi.org/10.1073/pnas.2422633122
  • OECD (2026). OECD Digital Education Outlook 2026: Exploring Effective Uses of Generative AI in Education. https://doi.org/10.1787/062a7394-en

Editorial note: The lead study is an arXiv preprint. Its latest version is dated 3 October 2026; the article does not treat it as a newly published journal paper or as definitive evidence of long-term effects.

Posted on — 1 Comment

Who Should Govern AI at Universities? Faculty Rights, Human Oversight, and Academic Work

University faculty members discussing AI governance and academic policy at a meeting

As of 11 October 2026, negotiations at several universities show that the debate over artificial intelligence in higher education is expanding beyond classroom use. The emerging question is who gets to shape the rules when AI affects academic work, employment decisions, privacy, and institutional accountability.

This is not evidence of a single global consensus. The cases discussed here are specific, ongoing negotiations in Australia and Canada, and the parties involved disagree about both the substance of AI safeguards and where those safeguards should be written.

Why AI governance is becoming a workplace issue

Universities increasingly have to make decisions about where AI tools may be used, what information may be entered into them, whether AI contributes to decisions about employees, and how human responsibility is preserved. These questions overlap with teaching and research, but they also concern employment conditions and institutional governance.

Three recent cases illustrate different parts of this debate: negotiations at the University of Melbourne, bargaining between York University and CUPE 3903 in Canada, and the University of Sydney’s stated preference for adaptable policies and frameworks.

1. University of Melbourne: a proposed AI clause, not a settled agreement

In its 8 October bargaining update, the National Tertiary Education Union (NTEU) reported that it had tabled a principles-based AI clause and that the University of Melbourne was engaging with it. The union said it was not seeking to ban AI; it wanted basic protections as AI was already being used. The university acknowledged that AI needed to be addressed in some form, while continuing to develop its position.

The discussion became more specific around disclosure. According to the NTEU’s account, the university was concerned that the draft could require disclosure of AI use in too many decisions. The union clarified that its intended focus was human-resources decisions affecting staff across the employment cycle, including recruitment, major workplace change, promotion, discipline, and performance. The parties were still working on wording on 8 October.

What this means: the question is not simply whether AI is allowed. It is whether staff should be told when AI materially contributes to consequential employment decisions, and how a disclosure rule can be clear without becoming unworkably broad. Because the update is from the union, it should be read as the union’s account of negotiations—not as a jointly agreed summary or a final contract.

2. York University: a joint working group with a recommendatory role

At York University in Canada, CUPE 3903—which represents teaching assistants, contract faculty, graduate and research assistants, and other workers—reported on 4 October that AI had been a major subject in collective bargaining. The union’s bargaining team report says the employer proposed replacing an ad hoc AI committee with a Joint Working Group on the Use of AI in the Workplace.

According to CUPE 3903, the group’s role would be to make recommendations, not implement changes directly, and its work would be deferred until well into the next collective agreement. The union’s report argues that meaningful safeguards should address consent, accountability, information security, academic freedom, and the role of human labour in teaching and research. Those are the union’s stated priorities; they should not be mistaken for agreed university policy.

York’s own labour-relations updates confirm that bargaining has been underway and that the parties have been pursuing conciliation. The university’s public account provides useful context, while the union report offers detail about its interpretation of the AI discussions. Reading both helps distinguish the existence of a negotiation from either side’s preferred outcome.

What this means: creating a working group can bring expertise and consultation into the process, but its practical influence depends on its mandate, timing, access to information, and what decision-makers must do with its recommendations. A committee is not equivalent to a binding safeguard.

3. University of Sydney: policies may be more adaptable than a three-year agreement

The University of Sydney has articulated a different emphasis. In its 2 September statement on industrial action, the university said it supported a human-centred approach to ethical AI and argued that AI should be governed through policies and frameworks that can be updated as technology changes, rather than placing all such rules in an enterprise agreement covering a three-year term.

This is the university’s stated position, not proof that policy-based governance is always more effective. Policies can be revised more readily, which may help institutions respond to fast-changing tools. But their practical strength depends on transparency, consultation, enforcement, and whether staff and students have meaningful ways to challenge decisions. Conversely, putting a principle into a collective agreement may give it a more formal status, but drafting broad language can be difficult and can create questions about scope and implementation.

Policy or collective agreement? The real issue is enforceability

These cases should not be reduced to a simple contest between innovation and resistance. They reveal a governance design problem: how can institutions preserve room to adapt while ensuring that AI use is transparent, proportionate, and accountable?

  • Define high-impact uses. Institutions should distinguish low-stakes support—such as brainstorming—from AI that materially informs hiring, promotion, discipline, performance evaluation, grading, or other consequential decisions.
  • Require meaningful human responsibility. Where an AI system informs a consequential decision, a named human decision-maker should be able to scrutinise its contribution, explain the decision, and correct errors. Human oversight should not be a rubber stamp.
  • Make disclosure specific. Clear rules should identify when AI use must be disclosed, to whom, and what information is needed. Requiring disclosure for every minor use can create noise; providing no disclosure for high-impact use can undermine trust.
  • Protect data and intellectual work. Rules should address confidential student and staff information, research materials, intellectual property, and the limits of uploading sensitive content to third-party systems.
  • Give people a route to challenge outcomes. Students and employees need an accessible process to question an AI-assisted decision and request meaningful human review.
  • Review rules on a schedule. Because systems and practices change, policies and agreements should include consultation, monitoring, and review mechanisms rather than assuming that a single document will answer every future question.

These are recommendations for institutional design, not a claim that any one university has already adopted all of them.

What educators and university leaders should watch next

The important evidence will be the text and implementation of any final agreements or policies—not headlines suggesting that a university has “settled” the AI question. Readers should look for precise definitions of covered AI uses, the scope of disclosure, the role of human decision-makers, data-protection responsibilities, consultation requirements, and review or appeal mechanisms.

For education leaders, the lesson is practical: AI governance should not be treated only as a question of student rules or classroom integrity. It also concerns the conditions under which teaching, research, and institutional decisions are carried out. For faculty and students, the key test is whether the rules create understandable responsibilities and meaningful avenues for accountability.

Conclusion

The current discussions at Melbourne and York, alongside Sydney’s publicly stated approach, show different institutional choices still being debated. They do not establish a settled international trend, and the negotiations may change. They do, however, offer a useful way to examine the central governance question: who sets the limits, who is informed when AI is used, and who remains accountable for the outcome?

Universities do not need to choose between adaptability and safeguards as if only one were possible. The stronger approach is to make the rules transparent, define high-impact uses clearly, preserve meaningful human responsibility, and create processes that can be reviewed as the technology and its educational consequences evolve.

Sources and further reading

Editorial note: This article reflects publicly available information reviewed as of 11 October 2026. The Melbourne and York bargaining accounts include statements from the union parties; proposals and negotiating positions are not final agreements. Readers should consult later official updates for changes after this date.

Posted on — 2 Comments

Beyond Prompting: How Can Schools Measure Real AI Literacy?

Student working at a laptop, representing critical evaluation and AI literacy in education.

As generative AI becomes part of everyday study, a practical question is becoming harder for schools and universities to avoid: how can educators tell whether students are genuinely AI-literate? A student may feel confident using ChatGPT, produce a polished assignment with it, and still struggle to verify a claim, recognize a fabricated reference, decide when AI assistance is inappropriate, or explain the reasoning behind a submitted answer.

This distinction matters because AI literacy is not simply familiarity with a chatbot or the ability to write an effective prompt. It includes understanding what a system can and cannot do, judging the quality of its output, making responsible decisions about its use, and retaining responsibility for learning. Recent research on performance-based testing and assessment-specific AI literacy suggests that education needs more precise ways to measure these capabilities.

This article reviews evidence on AI literacy assessment, considers what current measurement tools can and cannot tell us, and proposes practical principles for educators. It is an evidence-based synthesis of published research, not a report of a new experiment.

The measurement problem: confidence is not competence

Many AI literacy questionnaires ask learners to rate their own knowledge or confidence. Self-reports are useful: they can reveal attitudes, anxiety, perceived ability, and whether students believe they need support. But they do not directly demonstrate that a learner can perform a task successfully.

A systematic review in npj Science of Learning found that, although available AI literacy scales generally showed promising structural validity and internal consistency, relatively few had been tested for content validity, construct validity, responsiveness, or cross-cultural validity. The review also identified far fewer performance-based measures than self-report instruments. This points to a measurement gap, not proof that self-report tools are useless.

A later systematic review in Computers and Education: Artificial Intelligence examined 31 empirical studies using six AI literacy instruments across 14 countries. It found that AI literacy was associated with factors such as self-efficacy, attitudes, motivation, and digital competencies. It also reported differences between relationships measured with self-report scales and those measured with a performance-based test, raising the possibility that self-perceptions can distort how literacy is estimated.

The educational implication is straightforward: a survey can tell a teacher what students think they can do, but a performance task can provide evidence of what they actually do in a defined situation. Strong assessment systems should use each method for the questions it can answer. This distinction builds on the broader question explored in our guide to what AI literacy actually means and complements our analysis of the limits of AI detectors: neither confidence nor a detector score alone can establish what a student understands.

What performance-based assessment adds

One important contribution is the Generative AI Literacy Assessment Test (GLAT), reported in Computers and Education: Artificial Intelligence in December 2025. The researchers developed a 20-item multiple-choice test and evaluated it with 355 higher education students. They reported acceptable reliability and structural validity; GLAT scores also predicted performance on GenAI-supported tasks better than self-ratings such as perceived ChatGPT proficiency.

The finding supports a shift from asking only “How confident are you?” to also asking students to demonstrate knowledge and judgment. However, the evidence should be interpreted within its limits. The study involved a particular instrument and a sample of higher education students. A 20-item test cannot capture every real-world AI skill, and further validation is needed across age groups, languages, disciplines, and changing AI tools.

Performance-based assessment does not have to mean a long, standardized examination. A teacher might ask students to compare two AI-generated explanations, identify unsupported claims, verify a reference, explain why one answer is stronger, or revise an output while documenting what they changed and why. Such tasks make the underlying reasoning more visible than a confidence rating alone.

A second development: assessing AI literacy within academic assessment

A study published in Frontiers in Education on 10 September 2026 developed and validated the Generative AI Assessment Literacy Scale (GAA-LS) for higher education students. Rather than measuring general AI knowledge, it focuses on decisions students face when AI is used in assessed work.

The researchers began with an item pool and used expert review and pilot testing before analysing data from two student samples: 486 students in the first study and 798 in the second. The final 18-item instrument supported five dimensions:

  • Assessment criteria awareness: understanding what the assignment requires and how work will be judged.
  • AI-task appropriateness: deciding when AI assistance is suitable or unsuitable for a particular task.
  • Verification and evidence checking: checking claims, references, and reasoning instead of accepting outputs at face value.
  • Ethical attribution and academic integrity: following disclosure rules and taking responsibility for submitted work.
  • Feedback uptake and revision: using AI-supported feedback critically to improve work rather than accepting it uncritically.

The authors reported satisfactory to strong internal consistency and evidence supporting the scale’s validity, including measurement invariance across gender, discipline, and AI-use-frequency groups in their samples. Scores were positively associated with feedback engagement and intention to maintain academic integrity.

These results are promising, but the distinction between association and causation is essential. The study used a cross-sectional scale-development design; it does not show that raising a student’s score will necessarily improve academic integrity or learning outcomes. The instrument is also focused on higher education and needs further testing across languages, cultures, institutions, and observable behaviours. Because it uses self-report items, it complements rather than replaces performance-based assessment.

What should schools actually measure?

Taken together, the research suggests that AI literacy assessment should cover more than prompt-writing. A practical framework for classroom use can focus on five observable capabilities.

1. Understand the tool and its limits

Can the student explain, in appropriate terms, that generative AI may produce plausible but inaccurate answers? Can they identify situations where a model’s output needs independent checking? The goal is not to require every learner to understand the technical details of a large language model, but to develop an accurate mental model of its strengths and limitations.

2. Evaluate evidence, not just fluency

Give students an AI-generated response containing a mix of accurate statements, unsupported claims, and a questionable reference. Ask them to verify selected claims using credible sources and explain which evidence changed their judgment. A fluent answer should not receive full credit simply because it sounds authoritative.

3. Make appropriate decisions about delegation

Students should be able to distinguish between using AI to brainstorm, request feedback, or practise a skill and handing over the central intellectual work that an assignment is intended to assess. The boundary depends on the learning objective and the teacher’s rules. Assessment instructions should therefore specify permitted, restricted, and prohibited uses instead of relying on vague expectations.

4. Disclose use and retain responsibility

Where disclosure is required, students should be able to describe how AI contributed to their work. They should also be able to defend the reasoning, sources, and final decisions in their submission. Disclosure alone does not prove learning, but it can make the process more transparent and support fairer assessment.

5. Use feedback to improve, not merely to finish

Ask learners to compare AI feedback with a rubric or teacher feedback, decide which suggestions to accept, and explain why they rejected or adapted others. This makes evaluative judgment visible and reinforces the idea that AI-generated feedback is a resource to assess—not an instruction that must automatically be followed.

A practical assessment design for teachers

A balanced approach can combine three kinds of evidence rather than relying on one score:

  • Knowledge check: a short quiz on AI capabilities, limitations, privacy, bias, and responsible use.
  • Authentic performance task: students critique an AI output, verify evidence, improve the answer, and explain their decisions.
  • Process reflection: students record what they delegated, what they checked, what they changed, and what they learned.

A simple rubric might assess the accuracy of verification, the quality of reasoning, the appropriateness of AI use, transparency about assistance, and the student’s ability to explain the final work. The rubric should be shared before the task and aligned with the actual learning objective. It should not reward elaborate prompting if prompting is not the skill the course intends to teach.

This approach also helps avoid a false choice between banning AI and allowing unrestricted use. Different assignments serve different purposes. If the objective is unaided recall or foundational practice, AI may need to be restricted. If the objective is evaluating sources, revising arguments, or using tools responsibly, AI can be included explicitly in the assessment design.

Equity and validity: the cautions that matter

Assessment design must account for unequal access to paid tools, differences in language proficiency, disability accommodations, and students’ prior experience with technology. A test that inadvertently measures subscription access, English fluency, or familiarity with one interface may misrepresent the intended competence.

Tools also change quickly. A test tied to a particular product interface may become obsolete after an update. Durable assessment should focus on transferable judgment: checking evidence, recognizing uncertainty, selecting appropriate support, protecting private information, and explaining decisions.

Finally, no single score should be treated as a complete measure of a student’s AI literacy. Self-report questionnaires, knowledge tests, performance tasks, process evidence, and teacher observation each capture different aspects. Their combination is more informative than any one instrument used in isolation.

What educators and institutions should do next

For teachers, the immediate step is to define the capability a task is meant to assess, then design a short activity that makes that capability observable. For institutions, the priority is to provide consistent rules for acceptable AI use, teach students how to verify outputs, and evaluate assessment methods for fairness and validity.

For researchers, the agenda includes testing instruments across age groups and languages, comparing self-reports with actual performance, and studying whether assessment results predict learning over time. New scales should be evaluated not only for reliability but also for whether they measure the intended construct and work fairly across different student populations.

UNESCO’s guidance on generative AI in education and research provides a broader human-centred framework, emphasizing privacy, age-appropriate use, validation, and the development of educators’ and learners’ competencies. These principles support an approach in which assessment is designed around learning and responsibility rather than around the presence or absence of a particular tool.

Key takeaways

  • AI literacy is broader than prompt-writing or familiarity with a chatbot; it includes evaluation, verification, appropriate use, ethics, and responsibility.
  • Self-report questionnaires can reveal students’ perceptions, but they do not by themselves demonstrate practical competence.
  • The GLAT study, involving 355 higher education students, found that a performance-based test predicted GenAI-supported task performance better than self-ratings in that study.
  • A September 2026 study developed an 18-item scale focused on AI literacy in assessment contexts, covering criteria, appropriate use, verification, attribution, and feedback-based revision.
  • Both instruments have limits and need further validation across contexts; neither should be treated as a universal measure of every AI-related capability.
  • Teachers can begin with authentic tasks that require students to verify, justify, revise, and explain their use of AI.

Editorial conclusion: The central challenge for education is no longer only teaching students how to use AI. It is establishing credible evidence that they can use it thoughtfully, verify what it produces, and remain responsible for their learning. Assessment should make those capabilities visible. Confidence and polished output may be useful signals, but neither is a substitute for demonstrated judgment.

Sources and further reading

  • Jin, Y., Martinez-Maldonado, R., Gašević, D., & Yan, L. (2025). GLAT: The generative AI literacy assessment test. Computers and Education: Artificial Intelligence, 9, 100436. https://doi.org/10.1016/j.caeai.2025.100436
  • Nie, J., Zhang, Z., Lu, X., Zhang, Y., & Zhang, M. (2026). Development and validation of the generative AI assessment literacy scale for higher education students: psychometric evidence and associations with feedback engagement and academic integrity. Frontiers in Education, 11, 1934632. https://doi.org/10.3389/feduc.2026.1934632
  • How AI literacy correlates with affective, behavioral, cognitive and contextual variables: A systematic review. (2025). Computers and Education: Artificial Intelligence, 9, 100493. https://doi.org/10.1016/j.caeai.2025.100493
  • Lintner, T. (2024). A systematic review of AI literacy scales. npj Science of Learning. https://doi.org/10.1038/s41539-024-00264-4
  • UNESCO. (2023). Guidance for generative AI in education and research. UNESCO guidance.

Editorial note: This article synthesizes published research available as of 10 October 2026. Findings from higher education samples should not be assumed to generalize automatically to school-age learners or every educational setting.

Posted on — Leave a comment

AI Safety in Education: Can Teen AI Chatbots Be Trusted?

Student studying at a desk with a laptop

On October 7, 2026, a new independent assessment raised a difficult question for schools and families: can a chatbot designed to help teenagers learn also be trusted to protect them when conversations become risky? The Youth AI Safety Institute at Common Sense Media published an evaluation of OpenAI’s ChatGPT for Teens, reporting that some advertised safeguards did not work reliably in its tests. OpenAI disputed aspects of the testing. The disagreement matters because educational AI is moving beyond occasional homework help toward tools that may become part of students’ daily routines.

The issue is not whether AI can be useful for learning. It is whether the safety claims surrounding products used by minors are supported by evidence—and whether schools, parents, and policymakers have enough information to make informed decisions.

What changed: AI companies are designing for teenage learners

OpenAI introduced ChatGPT for Teens on August 18, 2026. The company describes it as an experience with age-appropriate protections and learning-oriented features, including Study Mode, step-by-step guidance, quizzes, reminders, and optional parental controls. In an October 7 update, it also announced additional learning and college-planning features for teenagers.

The educational rationale is understandable. A conversational system can explain a concept in different ways, offer practice questions, and help a student work through a problem when a teacher or family member is unavailable. These capabilities may widen access to support. But a product used by adolescents is not simply a tutoring tool: it is also a conversational environment that may encounter disclosures about distress, health, relationships, or personal safety.

That combination makes the reliability of safeguards a central educational question, rather than a secondary technical detail.

What the independent assessment found—and what it did not prove

In its October 7 risk assessment, Common Sense Media’s Youth AI Safety Institute said it tested more than 4,000 prompts before and after the teen experience was introduced. The organization reported that some protections worked, including refusals of explicit sexual role-play, while other measures were less reliable. Its concerns included missed crisis referrals, parental alerts that did not consistently trigger in its tests, the ease of moving from Study Mode to direct answers, and responses that could make the chatbot seem more person-like than intended.

The Institute rated the product an “Unacceptable Risk” for children and teenagers and recommended restricting access until the problems were addressed. That rating is the Institute’s conclusion, not a universal scientific consensus. The assessment is a structured product evaluation, not a randomized study of students’ learning outcomes or a peer-reviewed clinical trial. Its results identify concrete failure modes worth investigating, but they do not by themselves establish how often those failures occur across all users, settings, versions, or real-world conversations.

OpenAI has said the testing does not accurately represent how its safeguards work in practice. Reporting by the Associated Press also notes that the organization conducting the assessment receives funding from industry, including technology companies it evaluates. That funding relationship is relevant context for readers, but it does not automatically invalidate the results; the appropriate response is to examine the methods, disclose limitations, and seek independent replication.

The most defensible conclusion is therefore narrower than either “the chatbot is safe” or “the chatbot is unsafe in every circumstance”: the assessment raises credible questions about whether particular safeguards work as advertised, and those questions require transparent, repeatable testing.

Why this matters for learning—not only for online safety

1. Safety is part of educational quality. A learning tool should be judged not only by how clearly it explains algebra or summarizes a text, but also by how it responds when a student is vulnerable, confused, or seeking help beyond its competence. A failure in those moments can undermine trust in the entire learning environment.

2. Study support and academic shortcutting can coexist. OpenAI presents Study Mode as a way to encourage hints, guided reasoning, and knowledge checks rather than simply supplying answers. The Institute reported that some tested routes still allowed students to obtain direct answers. This does not show that guided learning is ineffective; it shows why claims about how a feature behaves should be tested in realistic conditions. Teachers should continue to design tasks that require explanation, reflection, and evidence of a student’s own reasoning.

3. Parental controls need clear limits. A setting that encourages Study Mode is not necessarily a hard restriction, and a safety notification is not a guarantee that every concerning conversation will be detected. Families and schools need plain-language descriptions of what controls do, what they do not do, what data is shared, and when a human must intervene.

4. Human relationships remain essential. Conversational AI can sound supportive, but it is not a teacher, counsellor, parent, or emergency service. Systems should make that distinction clear and should direct users toward appropriate real-world help when necessary. Educators should avoid positioning a chatbot as a substitute for trusted adults or professional support.

A useful framework already exists

UNESCO’s Guidance for Generative AI in Education and Research argues for a human-centred approach, including data privacy, age-appropriate use, validation of systems, and the development of educators’ and learners’ AI competencies. Published in 2023 and updated online in 2026, the guidance predates this particular product dispute, but its core principle is directly relevant: educational institutions should not assume that a widely available AI tool is pedagogically or ethically suitable without evaluating it.

For schools, this suggests a practical procurement and use checklist. Before recommending an AI tool to minors, ask:

  • Has its safety performance been evaluated independently, using transparent methods and age-appropriate scenarios?
  • Are the product’s age rules, privacy practices, parental controls, and escalation procedures explained clearly?
  • Can teachers distinguish a learning-support feature from a control that actually prevents certain actions?
  • Does the tool encourage students to reason, verify, and reflect—or does it routinely complete the task for them?
  • Is there a clear human support pathway for sensitive or high-risk situations, and a process for reporting failures?
  • Will the school review the tool again after updates, rather than treating a single assessment as permanent proof of safety?

What evidence should come next?

The next step should not be to settle the debate through competing headlines. AI companies should publish measurable, age-specific safety results and explain how tests translate into product changes. Independent evaluators should publish methods, limitations, and reproducible findings. Researchers should examine not only whether a system refuses dangerous requests, but also whether it recognizes when a student needs human support, whether controls behave as users understand them to behave, and how repeated use affects learning and help-seeking over time.

Schools, meanwhile, can take proportionate precautions without abandoning educational experimentation: use approved tools with clear policies, teach students to question AI outputs, avoid sharing sensitive personal information, keep teachers involved in assessment, and never treat a chatbot as the sole support for a student in crisis.

Key takeaways

  • AI tutoring features may expand access to individualized explanations and practice, but usefulness does not automatically establish safety.
  • A Common Sense Media evaluation published on October 7, 2026, reported weaknesses in some ChatGPT for Teens safeguards; OpenAI disputed aspects of the testing.
  • The evaluation is important evidence about possible failure modes, but it is not a peer-reviewed study of student outcomes or proof that every interaction is unsafe.
  • Schools should assess privacy, age-appropriateness, crisis pathways, parental controls, and learning design—not just product features.
  • The most credible path forward is transparent company reporting, independent replication, and continued human responsibility for students’ wellbeing and learning.

Editorial conclusion: The emerging issue is not whether teenagers will encounter AI, but whether the systems marketed to support their learning can demonstrate that their protections work under realistic conditions. For education, responsible adoption requires evidence, clear limits, and human oversight—not confidence based on product claims alone.

Sources and further reading

Posted on — Leave a comment

Is Prompt Engineering Still a Skill Worth Learning?

In March 2024, IEEE Spectrum ran a headline that still gets cited today: ‘AI Prompt Engineering Is Dead.’ It was based on real research, not speculation. VMware and Intel Labs researchers systematically tested hand-crafted prompts against automatically generated ones and found the automated prompts won. Two years later, the debate that headline started is still unresolved, and the honest answer is more useful than either side of it.

The research behind the original claim

The IEEE Spectrum piece, by Dina Genkina, reported on work by Rick Battle and Teja Gollapudi testing prompt engineering strategies on grade-school math problems. Their systematic finding: prompts generated automatically by another AI model consistently outperformed prompts carefully hand-crafted by humans, including some of the specific wording tricks prompt-engineering guides recommended at the time. That is a real, testable result, not an opinion, and it undercut one specific claim: that hand-tuned wording is where the skill’s value lives.

What replaced it in industry conversation: context engineering

Through 2025, a new term gained traction among AI practitioners, popularized in part by researcher Andrej Karpathy: context engineering, the practice of deciding what information, documents, examples, and tool access a model has available, rather than focusing narrowly on how a single instruction is phrased. Gartner reportedly advised enterprise AI leaders to shift investment accordingly, and Shopify CEO Tobi Lutke publicly said he preferred the term context engineering to describe what skilled AI practitioners actually do day to day. The shift in terminology reflects a shift in where practitioners say the leverage is: not the clever phrase, but what the model can see and use.

A second, separate technical finding worth knowing

Chroma Research’s Context Rot study adds a distinct finding: model performance measurably degrades as input length grows, even well within a model’s advertised context window. This matters for the same reason the VMware finding does. It suggests skill is shifting away from wordsmithing a single prompt and toward managing what and how much you feed a model at once, a different and more structural kind of judgment call.

The debate is real, not settled

It would be inaccurate to present this as resolved. Microsoft’s 31,000-person, 31-country workforce survey reportedly ranked Prompt Engineer near the bottom of new roles companies planned to add over the next 12 to 18 months, which suggests the narrow version of the skill has limited durable demand as a job title. But public commentary continues in both directions: Forbes contributor Bernard Marr argued in January 2026 that prompt engineering is no longer the most valuable skill, while fellow Forbes contributor Dan Fitzpatrick published a direct rebuttal in June 2026 titled Prompt Engineering Is Not Dead. Sam Altman also predicted back in 2022 that prompt engineering would not still be a discipline in five years, a prediction whose timeline is now close to being tested. We present this spread deliberately: the technical evidence points one direction, informed opinion remains split.

What this means for teaching and training: our judgment

This section is our interpretation, not a settled fact. The narrow version of prompt engineering, memorizing specific magic phrases or formatting tricks, looks weaker as something to teach as a standalone skill; the VMware research and the Microsoft survey both point that way. What still looks durable, and worth building into any AI literacy curriculum, is the broader judgment underneath it: understanding what information a model needs to do a task well, recognizing when an answer is weak because the model lacked context rather than because the task is impossible, and iterating deliberately instead of hoping a clever wording will fix an underspecified request. That is closer to what context engineering describes, and it connects to the evaluation habits in our framework for evaluating an AI tool and to what AI literacy actually means as a durable competency rather than a tool-specific skill.

Key takeaways

  • Real 2024 research from VMware and Intel Labs found automatically generated prompts outperformed hand-crafted ones, undercutting the narrow, wording-focused version of prompt engineering.
  • Industry conversation has shifted toward context engineering: managing what information and tools a model can access, not just how an instruction is phrased.
  • Chroma’s Context Rot study separately found performance degrades with input length even inside the advertised context window.
  • Public commentary remains split, even as a Microsoft workforce survey reportedly found limited demand for prompt engineer as a job title.
  • Our judgment: teach the underlying skill of judging what a model needs to succeed, not memorized wording tricks.

Sources: Genkina, D., IEEE Spectrum (March 2024), reporting on Battle, R. and Gollapudi, T. (VMware/Intel Labs); Chroma Research, Context Rot study; Microsoft workforce survey; Forbes (Bernard Marr, January 2026; Dan Fitzpatrick, June 2026). Attributions to industry figures reflect public statements as reported and should be verified against the original sources.

Posted on — 1 Comment

AI Tutors for Students: What the New Study Agents Mean for Learning

Abstract illustration in warm sand representing stacked study cards

The latest wave of educational AI is moving beyond the chatbot. OpenAI has just expanded ChatGPT for Teens with college-planning support, flashcards and quizzes, while Microsoft is positioning its Study and Learn Agent around guided practice rather than simply supplying answers. Anthropic is also building education-specific capabilities for teachers. The direction is clear: major AI companies are trying to turn general-purpose models into AI tutors for students.

But the important educational question is not whether these systems can explain a concept, generate a quiz or answer a student’s question. They can. The harder question is whether giving students an AI tutor actually produces more learning.

Recent evidence gives a much more cautious answer than the current technology race might suggest.

The trend: from AI answers to AI study agents

On 7 October 2026, OpenAI reported early usage data from ChatGPT for Teens and announced new learning-oriented features. Students can turn notes into flashcards and interactive quizzes, while a forthcoming College Planner is designed to help high-school students organize applications, deadlines and financial-aid tasks. OpenAI also says that, among teens using its learning tools, common requests include developing ideas, receiving feedback and checking evidence. OpenAI’s announcement.

Microsoft is pursuing a similar direction with its Study and Learn Agent. The company describes it as a learning-focused system that asks students to think before it tells them, using scaffolding, quizzes, flashcards and other activities. It is explicitly designed around the principle that the learner does the thinking. Microsoft’s documentation.

This is a significant shift in product design. The educational AI market is moving from the model of “ask the chatbot” toward “work with an AI tutor”: a system intended to question, prompt, scaffold, diagnose misconceptions and provide practice.

That shift is educationally important because the quality of an AI interaction depends not only on what the model knows, but also on what the student is required to do.

What does the research actually show?

The strongest reason for caution is that access to an AI tutor is not the same thing as effective tutoring.

A two-year cluster-randomized experiment in 18 Tennessee middle schools provides one of the clearest recent tests. Students using Khan Academy with the AI tutor Khanmigo achieved gains in mathematics of roughly 0.06–0.08 standard deviations over a school year. However, the researchers found that these gains were comparable to those produced by Khan Academy practice without AI. Although 96% of students tried Khanmigo at least once, the median student used it on only about one third of practice days and in only 17% of sessions in which they made a mistake. The researchers therefore identify student engagement with the tutor, rather than mere access, as a major constraint. Oreopoulos & Low, NBER Working Paper 35620 (2026).

Even more striking is a randomized university study published in October 2026. The study involved 2,379 undergraduate students and 30 instructors across multiple disciplines. Access to a course-integrated generative-AI tutor was associated with a 0.37 standard-deviation reduction in final grades and a 0.90-standard-deviation reduction in learning-management-system participation. The researchers suggest that the AI tutor may have displaced participation in existing learning activities rather than improving learning. The estimated losses were also larger among first-generation students. Liu et al., EdWorkingPapers (2026).

These two studies should not be treated as contradictory proof that AI tutoring is either good or bad. They show something more useful: the educational effect depends heavily on implementation, student behavior, task design and the surrounding course.

The wider evidence points in the same direction

A 2026 systematic review and meta-analysis of generative AI in STEM education examined 85 eligible studies, with 49 studies and 59 effect sizes included in the quantitative synthesis. It found an overall positive effect on cognitive learning outcomes, but the heterogeneity was extremely high (I² = 96.32%), with a very wide prediction interval. In other words, the average result hides substantial differences between contexts and interventions. Boolzen, Kuhn & Flegr (2026).

The OECD’s Digital Education Outlook 2026 reaches a similar conclusion from a policy and evidence perspective. General-purpose GenAI can improve the quality of students’ immediate outputs without producing equivalent learning gains when it removes the cognitive work that students need to perform themselves. By contrast, AI designed or used with a clear pedagogical purpose has greater potential to support learning. The OECD specifically highlights the possibilities of AI tutors that question, nudge and adapt their support rather than simply deliver solutions. OECD (2026).

This distinction is fundamental. Better performance on an AI-assisted task is not automatically evidence of better learning. A student can submit a better answer while acquiring less of the knowledge or skill required to produce that answer independently.

Why the design of the AI tutor matters

Learning requires cognitive activity. Students need to retrieve information, explain ideas, compare alternatives, make mistakes, receive feedback and revise their thinking. A system that removes all of those difficulties may feel efficient while quietly removing the very processes through which learning occurs.

This is why the most promising AI tutor is not necessarily the one that produces the best answer. It may be the one that produces the best learning sequence.

For example, an educational AI system can:

  • ask a student to attempt a problem before revealing a solution;
  • identify a misconception and ask a diagnostic question;
  • request an explanation in the student’s own words;
  • generate progressively harder practice questions;
  • compare two possible arguments and ask the student to defend one;
  • provide feedback without rewriting the student’s work for them;
  • ask the student to verify an AI-generated claim against a source.

These designs preserve what educational researchers call productive cognitive effort. They also align with the OECD’s emphasis on pedagogical purpose and with the emerging direction of purpose-built tools from major AI companies.

What could this mean for students?

1. More individualized support

The strongest promise of AI tutors is availability. A student who gets stuck at home does not have to wait until the next lesson to ask a question. AI can provide explanations, examples and practice at a pace that fits the learner.

For students who have limited access to tutoring, this could be particularly valuable. But access must not be confused with effectiveness: the evidence shows that students still need to engage actively with the learning process.

2. A new risk of educational dependency

If students learn that every difficult step can immediately be outsourced, they may become less willing to struggle with unfamiliar problems. The danger is not simply “cheating”; it is the gradual weakening of independent problem solving.

The relevant question for educators therefore becomes: What intellectual work remains with the student?

3. AI literacy becomes part of learning itself

Students now need to evaluate not only books, websites and teachers’ explanations, but also machine-generated explanations. They need to ask: Is this claim accurate? What evidence supports it? What might the system have misunderstood?

The OECD and European Commission’s 2026 AI Literacy Framework places this capacity at the center of education: learners should understand AI, critically evaluate its outputs and use it ethically and creatively. OECD/European Commission (2026).

4. The AI divide may become a learning-behavior divide

The problem may no longer be simply who has access to AI. It may be who knows how to use it well.

Recent Microsoft Research work involving 318 university students found that proactive and critical AI engagement was associated with better learning outcomes, while learner background differences were partly explained by differences in how students interacted with AI. This suggests that the ability to use AI productively could itself become an educational advantage. Microsoft Research (2026).

A particularly important lesson for Morocco

The issue is already highly relevant to Moroccan students. According to the OECD’s PISA 2025 country findings, 45% of students in Morocco reported using AI chatbots to help them learn at least once a week, almost identical to the OECD average of 46%. Thirty-six percent reported using AI for preliminary research, 30% for summarizing texts and 29% for drafting writing assignments. Only 9% said they never or almost never used AI for the schoolwork tasks examined by PISA. OECD, PISA 2025: Morocco.

At the same time, the Moroccan data reveal an important inequality: the gap between advantaged and disadvantaged students in opportunities to assess the quality of AI-generated information was among the widest observed across participating systems. This suggests that the educational challenge is not simply to give students access to AI. Schools also need to teach students how to interrogate AI.

For Moroccan education, this means that banning AI alone is unlikely to be a sufficient long-term strategy. A more productive approach would distinguish between AI use that replaces learning and AI use that strengthens learning.

What should teachers do now?

Teachers do not need to turn every lesson into an AI lesson. Instead, they can establish a few clear principles:

  1. Require an attempt before AI assistance. Students should demonstrate initial thinking before receiving extensive support.
  2. Use AI for feedback rather than substitution. Ask the system to identify weaknesses or pose questions rather than rewrite the entire answer.
  3. Make verification part of the task. Students should check important AI claims against textbooks, academic sources or reliable data.
  4. Assess the process. Drafts, oral explanations, reflections and problem-solving steps can reveal learning better than a final AI-assisted product alone.
  5. Teach AI literacy explicitly. Students need to understand hallucinations, bias, uncertainty, privacy and the limits of automated reasoning.

The real question is not whether students will have AI tutors

The latest announcements from OpenAI, Microsoft and other AI companies suggest that AI tutoring will become increasingly embedded in everyday student life. The technological trend is therefore unlikely to be reversed.

But the research does not support a simple claim that AI tutors automatically improve education. Some interventions show positive effects. Others show little added value. A recent randomized university study even found substantial negative effects on grades and participation. The strongest common lesson is that pedagogy mediates technology.

The future of AI in education will therefore not be decided by which company builds the most capable tutor. It will be decided by whether educational systems can design environments in which students still have to think, retrieve, explain, question, verify and create.

An AI tutor should make the student more capable, not make the student less necessary.

Research note

This article is an evidence-based synthesis of recent company announcements, randomized studies, systematic research and international policy evidence. It does not present original empirical research. The findings cited here vary in population, intervention and research design; therefore, causal claims should not be generalized beyond the contexts studied.

Selected references

  • OpenAI. (2026). Helping teens learn, plan, and shape the future of AI.
  • Oreopoulos, P., & Low, N. (2026). One Click Away: AI Tutoring with Khanmigo in a Two-Year School Experiment. NBER Working Paper 35620. DOI: 10.3386/w35620.
  • Liu, J., et al. (2026). The Effects of Course-Integrated AI Tutoring on Student Performance and Engagement: A Randomized University Trial. EdWorkingPaper 26-1598. DOI: 10.26300/y3f8-vh05.
  • Boolzen, C., Kuhn, J., & Flegr, S. (2026). Evidence of impact and interpretational limits of generative AI in STEM education. Artificial Intelligence Review, 59, 223. DOI: 10.1007/s10462-026-11665-9.
  • OECD. (2026). OECD Digital Education Outlook 2026: Exploring Effective Uses of Generative AI in Education. DOI: 10.1787/062a7394-en.
  • OECD/European Commission. (2026). Empowering Learners for the Age of AI: An AI Literacy Framework for Primary and Secondary Education. DOI: 10.1787/65cd27d4-en.
  • OECD. (2026). PISA 2025 Results: Morocco.
Posted on — Leave a comment

AI Watermarking in Education: What OpenAI’s New Move Means for Students, Teachers, and Assessment

Abstract illustration in periwinkle representing layered AI literacy frameworks

Artificial intelligence is entering a new phase in education. The question is no longer simply whether students, teachers, and researchers use generative AI. Increasingly, institutions are asking a harder question: Can we determine how AI was involved in producing a piece of work?

On October 5, 2026, OpenAI announced a new approach to text provenance for ChatGPT and Codex. The company said it would begin introducing an invisible, machine-readable watermark into eligible AI-generated text for users in the European Union. The technology, called textGrain, creates a statistical signal through model word choices that can later be detected by an authorized system. The move responds to transparency requirements under the EU AI Act. OpenAI’s announcement.

Key finding: AI watermarking can provide a provenance signal, but it does not establish authorship, measure human contribution, identify the user, or prove academic misconduct.

From AI detection to AI provenance

An AI detector generally asks: Does this text look as if it was generated by AI? A provenance system asks a narrower question: Does this text contain a signal associated with a particular AI system?

OpenAI’s textGrain belongs to the second category. It does not insert visible labels, hidden characters, or unusual punctuation. It subtly influences statistical choices among possible words or word pieces, creating a pattern that a detector can search for.

This distinction matters enormously in education. A watermark may provide evidence that an AI system contributed to a passage. It does not establish how much of the work came from AI, what instructions the student provided, what the student understood, or whether the final submission represents meaningful human reasoning.

Why AI watermarking matters for assessment

Generative AI has challenged a basic assumption behind traditional assessment: the submitted product is evidence of the student’s learning. That assumption becomes weaker when students can use AI to generate essays, solve problems, summarize readings, write code, translate text, and produce presentations.

But replacing traditional assessment with AI detection creates another problem. Consider two students: one copies an AI-generated essay without understanding it; another researches independently, uses AI for feedback, challenges its claims, verifies sources, and substantially develops the final argument. Both may have interacted with AI, but their learning processes are completely different.

A binary question—“Was AI used?”—cannot adequately distinguish between them.

The scientific limitation: watermarks are not perfect

OpenAI reports that detection becomes more difficult with shorter passages and subjects where there is less flexibility in word choice, such as mathematics. Editing can also substantially weaken the watermark. In one evaluation, replacing 10% of words with synonyms reduced detection from about 92% to 66%; replacing 25% reduced it to 17%.

These findings have an immediate implication for schools and universities: a watermark should not be treated as a definitive verdict about authorship. A positive result may indicate that an AI system generated or processed some text. An absence of a watermark does not prove human authorship.

OpenAI also says that a watermark does not measure human contribution, establish ownership or responsibility, identify the user, or verify content accuracy.

Assessment may need to move from products to processes

The most important educational consequence of AI watermarking may be the acceleration of a transition from product-based assessment toward process-aware assessment.

Educators can increasingly evaluate research processes, drafts and revisions, oral explanations, source evaluation, problem-solving steps, reflective commentary, project development, classroom discussion, and the student’s ability to defend conclusions.

This does not mean abandoning essays or examinations. It means recognizing that the final text alone may no longer provide sufficient evidence of learning when generative AI is widely available.

AI literacy becomes part of learning

If students are going to work with AI, education needs to teach them how to work critically with AI. AI literacy includes evaluating AI-generated information, identifying unsupported claims, verifying sources, recognizing uncertainty, protecting sensitive information, understanding model limitations, disclosing AI assistance when appropriate, distinguishing assistance from substitution, and taking responsibility for final work.

The objective should not simply be to teach students how to use AI. It should be to teach them how to think when AI is available.

What teachers should do

AI prohibited

Students complete the task without generative AI.

AI assisted

Students may use AI for brainstorming, language assistance, or feedback but must produce and verify the substantive work themselves.

AI integrated

Students are explicitly asked to use AI and critically evaluate its output. For example: Use an AI system to explain a scientific problem, identify weaknesses in its answer, verify its sources, and produce a corrected explanation.

In this model, AI becomes not a shortcut around learning, but an object through which learning takes place.

What universities should avoid

Universities should be cautious about turning AI detection into an automated disciplinary mechanism. A detection signal should not automatically lead to a finding of misconduct. Students should have an opportunity to explain their work, demonstrate understanding, provide drafts where relevant, and respond to the evidence.

The purpose of assessment is ultimately not to identify machines. It is to understand learning.

What are we actually assessing?

A polished essay can demonstrate writing ability, but it may also demonstrate access to tools. A correct mathematical answer can demonstrate understanding, but it may also demonstrate the ability to obtain an answer from a machine. A programming assignment can demonstrate coding competence, but it may also demonstrate the ability to supervise an AI coding system.

None of this makes assessment meaningless. It means that assessment design must evolve alongside the technology.

What OpenAI’s watermark really changes

Text watermarking does not solve the AI cheating problem, create a perfect AI detector, or tell a teacher whether a student has genuinely learned something. What it represents is a move toward a world in which AI-generated content can carry provenance signals.

For education, this could support transparency—but provenance should be combined with better assessment. The strongest response is likely to combine provenance + human judgment + AI literacy + process-based assessment + clear institutional policy.

Conclusion

OpenAI’s textGrain announcement may be an early step toward a new norm of digital transparency. But education should resist the temptation to equate AI origin with misconduct.

The real challenge is bigger: schools and universities need to redesign learning environments in which students can use powerful AI systems without outsourcing the cognitive abilities education is supposed to develop.

The goal should not be classrooms where AI is impossible to use. It should be classrooms where using AI does not make thinking unnecessary.


Research basis

This article is an analytical synthesis of current reporting and official regulatory material. It does not present original empirical research.

Related reading: Generative AI in Education: What the Research Says About Learning and Assessment · Do AI Detectors Actually Work? What the Evidence Shows

Posted on — Leave a comment

Generative AI in Education: What the Research Says About Learning and Assessment

Abstract illustration in periwinkle representing layered AI literacy frameworks

Generative AI in education has moved from a question of technological possibility to a question of educational design. The central issue is no longer simply whether students and teachers will use tools such as large language models, but how those tools should be integrated into teaching, learning and assessment without weakening the purposes education is meant to serve.

This article reviews recent peer-reviewed research and international guidance to identify what the evidence currently supports, where findings remain uncertain, and what the shift means for educators and institutions. It is a research synthesis, not an original empirical study.

Key finding: Recent research does not support a simple “AI is good” or “AI is bad” conclusion. Outcomes depend substantially on the pedagogical task, the way students use the tool, the role assigned to AI, and how learning is assessed.

Why generative AI changes the educational question

Generative AI can produce text, explanations, examples, code, images and other forms of content on demand. That changes the relationship between a learner and a conventional educational task. A student may now obtain a plausible explanation, draft an argument or receive feedback before submitting work that previously required more independent production.

UNESCO’s guidance on generative AI in education and research frames this development as a question of human-centred educational design. It emphasizes human agency, inclusion, equity, data protection, appropriate validation of AI systems and the need to consider how AI affects what is taught, how it is taught and how learning is assessed. UNESCO, 2023.

This distinction matters. The educational value of a generative AI system cannot be inferred from the quality of its output alone. A fluent answer may help a learner understand a difficult concept, but the same answer can also bypass the cognitive work that an assignment was designed to elicit.

What recent research tells us about learning

A 2025 systematic review in the International Journal of Educational Technology in Higher Education examined 63 peer-reviewed studies of AI-based learning tools in higher education. The review identified assessment and evaluation, personalized feedback and recommendations, and intelligent tutoring among the main roles of AI-based tools. It also examined cognitive, skill-based and affective learning outcomes rather than treating “learning” as a single measure.

Another 2025 systematic review in TechTrends synthesized research on pedagogical applications of generative AI in higher education. Taken together with other reviews, the literature indicates that generative AI is being used across teaching, learning support, feedback, content generation and assessment-related activities, but the research base remains heterogeneous.

A 2025 meta-analysis of 57 studies and 97 effect estimates reported positive effects of generative AI on several university learning outcomes, including language skills, academic achievement, affective-motivational outcomes and higher-order thinking. However, the same analysis found no statistically significant effect on metacognition and identified substantial variation associated with learners, tools, roles, rules and learning contexts. The implication is important: positive average effects do not mean that every use of generative AI produces better learning.

In practical terms, the strongest interpretation of the current evidence is conditional. AI can function as a scaffold, tutor, feedback partner or source of examples, but the educational design still determines whether the learner is thinking, checking, explaining and applying—or simply accepting an answer.

The assessment problem is bigger than plagiarism

The most visible educational debate has focused on academic misconduct: whether a student used AI to produce work that was expected to be independently authored. That issue is real, but it is only one part of a broader assessment problem.

If a conventional assignment can be completed largely by generating a plausible response, the institution may lose information about the student’s reasoning process. The question therefore becomes: What exactly is the assessment intended to measure?

A 2025 systematic review of the early impact of AI on higher-education curriculum, instruction and assessment found that the emergence of generative AI was putting pressure on established assessment practices and on how academics design curriculum and instruction. A later systematic review focused specifically on university assessment similarly identified academic integrity, AI literacy, ethics and institutional governance as connected issues.

Research published in 2026 on generative AI and 21st-century skills assessment adds another dimension. Its systematic review argues that skills such as critical thinking, creativity, communication and collaboration remain relevant, while suggesting that assessment methods need to capture processes and evidence of learning rather than relying exclusively on conventional outputs.

What assessment can look like in an AI-enabled environment

The evidence does not imply that every assessment should become an oral examination or that written assignments should disappear. Instead, it points toward greater variety and stronger alignment between the learning objective and the evidence collected.

  • Process evidence: drafts, revisions, research notes, problem-solving steps or reflective explanations can make learning more visible.
  • Authentic tasks: students can be asked to apply concepts to unfamiliar cases, local problems or discipline-specific situations.
  • Oral or dialogic components: short discussions can test whether a student can explain and defend the reasoning behind submitted work.
  • AI-use disclosure: where AI is permitted, students can document how they used it, what they accepted or rejected, and how they verified outputs.
  • Portfolio assessment: a collection of work over time can provide more evidence of development than a single generated product.

These approaches do not eliminate the need for academic integrity policies. They change the emphasis from trying to detect every possible instance of AI assistance toward designing assessments in which meaningful evidence of learning is harder to outsource.

AI literacy becomes part of the learning objective

Generative AI introduces a new literacy requirement. Students need to understand not only how to operate an AI system, but also how to evaluate its outputs, recognize uncertainty, protect sensitive information and decide when using AI is educationally appropriate.

UNESCO’s framework is explicitly human-centred: it treats AI competency as connected to human judgement, ethics and responsible participation rather than technical tool use alone. Recent research likewise identifies AI literacy and educator preparation as important conditions for responsible integration.

This changes the role of the teacher. The teacher is not simply a gatekeeper deciding whether AI is allowed. In many contexts, the teacher becomes a designer of tasks in which students learn how to question, verify and use AI without surrendering responsibility for the final intellectual product.

What institutions should change—and what they should not assume

Institutions considering generative AI policies should avoid two opposite assumptions. The first is that prohibition alone can restore pre-AI assessment conditions. The second is that introducing AI automatically modernizes teaching.

The research instead points toward several institutional priorities:

  1. Define permitted and prohibited uses clearly. Policies should distinguish brainstorming, translation, feedback, coding assistance and content generation rather than treating all AI use as one category.
  2. Align assessment with learning outcomes. If critical reasoning is the objective, the assessment should generate evidence of critical reasoning.
  3. Train educators. Faculty need practical knowledge of AI capabilities, limitations, assessment redesign and responsible use.
  4. Protect privacy and data. Institutions should evaluate what information students and staff enter into external AI systems.
  5. Evaluate evidence continuously. Generative AI systems and educational practices are changing quickly; policies should therefore be revisited as evidence develops.

Importantly, the research base still has limitations. Studies differ in discipline, educational level, duration, AI system, learning task, outcome measure and research design. Many findings are therefore context-dependent. Systematic reviews can identify patterns across studies, but they cannot remove the underlying heterogeneity of the evidence.

What the evidence means for educators

For educators, the practical question is not “How do I stop students from using AI?” in isolation. A more useful sequence is:

What should students learn? What evidence would demonstrate that learning? Which parts of the task can appropriately involve AI? Which parts require independent human reasoning? And how will students be taught to verify AI-generated information?

That approach is consistent with the direction of recent scholarship. Generative AI can be integrated into education, but its educational value depends on the surrounding pedagogy, the assessment design and the quality of human oversight.

Conclusion

The emerging evidence on generative AI in education is more nuanced than either technological optimism or technological alarm. Recent systematic reviews report meaningful opportunities for learning support, feedback, personalization and some learning outcomes, while also identifying unresolved challenges around assessment, metacognition, academic integrity, AI literacy, privacy and institutional governance.

The central educational task is therefore not to choose between “AI” and “no AI.” It is to decide where AI adds educational value, where it undermines the purpose of a task, and how assessment can continue to provide credible evidence of what a learner knows and can do.

For institutions, this means treating generative AI as a curriculum and assessment question—not merely as an IT policy question.


Research basis and references

  1. Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. Source.
  2. Luo, J., Zheng, C., Yin, J., et al. (2025). “Design and assessment of AI-based learning tools in higher education: a systematic review.” International Journal of Educational Technology in Higher Education, 22, 42. DOI.
  3. Qian, Y. (2025). “Pedagogical Applications of Generative AI in Higher Education: A Systematic Review of the Field.” TechTrends, 69, 1105–1120. DOI.
  4. Belkina, M., Daniel, S., Nikolic, S., et al. (2025). “Implementing generative AI (GenAI) in higher education: A systematic review of case studies.” Computers and Education: Artificial Intelligence, 8, 100407. DOI.
  5. Liang, J., Stephens, J. M., & Brown, G. T. L. (2025). “A systematic review of the early impact of artificial intelligence on higher education curriculum, instruction, and assessment.” Frontiers in Education, 10, 1522841. DOI.
  6. Chen, S., & Cheung, A. C. K. (2025). “Effect of generative artificial intelligence on university students learning outcomes: A systematic review and meta-analysis.” Educational Research Review, 100737. DOI.
  7. Nyagoga, L. M., Malik, L., & Lukoko, H. O. (2026). “Generative AI’s implications on higher education students’ 21st-century skills assessment: insights from a systematic literature review.” Artificial Intelligence in Education, 2, 109–126. DOI.

Editorial note: This article synthesizes published research and international guidance. It does not present original empirical data. Findings should be interpreted in light of differences in study design, population, discipline, intervention and assessment context.

Posted on — 1 Comment

Do AI Detectors Actually Work? What the Evidence Shows

Abstract illustration in sand tones showing a magnifying glass examining a document

GPTZero advertises 99% accuracy on its homepage. Independent peer-reviewed testing of 14 detection tools, including GPTZero and Turnitin, found that all scored below 80% accuracy, and only five exceeded 70%. Both of those facts are real and current. The gap between them is the actual story, and it matters directly to anyone relying on a detector to decide whether a student used AI.

What independent testing actually found

The most cited independent evaluation, Weber-Wulff et al. (2023), published in the peer-reviewed International Journal for Educational Integrity, tested 14 detection tools and found all scored below 80% accuracy, with only five exceeding 70%. The study identified a consistent bias: detectors tend to classify ambiguous text as human-written rather than AI-written, and accuracy drops further once text has been paraphrased, which is exactly what a ‘humanizer’ tool or a quick manual edit does.

The false-positive problem lands unevenly. A separate peer-reviewed study in Patterns (Liang et al., 2023) found detectors misclassified 61% of essays written by non-native English speakers as AI-generated, a finding we covered in detail in our piece on the Brown University cheating case. A separate Common Sense Media survey found generative-AI detectors produced a 20% false positive rate for Black students, compared with 10% for Latino students and 7% for White students. These are not scattered anecdotes; they are a consistent pattern across independent studies with different authors, methods, and years.

Why vendor claims and independent findings diverge

A 2026 academic analysis examining this exact gap found that vendors’ headline accuracy figures, GPTZero’s claimed 99.39% on its own multi-domain evaluation, Pangram’s claimed 99.98%, come from vendor marketing materials and vendor-run benchmarks, not from independent replication. That is not necessarily evidence of dishonesty; a vendor’s internal benchmark and an independent researcher’s real-world sample of student writing are measuring different things. But it means a detector’s own claimed accuracy is not a substitute for independent evidence, and the two numbers should not be read as describing the same reality.

What the vendors themselves say, which is easy to miss

This is worth stating plainly because it rarely makes it into how these tools are actually used: both major vendors explicitly disclaim the use case schools most often put them to. Turnitin’s own FAQ states its percentage score ‘should not be used as the sole basis for action’ against a student. GPTZero’s own FAQ states ‘no AI detector is 100% accurate’ and that results ‘should not be used to punish or as the final verdict.’ A score from either tool, used by the vendor’s own stated terms, is a prompt for a conversation, not a verdict.

What this means in practice

  • Treat a detector score as a prompt to look closer, never as proof. This is both the independent research finding and the vendors’ own stated position.
  • Weight that caution more heavily for non-native English writers. The 61% false-positive finding is specific and replicated enough to treat as a known, serious risk, not a rare edge case.
  • Prefer a pattern-level signal over a single-document score. Our analysis of the Brown University case found that what actually triggered institutional review was a class-wide score anomaly, not a detector flag on one essay, and that distinction held up better under scrutiny.
  • Build the response into policy, not improvisation. Our guide to building an AI use policy covers how to set this expectation before a detector score ever becomes a disciplinary question.

Key takeaways

  • Independent peer-reviewed testing found all 14 evaluated AI detectors scored below 80% accuracy; vendor-claimed figures near 99% come from vendor-run benchmarks, not independent replication.
  • False positives are not evenly distributed: 61% for non-native English writers in one study, 20% for Black students versus 7% for White students in another.
  • Both GPTZero and Turnitin explicitly state in their own FAQs that a score should not be used as sole proof or as a final verdict.
  • The more defensible signal is a pattern-level anomaly across a group, not a single document’s detector score.

Sources: Weber-Wulff, D., et al. (2023), International Journal for Educational Integrity; Liang, W., et al. (2023), Patterns; Common Sense Media (2024) survey findings; Turnitin and GPTZero official FAQ pages, accessed 2026.

Posted on — Leave a comment

Google May Retire Free Gemini Gems for Paid Skills: What It Could Mean for Schools

Abstract illustration in sand tones showing a fading gem shape transitioning into a locked gate

Google is reportedly preparing to retire Gemini Gems, its free tool for building a custom AI assistant, on October 20, 2026, replacing it with a new feature called Skills that currently requires a paid subscription. Google has not officially confirmed the date, and this article treats the details below as reported, not settled. But the shift itself, from a free, sharable custom-AI feature to a paid, subscription-gated one, is worth examining specifically for what it could mean for classrooms, because Gems is exactly the kind of tool a teacher or student builds without ever thinking of it as ‘AI infrastructure.’

What is reported to be changing

Gems, introduced at Google I/O 2024, let any Gemini user, including free-tier accounts, describe a task in plain language (a language-practice partner, a Socratic coding tutor, a first-draft feedback assistant) and get a reusable, specialized version of Gemini configured for exactly that purpose. According to notices surfaced independently by Android Authority and the outlet Jetstream, and corroborated by multiple regional tech publications, Google is preparing to discontinue Gems and direct users to recreate their workflows as Skills, a feature inside Gemini Spark. The reported catch: Skills currently requires a Google AI Pro or Ultra subscription, is not available on work or school Google accounts at all, and is not yet available in the European Economic Area, the UK, Switzerland, or Nigeria.

Why this specific detail matters for education

Two reported restrictions land directly on classrooms, not just individual consumers. First, Skills reportedly does not yet work on Google Workspace for Education accounts, the exact account type most K-12 and university Gemini use runs through. Second, several major regions have no access to Skills at all yet. If Gems is retired on the reported timeline before either gap closes, a genuinely free, teacher-buildable tool would functionally disappear from the school accounts that currently use it, not because the underlying capability vanished, but because of how access is currently structured.

Our perspective: what this could mean, if it proceeds as reported

Everything in this section is our own reading of the situation, not a confirmed outcome, and it could look quite different once Google clarifies its plans.

One way to read this is as a preview of a broader pattern worth watching: as AI vendors move from simple chat interfaces toward more capable, agent-like features, those more capable features seem to be landing behind subscriptions more often than the basic chat tools that came before them. If that pattern holds, the practical skill gap in classrooms may shift, from whether students and teachers have access to AI at all, to whether they have access to the specific tier of AI that lets them build and customize a tool rather than just use one someone else built. That is a meaningfully different, and arguably more consequential, kind of access gap.

It is also worth holding open the more optimistic reading several of the reports themselves note: Google could still expand Skills to free and school accounts before any retirement date, exactly as it did with earlier Gemini features. If that happens, this becomes a routine product migration rather than an access story. We genuinely do not know which outcome is more likely, and would caution against treating either as inevitable.

What this connects to on this site

A teacher-built Gem, in practice, is a simple version of what we described in our explainer on AI agents: a configured, reusable tool built around a specific task rather than a one-off prompt. Whether that capability stays free and school-accessible, or migrates behind a paid tier, is exactly the kind of practical question our framework for evaluating an AI tool is meant to help schools navigate: not just whether a tool is capable, but whether its access terms actually fit an education budget and an education account type.

Key takeaways

  • Google is reported, but has not officially confirmed, to be retiring free Gemini Gems around October 20, 2026, in favor of Skills, a Gemini Spark feature currently requiring a paid subscription.
  • As reported, Skills does not yet support school or work Google accounts, and is unavailable in several major regions including the EU and UK.
  • Our perspective, not a confirmed fact: this could signal a broader shift where more capable, agent-like AI features land behind paywalls more consistently than basic chat access did.
  • Google may still expand access before any retirement date; the outcome is genuinely uncertain at the time of writing.

Sources: reporting on the Gems retirement notice via Android Authority and Jetstream (August 2026); TestingCatalog; regional technology press corroboration, September 2026. Google had not issued an official statement on the reported timeline at the time of writing.