Publié le — Laisser un commentaire

AI Monitoring of Teachers: 7 Safeguards for Schools

Teacher working at a desk with a laptop and notes in a classroom

AI monitoring of teachers is moving from an abstract workplace-technology debate into a practical question for schools, universities and professional training providers: when does automated feedback help educators improve, and when does it become intrusive performance surveillance?

The distinction matters. An AI system may summarize a lesson, help a teacher reflect on questioning techniques or identify a topic learners found difficult. A system that continuously scores a teacher’s pauses, wording, response speed or classroom silence—and sends risk labels to managers—does something different. It turns selected signals into judgments about a complex human activity.

Recent reporting has made that tension visible. On 28 September 2026, The Guardian reported that instructors at UK training company Multiverse described stress and anxiety after an AI system began analysing lesson transcripts and flagging perceived performance concerns. The company said the system supports managers and does not write formal performance reviews. The accounts are reported allegations, not an independent evaluation of the system’s accuracy or effects.

For education leaders, the useful question is not simply whether AI can analyse a lesson. It is whether the monitoring purpose is justified, the evidence is valid, the data use is fair, and educators can challenge an incorrect interpretation.

Why AI monitoring of teachers is becoming a governance issue

AI can process far more text or audio than a human observer can review. That makes it attractive for quality assurance in online tutoring, apprenticeship programmes, teacher development and large training organisations. A dashboard may appear to offer consistent coverage where human observation is occasional.

But coverage is not the same as validity. A transcript may reveal whether a particular phrase appeared; it cannot reliably establish on its own why a teacher used it, whether a pause was productive, whether a learner’s silence signalled confusion, or whether an instructor deliberately departed from a script to meet an individual need.

The broader trend extends beyond education. On 28 October 2026, Reuters reported that Scale AI disputed privacy complaints concerning alleged monitoring of freelance AI-training workers. Those complaints concern a different workplace and remain allegations, but they illustrate the growing scrutiny of systems that convert workers’ digital traces into management signals.

The OECD’s 2026 report on reimagining teaching places professional autonomy, trust and collaboration alongside the use of AI as central issues for the future of teaching. Monitoring should be judged against those goals, not just against how many sessions a system can process.

What AI systems can measure—and what they cannot safely infer

Depending on their design, AI monitoring tools may analyse lesson transcripts, speaking patterns, adherence to a script, response timing, participation signals or selected behaviours. These features can sometimes help a coach locate a moment for closer review. The risk begins when a proxy is treated as a direct measure of teaching quality.

  • Filler words are not a complete measure of expertise. A teacher can speak fluently and still explain a concept poorly; a thoughtful teacher may use pauses or hedging while modelling uncertainty.
  • Silence is ambiguous. It may indicate confusion, reflection, independent work, a technical issue or a deliberate wait-time strategy.
  • Script adherence is not the same as responsiveness. A useful lesson may require changing an example, slowing down or answering an unexpected question.
  • A confidence score is not proof. A model’s numerical confidence should not be presented as a calibrated probability that a teacher performed well or badly unless that claim has been independently validated.

Research on AI in classroom management provides a warning about the evidence base. A 2025 systematic review of 104 studies found that ethical issues were discussed in only 22% of the reviewed studies and privacy-preserving measures were implemented in 13%. The review concerns classroom-management research rather than every teacher-monitoring product, so its figures should not be treated as a direct audit of workplace monitoring. They do, however, show why institutions should ask for evidence about privacy and ethics instead of assuming that technical capability guarantees responsible use. See the review in Computers and Education: Artificial Intelligence.

Related research on digital surveillance in blended higher education has also documented tensions between institutional oversight, trust and teacher–student relationships. That study does not establish that every monitoring system causes harm, but it reinforces the need to assess how surveillance changes professional behaviour and classroom relationships, not only how accurately software classifies data. Read the open-access study in Postdigital Science and Education.

Seven safeguards for schools and training providers

1. Define a narrow, educational purpose

Start with a specific question: for example, can optional transcript summaries help instructors notice that their explanations of one concept are consistently unclear? Avoid vague goals such as “measure teacher quality” or “identify low performers.” Record what the system is intended to improve, what it must not be used for, and who is accountable for the decision.

Before buying a tool, compare it with less intrusive options such as peer observation, learner feedback, voluntary self-reflection or targeted coaching. If a simpler method can achieve the same purpose, continuous monitoring may not be justified.

2. Tell educators what is collected and how it is used

Give staff clear, accessible information before a pilot begins. Explain whether audio, video, transcripts, chat messages or learner data are captured; which model analyses them; who sees the output; how long records are retained; whether a vendor can reuse data; and whether results can influence appraisal, promotion or contract renewal.

Involve teachers, trainers, staff representatives and data-protection specialists in design decisions. Consultation is not a substitute for a lawful basis, but it can reveal practical problems that managers and vendors may miss.

3. Minimise data and retention

Collect only what is necessary for the stated purpose. If the goal is to improve lesson explanations, a carefully selected transcript excerpt may be enough; continuous video, facial analysis or unrelated device activity may add intrusion without adding educational value. Restrict access, set deletion periods, secure vendor contracts and prohibit secondary uses that have not been clearly authorised.

The UK Information Commissioner’s Office explains that worker monitoring must be lawful and fair, and that excessive monitoring can undermine privacy and mental wellbeing. Its guidance on data protection and monitoring workers recommends a clear purpose, proportionality, transparency and consideration of a data protection impact assessment.

4. Validate outputs in real teaching contexts

Do not rely on a vendor demonstration or a single aggregate accuracy score. Test the system across subjects, age groups, accents, languages, class sizes, online and in-person formats, and different teaching styles. Have experienced educators independently review a sample of flagged and unflagged sessions. Record false positives, missed issues and differences between groups.

Ask vendors to explain the training data, known limitations, evaluation methods and conditions under which the system should not be used. If a product cannot explain why it flags a session or cannot provide meaningful evidence of validity, do not use its scores for consequential decisions.

5. Make human oversight meaningful

A manager should not simply approve an AI-generated rating. Reviewers need access to the relevant context, time to inspect the evidence, authority to disagree with the system and a process for asking the educator for their explanation. A score should be a prompt for inquiry, not a verdict.

The ICO’s guidance on monitoring tools that use solely automated processes stresses meaningful human involvement where automated processing informs significant decisions about workers. The exact legal requirements depend on jurisdiction and use case, so institutions should obtain appropriate advice before deployment.

6. Pilot for learning, not punishment

Run a limited pilot with a defined end date and agreed evaluation criteria. At first, use outputs for voluntary reflection or coaching rather than employment decisions. Compare the system’s observations with peer review and learner evidence, and ask teachers whether the feedback is accurate, useful and respectful.

Measure unintended effects as well as efficiency: anxiety, workload, changes in teaching style, willingness to answer difficult questions, learner participation and time spent contesting flags. Pause the pilot if the tool encourages performative compliance, produces persistent unexplained errors or reduces attention to learners.

7. Provide access, correction and appeal

Educators should be able to see the information about them, understand the reason for a flag, correct inaccurate records and challenge a conclusion before it affects them. Keep an audit trail of model outputs, human changes and final decisions. Set an independent route for complaints and review the system regularly after updates.

These controls also help distinguish developmental feedback from formal performance management. If an organisation intends to use monitoring data in high-stakes decisions, that use needs a separate assessment rather than being quietly added to a coaching tool after the pilot.

What the EU AI Act means for worker monitoring

The EU AI Act lists certain AI systems intended for employment, workers’ management and access to self-employment as high-risk, including systems intended to monitor or evaluate workers’ performance and behaviour. The classification depends on the system’s intended purpose and the Act’s conditions and exceptions; it should not be reduced to the claim that every classroom analytics tool is automatically high-risk.

Education providers operating in or serving the EU should review the relevant provisions in Regulation (EU) 2024/1689, especially Annex III, alongside applicable employment and data-protection rules. Organisations elsewhere should check their own legal framework. This article is an educational overview, not legal advice.

A practical 30-day implementation plan

  1. Week 1 — Define the purpose. Write a short impact statement, map the data collected, identify alternatives and consult educators.
  2. Week 2 — Test and challenge. Use a small, representative sample; compare AI flags with independent educator review; document errors and uncertainty.
  3. Week 3 — Run a limited coaching pilot. Give participants access to outputs, a human contact and a clear way to correct or contest results. Do not use pilot scores for disciplinary decisions.
  4. Week 4 — Review the evidence. Compare educational usefulness, false-positive rates, staff experience, privacy risks and total workload. Continue only if the benefits are clear and the safeguards work.

For a broader framework, connect this process to four models of teacher–AI collaboration, the site’s guide to building an AI use policy, and its analysis of AI teacher-training competencies. Those resources can help institutions place monitoring within a wider strategy for responsible AI adoption rather than treating it as a stand-alone management solution.

Frequently asked questions

Can AI reliably evaluate teaching quality from a transcript?

A transcript can support a narrow review, but it does not capture every relevant feature of teaching. It may omit non-verbal context, learner needs, subject difficulty and reasons for adapting a lesson. Use it as one source of evidence, not a complete evaluation.

Is AI monitoring of teachers legal?

It depends on where the organisation operates, what data is collected, the purpose, the level of intrusion and how outputs are used. Data-protection and employment rules may require transparency, proportionality, a lawful basis, impact assessment and meaningful human review. Obtain jurisdiction-specific advice.

Should AI-generated scores affect a teacher’s employment?

Do not use scores as an automatic verdict. Before any consequential use, validate the system, disclose its role, provide access to evidence and appeal, ensure meaningful human decision-making, and assess applicable legal obligations. In many settings, a developmental coaching purpose is safer and more educationally defensible than continuous punitive scoring.

The bottom line

AI monitoring of teachers should be judged by whether it improves teaching and learning without undermining professional trust, privacy or autonomy. Schools and training providers should begin with a narrow purpose, collect less data, validate outputs with educators, preserve meaningful human oversight and give staff a genuine right to challenge errors. If a tool cannot meet those conditions, more monitoring is not the same as better education.

Image credit: Vitaly Gariev via Unsplash.

Publié le — Laisser un commentaire

Generative AI Learning Outcomes: What a 2026 Meta-Analysis Really Shows

Teacher reviewing research and lesson notes on a laptop at a classroom desk

Short answer: A peer-reviewed meta-analysis published on 21 October 2026 found a positive average association between generative AI-supported instruction and students’ learning-related outcomes. But its headline effect is not a guarantee that an AI tool will help in every classroom. The same paper reports substantial variation between results and a prediction interval that includes no benefit. For schools and training teams, the useful question is not “Does AI work?” but “For which learners, task, teaching design and assessment does it work—and how will we know?”

This guide explains what the new evidence can support, what it cannot establish, and how educators can translate it into a sensible evaluation plan. It also distinguishes learning with AI from learning that students can demonstrate independently.

What the October 2026 meta-analysis examined

Khodjaev, Masalimova, Chistyakov and Ay published “A meta-analysis of the effects of generative artificial intelligence on learning, cognitive, and linguistic outcomes” in Frontiers in Education on 21 October 2026. The researchers synthesized 68 effect sizes from 58 peer-reviewed primary studies, representing 6,941 participants.

The review focused on three outcome families:

  • Learning outcomes: academic performance, comprehension, retention and transfer.
  • Linguistic outcomes: writing, speaking, reading, vocabulary, grammar and pronunciation.
  • Cognitive outcomes: measures such as memory, attention, reasoning, cognitive load and problem-solving.

The researchers searched Web of Science and Scopus in May 2026, screened studies against eligibility criteria and used a three-level random-effects model with cluster-robust variance estimation. That matters because some primary studies reported more than one relevant outcome; those results are related, not wholly independent observations.

The evidence base is not evenly distributed across contexts. Around 73.5% of the included effect sizes came from higher-education or adult samples, while primary-school samples accounted for 10.3%. China and Taiwan contributed a substantial share of the studies. The findings are informative, but they should not automatically be generalized to every age group, language, curriculum or education system.

What does the headline effect size mean?

The authors reported a pooled standardized effect of Hedges’ g = 0.864, with a 95% confidence interval from 0.720 to 1.009. In the sample of studies included, the average result favored GenAI-supported learning. Hedges’ g expresses a difference in standardized units; it is not an 86.4% improvement, a percentage-point gain, or a promise that a student will receive a higher grade.

A pooled estimate is useful because individual studies can be small, narrow or inconsistent. Combining results can provide a more stable estimate of the average pattern across the included evidence. Yet the average is only one part of the story. The range of results and the quality of the underlying studies matter just as much when deciding whether to adopt a tool.

For example, a chatbot that gives step-by-step hints during practice may affect learning differently from a tool that writes an essay, summarizes a reading or generates language exercises. Even when two interventions use the same underlying model, the instructional task, amount of guidance, teacher involvement and assessment method can change the result.

The most important caveat: effects varied widely

The review reported substantial heterogeneity, with I² around 88%. In plain language, the differences among study results were much larger than would be expected from sampling error alone. The studies were not all estimating one identical, universal effect.

The authors also reported a 95% prediction interval from −0.213 to 1.942. A confidence interval around a pooled average describes uncertainty about that average. A prediction interval asks a different question: how widely might the true effect vary in a new, comparable setting? Here, the interval crosses zero, meaning a future implementation could plausibly show little or no benefit—and, in some circumstances, a negative result—even though the overall average was positive.

This is not a contradiction. A treatment can have a favorable average while working better under some conditions than others. It is a reason to evaluate a specific educational use case rather than treating “AI in education” as a single intervention.

It also explains why a school should avoid making procurement decisions based on one impressive number. A strong result in language learning or a university course does not prove that the same product will improve primary mathematics, vocational training or independent reading.

How publication bias could affect the estimate

The authors tested whether the observed evidence showed signs of small-study effects. Egger’s regression indicated funnel-plot asymmetry (p = .002), and PET–PEESE adjustments suggested that the underlying effect might be appreciably smaller than the headline estimate—roughly g = 0.26 to 0.45, depending on the estimator.

These tests are warning signals, not a definitive measurement of how much bias exists. Funnel-plot asymmetry can have more than one explanation, and statistical corrections rely on assumptions. The review’s trim-and-fill procedure did not impute missing studies, while the other diagnostics still suggested caution. Taken together, the results support neither dismissing the review nor repeating its largest number without qualification.

A practical reading is: the evidence points toward possible benefits, but the magnitude may be overstated and is not yet sufficiently predictable across settings. Independent replications, larger samples, preregistered studies and transparent reporting of null results would help clarify the picture.

Why other 2026 reviews report different effects

Meta-analyses can produce different pooled estimates without one necessarily being wrong. Their research questions, populations, outcome definitions, dates, inclusion criteria and comparison groups differ.

  • Higher education specifically: A May 2026 three-level meta-analysis by Fan and colleagues synthesized 132 effect sizes from 36 studies and 7,229 participants. It reported a medium overall effect (g = 0.499) and found stronger results in collaborative and blended learning designs. Its scope was higher education, not the same mix of learning, cognitive and linguistic outcomes as the October review. Read the higher-education meta-analysis.
  • AI literacy classes for school-age learners: A meta-analysis published in the Journal of Computer Assisted Learning in August 2026 examined 16 articles and 57 effect sizes on whether teaching students about AI improves AI literacy. It reported a positive average effect (g = 0.892). This is a different question from whether students learn subject content with a generative AI assistant. Read the K–12 AI-literacy review.
  • AI applications more broadly: A February 2026 second-order meta-analysis combined 19 earlier meta-analyses and reported a moderate average effect (ES = .67). Because it covered AI applications and earlier reviews more broadly, it should not be compared as if it were a direct replication of the October GenAI analysis. Read the second-order meta-analysis.

These estimates are not a leaderboard for AI products. They are summaries of different bodies of evidence. Before comparing effect sizes, check who was studied, what counted as learning, how AI was used, what the control group did and whether the outcome was measured while the AI tool remained available.

What the evidence means for schools and training providers

The strongest practical response is to define a learning problem before choosing a tool. An AI feature may save preparation time without improving student learning; it may improve the quality of a draft while leaving students unable to explain the underlying idea. Those are different outcomes and should be measured separately.

1. Set one observable learning goal

Replace a broad goal such as “use AI to improve learning” with a testable target: for example, learners will explain a concept in their own words, solve a new problem, revise a weak argument or recall key ideas one week later. A clear outcome makes it easier to decide whether AI is appropriate.

2. Decide what the learner must still do independently

Identify the thinking that must not be outsourced. Depending on the subject, that may include retrieving facts from memory, choosing a method, constructing an argument, interpreting evidence or diagnosing an error. AI can provide hints, counterexamples and feedback while leaving those decisions with the learner.

3. Compare against a meaningful alternative

Do not compare an AI-supported class only with “nothing.” Compare it, where feasible, with a credible alternative such as teacher feedback, worked examples, peer discussion or structured practice. If AI performs similarly to a simpler and cheaper method, the institution should consider whether the additional complexity is justified.

4. Measure both assisted performance and independent learning

Collect evidence while students use the tool and, when relevant, after it is removed. A polished answer produced with AI is not the same as durable knowledge. Short quizzes, transfer tasks, oral explanations, delayed recall and revisions with reasons can reveal whether learners have internalized the material.

5. Monitor who benefits and who is left behind

Look for differences by prior knowledge, language proficiency, accessibility needs and access to devices. Check whether examples are accurate and inclusive, whether the system invents facts or citations, and whether students can recognize and correct errors. Avoid entering identifiable learner data into an unapproved system.

A simple evaluation checklist before adoption

Use these questions in a pilot rather than relying on product demonstrations or vendor claims:

  1. Purpose: What specific learning outcome should improve?
  2. Mechanism: How is the AI expected to help—hints, practice, feedback, explanation, language support or something else?
  3. Comparison: What existing method will serve as the benchmark?
  4. Evidence: What will be measured, when will it be measured, and will some assessment happen without AI?
  5. Quality and safety: How will educators check accuracy, privacy, accessibility and age appropriateness?
  6. Equity: Do learners have comparable access, and are the benefits distributed fairly?
  7. Decision rule: What result would justify continuing, changing or stopping the pilot?

Keep the pilot narrow enough to learn from. Record the task, model or product version, prompts or scaffold, duration, teacher role, learner group and assessment conditions. Without those details, a positive or negative result will be difficult to interpret or reproduce.

What teachers and professional-development leaders should do next

Professional development should focus on instructional judgement, not only prompt-writing. Teachers need practice selecting tasks suited to AI support, checking outputs, designing assessments that reveal student thinking and explaining why they accepted or rejected a suggestion. Institutions can connect this work to AI teacher-training competencies and the five-step AI integration framework already discussed on Prowad.

For a broader introduction to the evidence on learning and assessment, see our guide to generative AI in education research. For a practical way to assess the tools themselves, use the seven evidence checks for AI learning tools. If a tool mainly produces feedback, our analysis of AI feedback versus actual learning explores why feedback quality and learning gains should not be treated as interchangeable.

The OECD’s 2026 report Reimagining Teaching in an Accelerating World also emphasizes the changing role of teachers as AI use spreads. The institutional task is not simply to increase adoption; it is to build the professional knowledge, safeguards and evaluation capacity needed to use AI purposefully.

Frequently asked questions

Does the new meta-analysis prove that generative AI improves learning?

No. It reports a positive average effect across the included studies. High heterogeneity, a prediction interval crossing zero and signs of small-study effects mean results are not guaranteed in a new context.

Is Hedges’ g = 0.864 an 86.4% improvement?

No. Hedges’ g is a standardized effect size. It describes the average difference in standard-deviation units, not a percentage increase, a grade-point change or the share of students who benefit.

Should every school introduce AI because the average effect is positive?

No. Schools should first identify the learning need, compare AI with credible alternatives, check privacy and accessibility, and run a focused pilot with meaningful assessments.

What is the difference between AI literacy and learning with AI?

AI literacy means understanding, evaluating or using AI responsibly. Learning with AI means using an AI system to support another learning goal, such as language development or subject knowledge. Evidence for one outcome should not be assumed to prove the other.

Conclusion: treat the average as a starting point, not a promise

The October 2026 meta-analysis adds valuable evidence that generative AI can support learning-related outcomes on average. Its most useful lesson, however, is methodological: the average effect is not the effect every school should expect. Differences among tasks, learners, comparison methods and study quality matter.

For educators, the responsible path is to start with a clearly defined learning objective, keep essential thinking visible, compare AI with a credible alternative and measure what learners can do independently. The question is not how much AI a school can deploy. It is whether a carefully designed use helps learners understand, remember, transfer and apply what they are taught.

Evidence note: This article interprets the published studies linked above; it is not a new systematic review. Effect-size estimates should be read in the context of each review’s eligibility criteria and limitations.

Publié le — Laisser un commentaire

When Should Teachers Use AI? A Human-First Sequence for Lesson Design

Laptop and planning materials on a classroom desk for teacher lesson design

Short answer: Teachers should often begin a lesson-design task without generative AI, then introduce AI to challenge, expand or test their thinking—not automatically to produce the first complete answer. A 2026 study of pre-service teachers offers a useful clue: AI was most effective when it followed initial human-only design work and was paired with collaborative inquiry and reflective learning analytics. The findings are promising, but they do not prove that delaying AI by itself improves teaching in every context.

For schools and teacher-education programmes, the practical question is not simply whether to use AI. It is when to use it, what thinking should happen first, and how educators can tell whether the final design is better.

What the 2026 study found

In August 2026, Yang and colleagues published “Fostering preservice teachers’ design thinking by integrating generative AI and analytics-supported reflective assessment in a collaborative inquiry environment” in Computers & Education. The study followed 110 pre-service teachers enrolled in a semester-long educational technology course at a teacher-education university in central China. Participants worked in a collaborative Knowledge Building environment that combined inquiry, generative AI and analytics-supported reflection.

The design deliberately positioned AI as a cognitive and reflective partner rather than a solution provider. Students first had opportunities to develop ideas through human-led work; AI was introduced strategically later in the process. The researchers examined a design-thinking scale, successive instructional-design artefacts and 1,305 online discourse notes.

The reported pre–post design-thinking score rose from 5.15 to 5.25. The change was statistically significant, but the effect size was small (Cohen’s d = 0.21). The study also found gains in problem discovery and definition, alongside a shift towards more integrated, iterative design practices, particularly prototyping and testing. The authors reported that GenAI was most effective after human-only design efforts.

Source: Yang et al. (2026), Computers & Education, 249, article 105602. A related conference poster is available from the International Society of the Learning Sciences.

Why the timing of AI use may matter

Generative AI can quickly produce lesson objectives, activities, examples and assessment questions. That speed is useful, but it can also hide the thinking that teachers need to practise: identifying the actual learning problem, deciding what evidence would show understanding, anticipating misconceptions and making trade-offs for a particular class.

If a teacher accepts a polished first draft before defining the learning problem, the output can become the frame for every later decision. The teacher may spend time editing an answer whose underlying assumptions were never examined. Starting without AI creates a visible baseline: the teacher can identify what they already understand, where they are uncertain and which decisions need outside challenge.

Introducing AI later changes its role. Instead of asking, “Write my lesson,” the teacher can ask, “What misconception have I missed?”, “Which part of this activity does not align with the learning objective?” or “Offer two alternative explanations for learners who struggle with this concept.” Those prompts support critique and comparison rather than passive acceptance.

This interpretation is consistent with a 2026 critical review of 20 studies on generative AI in teacher professional development. Shenoy and Saarela identify functional, cognitive, social and reflective affordances, while highlighting gaps in explicit training for critical evaluation, ethical reasoning and verification. The review is a synthesis of a still-developing evidence base, not proof that one sequence works for all teachers.

Further reading: Shenoy and Saarela (2026), “A critical review and actionable framework for integrating generative AI into teacher professional development”.

What the study does—and does not—prove

The results should be read carefully. The intervention combined several elements: collaborative inquiry, strategically delayed GenAI use and analytics-supported reflective assessment. It was not a simple experiment in which one group used AI immediately and an otherwise identical group used it later. We therefore cannot attribute the observed change to timing alone.

  • It suggests: a structured process that gives teachers room to frame a problem before AI assistance can support design thinking.
  • It does not establish: that delaying AI will always improve lesson quality, student attainment or teacher performance.
  • It does not mean: teachers should avoid AI during brainstorming or that AI-first work is always harmful.
  • It does mean: schools should test the sequence against learning goals and examine the quality of the resulting work, not merely how quickly a draft is produced.

The small effect size is another reason to avoid exaggerated claims. The study is useful as a design signal and a basis for local experimentation, not a universal rulebook.

A four-step human-first workflow teachers can try

1. Frame the learning problem before opening an AI tool

Spend five to ten minutes writing the intended learning outcome, the evidence that would demonstrate it and two likely misconceptions. Identify the learners, prior knowledge, curriculum constraints and any accessibility needs. This short human-only phase gives the teacher a clear point of view against which AI suggestions can be judged.

For example, instead of starting with “Create a lesson on fractions,” write: “Learners should explain why two fractions with different numerators can represent the same quantity, and justify their reasoning using a diagram.” That statement defines a learning problem rather than a content topic.

2. Ask AI to challenge the draft, not replace it

Once a first idea exists, use AI for a bounded purpose. Ask it to identify a misconception, suggest a contrasting example, propose a question that reveals shallow understanding or point out where an activity may not match the objective. Ask for alternatives and reasons, not a single authoritative answer.

A useful prompt is: “Review this lesson idea as a critical teaching colleague. Identify two likely misconceptions, one accessibility barrier and one mismatch between the objective and the assessment. Explain the reasoning for each suggestion. Do not rewrite the lesson yet.”

3. Compare every suggestion with subject knowledge and evidence

Teachers should verify factual claims, curriculum alignment, age appropriateness and the suitability of examples. AI can invent references, oversimplify a concept or recommend an activity that sounds engaging but measures the wrong skill. Reject suggestions that do not fit the learners or the available evidence. Never enter identifiable student information into a tool unless the institution has explicitly approved that use and the relevant privacy requirements are met.

4. Revise, then explain the decisions

After comparing the suggestions, revise the lesson yourself. Record which AI suggestions were accepted, adapted or rejected and why. That brief reflection turns AI use into a professional-learning activity: teachers practise making and defending decisions rather than simply producing a document.

How to check whether the workflow is helping

Do not evaluate the process only by minutes saved or by how polished the lesson plan looks. A school or teacher-education programme can use a short rubric before and after a trial:

Indicator Evidence to look for
Problem definition Does the plan name a specific learning difficulty or misconception?
Alignment Do the activities and assessment measure the stated learning objective?
Quality of reasoning Can the teacher explain why key choices were made and which alternatives were rejected?
Iteration Does the final plan improve on the first draft in identifiable ways?
Verification and inclusion Are factual claims checked, student data protected and accessibility needs considered?

Where feasible, collect a first draft, a revised draft and a short reflection. Compare them using the same rubric. If teachers save time but the reasoning, alignment or accessibility of the lesson deteriorates, the workflow needs redesign. If the quality improves without excessive extra work, the sequence may be worth retaining. A small local trial cannot prove universal effectiveness, but it can inform a better decision than relying on enthusiasm or anxiety alone.

How teacher educators can build this into professional development

Teacher development should teach more than prompt-writing. Participants need opportunities to practise subject-specific judgement, test AI suggestions, discuss privacy and bias, and compare examples of weak and strong instructional alignment. A short workshop can model the four steps, but follow-up is important: teachers should try the process with a real lesson, bring their drafts back and discuss what changed.

Programme leaders can connect this approach with broader AI teacher-training competencies and the practical AI integration framework for educational institutions. Schools can also use our guide to measuring AI literacy beyond prompting to define the competencies teachers should demonstrate. For a wider view of how responsibilities can be divided between educators and tools, see our guide to teacher–AI collaboration in education.

Professional development should also be differentiated. A novice may need support checking outputs and protecting data; an experienced teacher may be ready to use AI to stress-test assessment design or compare alternative explanations. In both cases, the goal is not maximum AI use. It is better professional judgement and more purposeful learning design.

Frequently asked questions

Should teachers always create a lesson plan without AI first?

No. A human-first phase is a useful option when the goal is to practise problem framing, design judgement or independent thinking. For routine administrative tasks or when a teacher needs accessibility support, earlier AI assistance may be appropriate. The sequence should match the learning goal and the risks of the task.

Does delayed AI use improve student learning?

The cited study examined pre-service teachers’ design thinking in a combined collaborative-learning intervention. It does not directly establish that delayed AI use improves school pupils’ learning outcomes. More controlled research is needed to isolate the effect of timing and test it across subjects and learner groups.

What is the difference between using AI as an author and as a critic?

As an author, AI generates a substantial first draft. As a critic, it reviews a draft the teacher has already considered, offering alternatives, identifying possible gaps and raising questions. The second role makes the teacher’s initial reasoning visible and easier to compare with suggestions.

How can a school measure success?

Use a shared rubric to assess problem definition, alignment, reasoning, iteration and verification. Combine those measures with teacher reflections and, where appropriate, evidence from classroom implementation. Track time, but do not treat time saved as a substitute for learning quality.

Conclusion: let AI enter at the point where it adds value

The emerging evidence supports a practical principle: do not let the speed of generative AI decide the order of professional thinking. When the learning goal is to develop teachers’ design judgement, begin by framing the problem, bring AI in to challenge and extend the draft, verify its suggestions and reflect on the choices made. The 2026 study offers a promising example of this sequence, but its small effect and combined intervention call for careful interpretation.

The best question for a teacher is not “Can AI make this lesson for me?” It is “Which part of this task benefits from AI, which part requires my judgement, and what evidence will show that the final lesson is better?”

References

  • Yang, Y., Chen, L., Sun, D., Zhu, W., & Pang, S. (2026). Fostering preservice teachers’ design thinking by integrating generative AI and analytics-supported reflective assessment in a collaborative inquiry environment. Computers & Education, 249, 105602. https://doi.org/10.1016/j.compedu.2026.105602
  • Shenoy, P., & Saarela, M. (2026). A critical review and actionable framework for integrating generative AI into teacher professional development. Discover Education, 5, 570. https://doi.org/10.1007/s44217-026-01579-7
  • International Society of the Learning Sciences. (2026). Fostering preservice teachers’ design thinking… CSCL 2026 conference poster. Repository record
Publié le — 3 commentaires

Teacher–AI Collaboration in Education: 4 Models Schools Can Use

Teacher working on a laptop in a classroom while planning teaching activities

Schools do not need to choose between “AI does the work” and “teachers do everything themselves.” A more useful question is how to divide a teaching task so that software handles a suitable part while educators retain the judgement, relationships and responsibility that make teaching work.

A chapter in the OECD’s Co-constructing Visions for the Future of Teaching, published on 19 October 2026, frames this as hybrid human–AI collaboration. It distinguishes replacement, complementation and augmentation, and argues that AI should be designed around educational practice rather than bolted onto it. This article turns that framework into four practical models schools can test—while separating an emerging design vision from evidence that has already been demonstrated.

Why teacher–AI collaboration is a design problem

AI tools are often evaluated as if the system alone produces the educational outcome. In a classroom, however, outcomes usually depend on a social and technical system: the tool, the teacher, the learner, the task, the curriculum and the conditions in which they interact.

The OECD chapter by education researcher Inge Molenaar argues that the relevant question is not simply whether an AI product improves a test score. Schools should examine how teacher and AI contributions fit together, whether the system reflects sound knowledge about learning, and whether the arrangement improves teaching without displacing important human responsibilities. The chapter also notes that research on how to design and implement teacher–AI collaboration remains limited. For a closer look at when AI should enter the lesson-design process, see our evidence review on when teachers should use AI. It is a future-oriented expert perspective, not a controlled trial proving that one collaboration model is best in every classroom.

This distinction matters because a fluent AI response can still be incorrect, misaligned with the curriculum or inappropriate for a particular learner. For related background, see Prowad’s guides to implementing AI in education and teacher AI competency frameworks.

Four models of teacher–AI collaboration

1. Full replacement for a narrow, bounded task

In a replacement model, an AI system performs a task that previously required a person. The OECD chapter gives examples such as an intelligent tutoring system allowing a learner to practise a defined skill without a teacher providing every step of support. In everyday school operations, a tool might also sort routine practice items or provide an initial correctness check against a fixed answer key.

This model is most defensible when the task is narrow, the expected output is easy to verify, the consequences of an error are limited and a clear route to human help remains available. It is much less appropriate for decisions about a learner’s ability, behaviour, wellbeing, progression or access to support.

School test: Start with one low-stakes, repetitive task. Compare the AI output with a teacher-checked sample, record the types of error, and specify when the task must be escalated to a person. Do not assume that success on one exercise means the system can safely handle a broader teaching responsibility.

2. Partial replacement: divide the task between teacher and AI

Partial replacement means the AI completes one component of a larger teaching task while the teacher handles the rest. For example, software may mark whether a maths answer is correct, while the teacher explains why a misconception occurred and helps the learner choose a strategy for the next attempt.

This model can reduce repetitive work without pretending that every part of feedback is equally automatable. Correctness checking, diagnosing a misconception, motivating a discouraged learner and deciding what to teach next are related but different tasks.

School test: Write down the task as separate steps. Assign the AI only the step it can perform reliably, then identify the human checkpoint. A teacher should be able to see enough of the AI’s output to challenge it, correct it or override it.

3. Complementation: add information to an existing teaching practice

In complementation, AI extends an existing practice by giving the teacher additional information or capacity. It does not simply take over a task; it helps the teacher do the task with better or more timely evidence.

For instance, an approved reading-support tool might summarise patterns in students’ recurring decoding errors across several practice sessions. The teacher still interprets those patterns, considers the child’s language and learning context, and decides whether to change instruction. The extra information may be useful, but it should not be treated as a diagnosis or as a complete picture of the learner.

This model is promising when the information is difficult to collect consistently by hand. It also raises questions about data quality, privacy, bias and whether the dashboard’s categories match the teacher’s professional understanding.

School test: Ask whether the additional information changes a real instructional decision. If teachers receive a dashboard but cannot interpret it, do not have time to act on it or do not trust its measurements, the extra data may add workload rather than value.

4. Augmentation: create a new teaching practice with AI

Augmentation goes beyond improving an existing task. Teacher and AI work together to make a new practice feasible—for example, exploring how a class might follow different practice sequences based on emerging patterns, while the teacher adjusts the plan using knowledge of students that the system cannot see.

Here, AI might help generate alternative explanations, propose differentiated practice or surface patterns across a large set of responses. The teacher decides whether those suggestions fit the learning objective, the curriculum and the students in front of them. The new practice should be treated as a design hypothesis to test, not as an automatic benefit of introducing AI.

School test: Define what the new practice makes possible, why it could not be delivered in the same way before, and what evidence would show that it improves learning or teaching. If the only outcome is more generated content, the innovation may not be educationally meaningful.

What the evidence says—and what it does not

The OECD chapter cites earlier task-level estimates suggesting that about 6% of teaching tasks could be replaced by AI, 22% are bottleneck tasks unlikely to be performed by AI in the near future, and 72% could involve some division of work between teachers and AI. These figures come from earlier OECD work on automation and skills. They should not be read as a current census of schools, a prediction that 72% of teachers will be replaced, or a guarantee that the remaining tasks can already be automated safely.

A broader systematic review and meta-analysis by Vaccaro, Almaatouq and Malone, published in Nature Human Behaviour in 2024, analysed 106 experimental studies and 370 effect sizes. Across the included experiments, human–AI combinations performed, on average, worse than the better of the human-alone or AI-alone conditions. The pattern varied by task: combinations tended to lose ground on decision tasks and showed more favourable results on content-creation tasks.

This is a warning against assuming that putting a person and an AI together automatically creates a better team. The meta-analysis covered multiple domains and is not direct proof about school teaching; the authors also noted substantial variation across studies. Its practical lesson is narrower: define the division of labour, understand each partner’s strengths, and test the combined process against relevant alternatives.

Research on formative assessment offers a related caution. A 2026 article in the British Journal of Educational Technology argues that generative AI may support personalised feedback and responsive teaching, but also stresses that the technology is fallible and that its value depends on teachers’ interpretation, professional judgement and pedagogical knowledge. This is a research-informed analysis, not evidence that every AI-supported assessment system improves outcomes.

A five-step pilot schools can run

  1. Choose a real teaching bottleneck. Start with a recurring task that consumes time or delays useful feedback. Avoid choosing a tool first and inventing a problem for it.
  2. Map the task into components. Separate data gathering, pattern recognition, explanation, decision-making, communication and follow-up. Identify which parts require context, empathy or professional accountability.
  3. Set a baseline before the pilot. Record the current time required, error rate, teacher workload and one or two learner outcomes relevant to the goal. Keep the comparison proportionate to the risk and scale of the pilot.
  4. Define the human checkpoint. Specify what the AI may do, what the teacher must review, what cannot be automated and how students or families can raise a concern. Do not enter identifiable student information into a tool unless the school has approved its data handling.
  5. Review and decide. Compare the pilot with the baseline. Look for benefits and unintended effects, including errors, extra verification work, unequal performance across groups and loss of teacher control. Continue, redesign or stop based on the evidence.

How to measure whether collaboration is working

Do not evaluate a teacher–AI workflow only by the number of minutes saved or the quantity of material generated. Those are operational measures, not proof of better teaching or learning.

  • Quality: Are outputs accurate, curriculum-aligned and useful after teacher review?
  • Learning: Can students explain or apply the idea independently, rather than only while the AI is helping?
  • Teacher workload: Does the workflow reduce total effort after checking, correcting and documenting AI outputs are counted?
  • Equity: Does it work across relevant language, disability, device and connectivity needs?
  • Agency and trust: Can teachers understand, question and override recommendations? Do students know when AI has been used?
  • Safety: Are privacy, retention, security, age-appropriateness and escalation procedures clear?

Schools can adapt Prowad’s evidence checks for evaluating AI learning tools to structure this review. For decisions involving institutional policy, the article Who Should Govern AI at Universities? explores the importance of oversight and professional rights.

Teacher professional learning must evolve with the system

Teachers need more than a list of prompts. They need to understand what the tool is designed to do, where it tends to fail, how its output should be checked, and how to decide which parts of a task should remain human-led. The UNESCO AI Competency Framework for Teachers provides a useful policy reference for developing teacher knowledge and skills around human-centred use, ethics, AI foundations and pedagogy.

Professional learning should be linked to real classroom practice. A team can co-design a small workflow, test it with suitable safeguards, examine examples of errors and revise the task division together. Teachers should be involved in tool selection and redesign rather than being asked to adapt unilaterally to a product chosen elsewhere.

Conclusion: design the partnership, do not assume it

Teacher–AI collaboration is not a single model. It may involve replacing a narrow routine, dividing a larger task, adding useful information to existing practice or creating a new learning activity. The right arrangement depends on the task, the quality of the system, the learners’ needs and the consequences of error.

The most responsible starting point is modest: choose one task, define the human and AI roles, measure a baseline, keep a clear human checkpoint and evaluate the combined workflow. AI should be judged by whether it helps teachers and learners achieve a meaningful educational goal—not by how much activity it can automate.

Sources and further reading

Publié le — Un commentaire

AI Vocabulary Learning: What 3 Studies Tell Teachers in 2026

Students studying together in a classroom, representing guided vocabulary learning and language practice.

AI vocabulary learning is often presented as a faster, more personalised alternative to traditional language study. A chatbot can explain a word, create examples, translate a phrase and respond to a learner’s follow-up question in seconds. But the educational question is more precise: does AI help learners recognise words, use them accurately, pronounce them, and recall them later without assistance?

Research published in 2026 offers a useful, more nuanced answer. Studies involving school-age learners and university language students suggest that AI-supported instruction can help with some vocabulary outcomes, but it does not consistently outperform established methods such as strategic dictionary use. The strongest practical conclusion is not to replace dictionaries with chatbots. It is to design activities in which AI, reference tools, teacher guidance and independent retrieval serve different purposes.

What recent research actually tested

Three 2026 studies illustrate why vocabulary learning should not be treated as one single outcome. They examined different ages, languages, teaching approaches and measures, so their results should not be combined into a universal claim that AI either works or fails.

1. A comparison of AI, dictionary instruction and a control group

A study published in Education Sciences in July 2026 compared generative-AI-supported instruction with strategic dictionary use among 136 upper-elementary pupils aged 10–12 in Greece. The four-week intervention focused on climate-change vocabulary. The researchers measured receptive vocabulary—recognising and understanding words—and expressive vocabulary, or producing words in response to a task. The study used a quasi-experimental pretest–posttest design rather than individual random assignment.

For receptive vocabulary, both the AI-supported group and the dictionary-instruction group improved more than the control group. The difference between the two intervention groups was not statistically significant. For expressive vocabulary, there was no overall intervention effect. A more specific analysis found that bilingual pupils in the dictionary group made larger expressive-vocabulary gains than bilingual pupils in the AI and control groups; this subgroup finding needs replication.

The result matters because it challenges the idea that a newer tool automatically replaces an established learning strategy. AI and strategic dictionary use both supported receptive vocabulary in this setting, while the evidence for expressive gains was more qualified. The authors also noted that the intervention was short and that results may depend on the learners, language background and outcome measure. Read the original study in Education Sciences.

2. AI-supported dynamic assessment for university EFL learners

A June 2026 article in Studies in Educational Evaluation examined AI-assisted dynamic assessment with 102 lower-intermediate English-as-a-foreign-language learners at an Iranian university. The researchers compared an AI-assisted dynamic-assessment group, an interventionist dynamic-assessment group and a control group. Dynamic assessment combines evaluation with graduated help, so the teacher or system responds to what a learner can do and the kind of support needed to move forward.

The authors reported that the dynamic-assessment groups outperformed the control group on receptive and productive vocabulary measures, and that the AI-assisted group also outperformed the dynamic-assessment-only group. This is promising evidence for AI used as a responsive learning scaffold rather than as a source of ready-made answers. However, the study involved three intact classes in one university context. It does not establish that every chatbot, age group, language or assessment design will produce the same outcome. Read the published study and abstract.

3. A small study of ChatGPT-supported Chinese vocabulary instruction

A study published on 22 September 2026 in SN Social Sciences described a six-week intervention with 16 international undergraduates learning Chinese. One pre-existing class used ChatGPT-supported vocabulary instruction and another received traditional instruction. The AI-supported class showed a larger observed change on a composite measure of semantic and syntactic knowledge, while the observed changes in phonetic knowledge were similar.

The paper is especially useful because it states its own limits clearly: class membership and instructional condition were completely confounded, with only one class in each condition. The study therefore cannot show that ChatGPT caused the difference between the classes. Its findings are exploratory, class-specific observations—not proof of a treatment effect. The researchers also caution that the combined semantic-syntactic measure cannot establish separate effects on meaning and grammar. Read the open-access study.

Why the type of vocabulary knowledge matters

Knowing a word has several dimensions. A learner may recognise it in a text but be unable to retrieve it while speaking. They may know a translation but not the word’s collocations, grammatical pattern, register or pronunciation. A single quiz score can hide these differences.

  • Receptive knowledge: recognising a word and understanding it when reading or listening.
  • Expressive knowledge: retrieving and using the word in speech or writing.
  • Contextual knowledge: selecting a word that fits the meaning, grammar and situation.
  • Phonological knowledge: producing or recognising the sound pattern accurately, including stress or tones where relevant.
  • Retention and transfer: remembering the word later and using it in a new context without AI help.

These outcomes need different learning activities. AI can quickly generate varied examples and explain contrasts between near-synonyms. A dictionary can provide carefully edited definitions, pronunciation information, grammatical labels and usage notes. Retrieval practice requires the learner to recall the word rather than simply reread an explanation. No single tool automatically supplies all these learning processes.

Where AI can help—and where it can mislead

Generative AI is useful when it creates an opportunity for a learner to think, respond and revise. For example, it can produce several sentences using a target word, simplify a definition, contrast two related terms, or ask a learner to infer meaning from context. A teacher can also use it to draft differentiated practice materials and then check them before classroom use.

But immediate feedback is not the same as reliable feedback. A chatbot may invent a usage rule, provide an unnatural sentence, overlook a regional difference or give a confident but incorrect explanation. Text-based interaction is also not a substitute for listening to accurate audio or receiving feedback on speech. Younger learners may have particular difficulty detecting errors in fluent responses.

For these reasons, AI vocabulary learning should be treated as a guided instructional method, not as an authority that verifies itself. Ask learners to compare important claims with a trusted dictionary, textbook, teacher-approved corpus or other reliable reference. For more on separating assisted performance from actual learning, see Prowad’s guides to student memory and retrieval practice and AI feedback versus learning.

A practical classroom routine for AI vocabulary learning

The following sequence is a teaching proposal informed by the studies above. It is not itself a tested intervention, and teachers should adapt it to learners’ age, language level and curriculum.

  1. Choose a small set of useful words. Define whether the goal is recognition, accurate production, pronunciation, or use in a subject-specific context. Avoid trying to teach too many words in one session.
  2. Ask for an initial attempt before using AI. Learners predict a meaning from context, recall a definition, or write a sentence. This gives them something to compare with the tool’s response.
  3. Use AI for graduated hints and examples. Start with a contextual clue or question. Reveal a definition only when necessary, and ask the learner to explain why it fits.
  4. Verify the response. Check the definition, collocation, grammar or pronunciation against a trusted reference. Correct any misleading AI output before it becomes part of the learner’s notes.
  5. Produce something independently. Have the learner create a new sentence, complete a short dialogue, explain the word to a partner or use it in a subject-related answer without copying the model.
  6. Return to the words later. Use a short no-AI retrieval task in the next lesson and again after a delay. Include a new context to check whether the learner can transfer the word beyond the original example.

A prompt that encourages learning rather than answer copying

You are a language-learning tutor. Help me learn these target words without doing the work for me. First ask me to predict the meaning from context. Give one hint at a time and wait for my answer. Then show two natural example sentences and one common mistake to avoid. Ask me to create my own sentence. Do not claim a definition or usage rule is certain if you are unsure; tell me what I should verify in a trusted dictionary.

Teachers should test prompts before using them with a class. A prompt cannot guarantee that a model will follow every instruction, so outputs still need review and learners should know how to question them.

How to evaluate whether the approach is working

Do not judge a vocabulary intervention only by student enjoyment, the number of chatbot messages or the quality of sentences produced while AI is available. Those indicators may help teachers understand engagement, but they do not prove independent learning.

A manageable classroom evaluation can include four measures:

  • Before instruction: a short baseline task covering the target vocabulary.
  • Immediately after: separate receptive and expressive checks, rather than a single combined score.
  • After a delay: a brief retrieval test without AI or notes.
  • Transfer: a new sentence, dialogue or subject-related task that requires learners to use the words in a different context.

Where possible, compare the AI-supported routine with an alternative such as strategic dictionary use, flashcards or teacher-led practice. Keep the target words, time, instructions and assessment conditions as similar as possible. Record the limitations of the comparison, and avoid interpreting a small class-level difference as proof that AI caused an improvement.

For a broader approach to evaluating educational technology, see Prowad’s evidence checklist for AI learning tools. For work on adaptive practice in a different subject and age group, see the study of adaptive learning in primary mathematics.

Safeguards for teachers and schools

For younger learners, use age-appropriate tools and follow school policies on consent, privacy and data protection. Do not enter identifiable student information, sensitive learning records or private writing into an AI service unless the institution has approved that use. Provide a non-AI alternative for students who cannot access the tool or need a different form of support.

Teachers should also check generated examples for cultural appropriateness, bias and linguistic accuracy. If pronunciation is an objective, use a reliable audio source or a qualified teacher rather than relying on text output alone. Make clear to students which uses of AI are permitted, what must be independently completed, and how they should disclose assistance when required.

What the evidence supports—and what remains uncertain

The available studies support a measured conclusion. AI-assisted vocabulary activities can be useful, particularly when they provide responsive examples, scaffolding and feedback. In one study of upper-elementary pupils, AI-supported instruction and strategic dictionary use both improved receptive vocabulary compared with a control group, without a significant difference between the two approaches. Other studies report promising outcomes for AI-assisted dynamic assessment, but their settings and designs limit how broadly the findings can be applied.

The evidence does not justify claiming that AI is always better than a dictionary, that short-term gains guarantee long-term retention, or that findings from one language and age group transfer to all learners. Larger studies, stronger assignment designs, delayed assessments and measures of independent language use are needed.

The most defensible approach is to use AI where its responsiveness adds value, preserve strategic reference skills, require learners to retrieve and produce language themselves, and check learning after the tool is removed. The goal of AI vocabulary learning is not to make explanations effortless; it is to help learners build word knowledge they can use independently.

Further reading and research

Publié le — Laisser un commentaire

PISA 2025 AI Use in Schools: 6 Lessons for Teachers

Teacher supporting secondary-school students as they work together in a classroom, representing critical evaluation of AI-assisted learning.

The question facing schools is no longer whether teenagers use generative AI, but what they use it for—and whether the way they use it helps them learn. The OECD’s PISA 2025 Results, published on 8 September 2026, offers a large-scale view of students’ reported AI use for schoolwork and how different patterns relate to science performance. Its findings are more nuanced than either “AI improves learning” or “AI harms learning.”

The central lesson is practical: access to an AI chatbot is not a learning strategy. Schools need to teach students when to use AI, how to question its answers, and how to demonstrate understanding without it. This article translates the OECD findings into six steps teachers and school leaders can test without treating correlations as proof of cause and effect.

What PISA 2025 actually measured

The OECD asked students how frequently they used AI chatbots for four schoolwork purposes: summarising a text they had to read, conducting preliminary research on a new topic, drafting written assignments, and helping them learn more generally. The report compares these self-reported patterns with student outcomes, including science performance, while accounting for socioeconomic background in several analyses.

That design is useful for identifying patterns across education systems, but it is not a randomised experiment. Students choose whether and how to use AI; the report therefore cannot establish that AI use itself caused a higher or lower score. Prior achievement, access to devices, motivation, teacher guidance and the reason a student reaches for AI may all influence the relationship.

Five findings that matter for schools

1. AI use is widespread, but intensity varies

In most participating countries and economies, a majority of students reported using chatbots for schoolwork. Across OECD countries, only 14% said they never or almost never used AI for any of the schoolwork purposes examined. Yet almost-daily use was reported by only about one in five students on average. Schools should therefore plan for a range of experience rather than assume that every learner is either a confident daily user or a complete beginner.

2. The purpose of use matters more than a simple user/non-user label

The OECD found that students who did not use AI for particular schoolwork tasks generally scored higher than students who did. But the pattern varied by purpose and frequency. For the general purpose “to help me learn,” weekly users had science performance similar to non-users on average after socioeconomic adjustment. Students who used AI moderately for some specific tasks—such as summarising a reading or conducting preliminary research—tended to outperform both limited and very frequent users.

This is not evidence that every student should use AI weekly, nor that moderate use automatically improves results. It shows why “AI use” is too broad a category for policy. Asking a chatbot to complete an assignment, to suggest search terms, to quiz a learner, and to critique a draft are different activities that should not be evaluated as though they were the same intervention.

3. Frequent use is not proof of strong AI literacy

Regular access can make a student familiar with a tool’s interface without teaching them to detect unsupported claims, biased framing or fabricated references. In the OECD data, students’ opportunities to practise evaluating AI-generated information at school were associated with more favourable patterns among frequent learning-oriented users. The association does not establish causality, but it supports a sensible instructional priority: teach evaluation explicitly rather than equating familiarity with competence.

4. Critical evaluation is already part of some classrooms—but not all

Across OECD countries, around six in ten students said that school lessons had asked them to assess the quality of AI-generated information. The share varied substantially across countries and economies. The report also found that students from socioeconomically disadvantaged backgrounds were less likely to report these learning opportunities.

This creates a risk of a new divide. Some students may receive regular coaching in checking AI outputs, while others are left to learn through trial and error outside school. If AI literacy is important, access to critical instruction should not depend on a student’s family resources, device access or prior confidence.

5. Teacher guidance and task design remain essential

The OECD’s wider Digital Education Outlook 2026 makes a related distinction: generative AI can improve the immediate quality of a task without producing equivalent learning gains when it removes the thinking the learner needs to practise. PISA 2025 does not prove a single ideal level of AI use, but it reinforces the need to connect tool use to the learning objective and to give students opportunities to question the information they receive.

Six practical changes teachers can make

1. State the learning goal before allowing a prompt

Before students open an AI tool, name the skill being practised: interpreting evidence, solving a problem, explaining a concept, comparing arguments or planning an investigation. Then decide what assistance is appropriate. If the goal is to practise writing an argument, asking AI to write the argument defeats the task; asking it to identify a counterargument may support it.

2. Require an independent first attempt

Ask learners to write a short initial answer, solve the first step, or record what they already know before consulting AI. The first attempt does not need to be correct. Its purpose is to make the student’s current thinking visible and provide a basis for comparison. For students who need accommodations, allow an appropriate oral response, diagram, speech-to-text or other accessible format.

3. Teach students to interrogate—not merely accept—the output

Give students a repeatable critique routine. They should identify the main claim, ask what evidence supports it, look for an omitted perspective, and mark anything they cannot verify. In science, ask them to distinguish a source’s finding from the AI’s explanation of it. In history, compare the answer with a primary source. In mathematics, test the proposed solution against the original problem.

4. Make source checking visible

Require students to open and read at least one credible source behind an important factual claim. They should record the source, confirm that it actually supports the claim, and note any difference between the source and the AI’s summary. A list of plausible-looking links is not enough: the learner must check that the source exists and says what the response claims.

5. Include a short no-AI follow-up

After AI-supported practice, use a parallel question that students answer independently. A brief exit ticket can reveal whether they can retrieve and apply the idea without the tool. When feasible, repeat a small retrieval task a few days later. These checks should align with the lesson objective and should not be treated as a complete measure of learning on their own.

6. Teach the skill equitably and protect student data

Do not assume that students already know how to use AI responsibly. Demonstrate a weak response, model how to verify it, and let students practise with feedback. Provide a non-AI route when access is limited, and explain what information must never be entered into public tools. Teachers should avoid submitting identifiable student work or confidential school information unless the tool and the institution’s data arrangements have been appropriately approved.

A simple four-week school pilot

Schools do not need to begin with a large platform purchase. A small, well-defined pilot can test whether explicit AI-use guidance improves students’ reasoning and independent performance.

  • Week 1 — Baseline: choose one unit and define the target skill. Collect a short unaided task and record common errors.
  • Week 2 — Teach the routine: model an initial attempt, AI critique, source verification and independent revision. Tell students when AI is allowed and when it is not.
  • Week 3 — Practise: use the routine in two or three lessons. Record the kinds of assistance students request and the errors they catch or miss.
  • Week 4 — Evaluate: compare unaided follow-up work with the baseline, review student explanations and gather teacher observations. If possible, compare with a similar task taught without the AI routine.

Measure learning outcomes, not just logins, time on platform or student satisfaction. If students produce polished work with AI but cannot explain or reproduce the key idea independently, the design needs revision.

What the evidence does not yet tell us

PISA is valuable because it covers many education systems, but its AI-use measures are based on students’ reports and its performance analyses are observational. They cannot tell us exactly what would happen if a school required a particular AI routine, nor can they isolate the effect of each chatbot, prompt or classroom policy. Results for 15-year-olds should not be transferred automatically to younger pupils, adult learners or vocational training.

The safest conclusion is conditional rather than alarmist: AI is neither a guaranteed learning aid nor a uniform threat. Its educational value depends on the task, the student’s behaviour, the guidance provided and whether the learner still has to think, verify and apply knowledge. Schools should use PISA 2025 as a reason to teach deliberate AI use—not as a reason to mandate it for every task or ban it without examining the learning goal.

Related reading on Prowad

Sources and further reading

Publié le — Laisser un commentaire

AI in University Administration: 6 Use Cases and 7 Safeguards

University administrator reviewing digital information on a laptop at a desk

Universities are already experimenting with AI beyond the classroom. The useful question is not whether a chatbot can speed up a task, but which administrative work can be improved safely, measured fairly, and kept accountable to people.

AI in university administration is becoming a distinct area of institutional practice: staff are testing generative AI for routine communication, document handling, research support, reporting, and decision preparation. But the evidence does not justify assuming that every use saves money or improves services. Institutions need to separate plausible use cases from demonstrated outcomes—and low-risk assistance from decisions that can affect a student’s opportunities or rights.

What the latest evidence says

A September 2026 study from UNESCO’s International Institute for Higher Education in Latin America and the Caribbean (IESALC), prepared with the United Nations University Institute for the Advanced Study of Sustainability, surveyed 200 higher-education institutions in 19 Latin American and Caribbean countries. It found that 87% reported using AI in at least one area, while only 26% had a formal AI strategy. The report also found AI use in teaching and learning at 74% of institutions and in research at 57%.

These numbers describe the institutions surveyed, not every university worldwide. The study is a regional snapshot based on institutional responses, and it does not prove that AI adoption itself improves learning, efficiency, or service quality. Its most important signal for administrators is the gap between experimentation and formal strategy.

A peer-reviewed study of 127 administrative employees across three Greek public universities, published in Administrative Sciences in March 2026, found a generally supportive but conditional attitude toward AI. Respondents prioritized ethics and data protection, were more positive about automating specific tasks than about broad claims of organizational performance, and emphasized training and human oversight. Because the study was cross-sectional and based on self-reports, it measures perceptions—not verified productivity gains.

Together, these sources suggest a practical starting point: begin with bounded, repetitive tasks; protect sensitive data; involve the people who do the work; and measure results before scaling.

Six realistic uses of AI in university administration

1. Student-service information and routine enquiries

A carefully configured assistant can help students find published information about office hours, registration steps, campus services, deadlines, and where to direct a request. It can also help staff draft plain-language explanations or translate routine notices for review.

The system should retrieve approved information rather than invent policy. Every answer about deadlines, eligibility, fees, accommodations, or appeals should point to the authoritative page or office. If the question concerns an individual record or an exception, the assistant should route the student to a person instead of pretending it can resolve the case.

2. Drafting and classifying administrative documents

AI can propose first drafts of meeting summaries, internal announcements, standard replies, and procedural checklists. It may also help classify incoming requests so that staff can route them to the right team.

This is assistance, not automatic approval. A staff member should check names, dates, policy references, commitments, and any statement that could be interpreted as an official decision. Institutions should avoid sending confidential records to consumer tools without an approved data-protection and contractual basis.

3. Scheduling and resource coordination

Scheduling teams may use optimization software and AI-assisted analysis to compare room availability, timetable constraints, equipment needs, or service demand. The most appropriate systems are often narrow tools with explicit constraints, not a general chatbot asked to make decisions from incomplete information.

Any proposed schedule needs checks for accessibility, travel time between locations, staff workload, and conflicts that the source data may not capture. A recommendation should be explainable enough for staff to understand why it was made and to override it when local knowledge matters.

4. Research administration and grant support

Research offices may test AI for summarizing funding-call requirements, preparing internal checklists, identifying missing fields in applications, or drafting project-management updates. These uses can reduce repetitive reading, but the official call text and funder’s rules remain authoritative.

AI-generated summaries should link back to the original clause, deadline, or eligibility condition. Researchers and administrators should verify every requirement, especially when a mistake could make an application ineligible. Sensitive research data, unpublished results, and personal information require separate controls.

5. Quality assurance and reporting

AI can help staff organize feedback, summarize open-text survey responses, compare policy documents, or prepare a first draft of a quality-assurance report. It can also help identify questions that require further analysis.

However, a fluent summary can conceal minority views or overstate a pattern. Keep a traceable link to the underlying data, report how responses were selected and summarized, and let a responsible analyst inspect the evidence. Quantitative claims should be reproduced from the source data, not copied from an AI-generated narrative.

6. Decision support—not automated decisions about people

Analytics may help administrators explore service demand, identify bottlenecks, or test different resource-allocation scenarios. But a model’s prediction is not a fact about an individual student or employee. Historical records can encode unequal access, inconsistent past decisions, or missing data.

Do not let a general-purpose AI assistant independently decide admission, progression, discipline, disability accommodations, scholarships, employment, or access to essential services. For consequential decisions, the institution needs a lawful basis, validated methods, meaningful human review, an explanation appropriate to the context, and a route to challenge an error. In the European Union, certain AI uses in education and vocational training are specifically treated as high-risk under the AI Act; classification depends on the intended use, so institutions should consult the official guidance rather than rely on a vendor’s label.

Why efficiency claims need to be tested

AI vendors often demonstrate a task completed quickly. That is not the same as proving that an administrative service became faster, more accurate, fairer, or cheaper overall. Staff may spend the saved time checking hallucinations, repairing errors, handling escalations, or explaining decisions that the system made opaque.

A 2026 bibliometric review of 279 Scopus-indexed articles on AI in higher-education management found expanding scholarly attention and growing interest in generative AI, ethics, and governance. A separate systematic review of institutional approaches to generative AI found considerable variation in the methods and rigor of the studies it assessed. These reviews help map the field, but neither should be treated as a universal estimate of return on investment.

For each pilot, record a baseline before introducing the tool. Compare similar work before and after deployment, and measure both benefits and costs:

  • Time: minutes to complete a case, including human checking and correction.
  • Quality: factual errors, incomplete responses, rework, and complaints.
  • Access: whether different language groups and disabled users can use the service successfully.
  • Workload: whether the tool reduces repetitive work or simply moves it to another team.
  • Trust: whether students and staff understand when AI is used and how to request human help.
  • Total cost: licenses, integration, security review, training, maintenance, and exit costs.

Seven safeguards before a university deploys an AI tool

  1. Define the task narrowly. Write down the user, intended benefit, data inputs, excluded uses, and what the system must never decide.
  2. Classify the risk. Separate public-information drafting from uses involving personal records, student opportunities, employment, health, or other sensitive decisions.
  3. Minimize data. Do not upload identifiable student or staff records unless the institution has approved the tool, purpose, access controls, retention terms, and legal basis.
  4. Keep an accountable owner. Name the office responsible for quality, escalation, monitoring, and suspending the system when problems arise.
  5. Test with real scenarios. Include ordinary cases, edge cases, multilingual queries, accessibility needs, and attempts to elicit unsupported policy answers.
  6. Train users and publish guidance. Explain what the tool can and cannot do, how to verify outputs, how to report errors, and when human review is mandatory.
  7. Plan for change or exit. Check data portability, vendor changes, audit access, incident reporting, and how the institution will continue the service if the tool is withdrawn.

The NIST Generative AI Profile offers a cross-sector risk-management resource for identifying and addressing generative-AI risks. It is not a university-specific legal standard, but its lifecycle approach can help teams document intended use, evaluation, oversight, and ongoing monitoring.

A practical 30–60–90 day pilot

Days 1–30: map and select

Interview frontline staff and student representatives. Map repetitive tasks, their current error rates, and the data they involve. Select one bounded, low-risk workflow—such as drafting replies from an approved FAQ—rather than launching a broad assistant across the institution.

Days 31–60: test in a controlled setting

Use synthetic or appropriately de-identified examples where possible. Compare AI-assisted work with the existing process. Have staff check every output, record failure types, and test whether users can reach a human. Do not scale simply because the demonstration looks convincing.

Days 61–90: evaluate and decide

Review time, quality, access, staff workload, incidents, and total cost with the people who use and receive the service. Publish a short decision note: continue, revise, expand cautiously, or stop. If the evidence is inconclusive, extend the pilot or choose a more measurable task rather than claiming success.

What this means for university leaders

The strongest case for AI in university administration is not a promise to replace professional judgment. It is the possibility of reducing avoidable routine work while making services clearer and helping staff focus on cases that require contextual knowledge, empathy, and accountability.

The latest UNESCO IESALC findings make the implementation gap visible: adoption can spread before formal strategies, governance, and evaluation catch up. Universities should respond by establishing clear ownership and shared rules—not by assuming that informal use is either automatically harmful or automatically beneficial.

For a broader institutional adoption process, see our guide to AI integration in education. For questions about accountability and academic work, read who should govern AI at universities. Teams evaluating a specific product can also use our evidence checklist for AI learning tools and adapt its measurement principles to administrative workflows.

Sources and further reading

Editorial note: Evidence about institutional adoption and staff attitudes is still developing. The workflow and safeguards proposed here are practical recommendations, not a claim that every listed use has already demonstrated causal improvements in university performance.

Publié le

AI and Student Memory: 5 Classroom Practices to Protect Learning

Learner studying with a notebook and laptop, illustrating active recall and AI-supported study

Generative AI can explain a difficult concept in seconds, generate practice questions, and adapt examples to a learner’s level. But a central question for educators is not simply whether AI makes study easier: does it help students remember, explain, and apply knowledge later, when the tool is no longer available?

A 2026 expert-consensus report from the University of Minnesota’s College of Education and Human Development asked 30 learning scientists and education researchers to assess 65 learning processes; consensus was reached on 42. The authors caution that much empirical research on generative AI and learning remains limited in quality, so the report maps expert judgments and evidence strength rather than proving that every AI use harms memory. The practical task for schools is to design activities that preserve the learner’s own effortful thinking while using AI where it adds value.

Why student memory matters when using AI

Learning involves more than producing a correct answer in the moment. Students need to retrieve ideas, connect them to prior knowledge, and use them in new contexts. If a tool routinely supplies explanations or completed solutions before learners attempt the task, students may finish faster without building the same ability to recall or transfer the knowledge independently.

This risk is often discussed as cognitive offloading: using an external tool to carry out mental work. Offloading is not inherently bad. Calculators, dictionaries, and accessibility tools can free attention for more demanding work. The key question is whether the offloaded task is a prerequisite skill the student is expected to learn, or a burden that prevents access to the learning goal.

Claims about AI and memory should be made carefully. Outcomes depend on age, subject, prior knowledge, task design, the quality of feedback, and whether students later practice without assistance. Correlation between AI use and a learning outcome does not by itself establish causation.

Practice 1: Ask students to attempt retrieval before opening AI

Begin a lesson with a brief no-notes question: ask learners to recall a definition, explain a process, solve a problem, or sketch the main steps from memory. Only after this first attempt should they consult an AI assistant.

This sequence gives the teacher evidence of what students can currently retrieve and makes the AI response a resource for comparison rather than a substitute for an initial attempt. The prompt can be simple: “Here is my explanation. Identify what is accurate, what is missing, and what I should verify. Do not rewrite it for me.”

For younger learners, use short oral responses, diagrams, or worked examples. For advanced learners, ask them to state assumptions and justify each step. Retrieval attempts should be low stakes; the goal is practice and diagnosis, not punishment for forgetting.

Practice 2: Use AI for hints, not immediate solutions

Configure classroom prompts so the tool gives one hint at a time. A useful tutor asks a guiding question, points to a relevant concept, or highlights the next decision without completing the whole task.

For example, rather than asking a chatbot to solve an algebra problem, a student could ask: “Ask me one question that helps me decide which operation to use next. Wait for my answer before giving another hint.” Teachers should test these prompts because a language model may still reveal the solution or provide inaccurate guidance.

Hints should fade as competence grows. If a learner is repeatedly stuck, a worked example may be appropriate—but it should be followed by a similar problem completed independently.

Practice 3: Require explanation and verification

After using AI, ask students to explain the answer in their own words and identify the evidence supporting it. In science, they might distinguish observation from inference. In history, they might check a claim against a primary source. In mathematics, they might substitute a solution back into the original equation.

A practical “explain and verify” routine has three parts:

  • Explain: State the reasoning without copying the AI response.
  • Verify: Check important claims against the textbook, teacher-provided materials, calculations, or credible primary sources.
  • Revise: Identify one change made after verification and explain why it was necessary.

This approach also teaches AI literacy: fluent language is not proof of accuracy, and a confident answer may contain fabricated details, omitted assumptions, or outdated information.

Practice 4: Schedule an independent follow-up

A student may understand an explanation while reading it but struggle to reproduce the idea later. Build a short follow-up into the lesson or the next class: ask learners to answer a parallel question without AI, notes, or copied text.

Use more than one time scale where practical. A brief exit ticket can check immediate understanding; a short retrieval question a few days later can help reveal whether knowledge remains accessible. Keep the questions aligned with the intended learning objective rather than testing trivia unrelated to the lesson.

Teachers should interpret results in context. One quiz is not a complete measure of learning, and performance can be affected by anxiety, language demands, disability, or unfamiliar question formats. Combine short checks with discussion, projects, and other appropriate assessments.

Practice 5: Make the learner—not the chatbot—responsible for the final product

When AI is allowed, define which parts of the process students must perform themselves. They might use AI to brainstorm counterarguments but independently choose and defend their position; ask for feedback on a draft but write the revision rationale themselves; or generate practice questions and then answer them without assistance.

Ask students to submit a brief process note describing how they used the tool, what they accepted or rejected, and which claims they checked. The note should be proportionate to the task and should not become a surveillance exercise. Explain expectations before students begin, including privacy rules and any restrictions on entering personal or confidential information.

For related guidance, see Prowad’s articles on AI feedback and student learning and evidence on adaptive learning in primary mathematics.

How teachers can evaluate whether AI is helping

Before adopting a tool widely, run a small, time-limited pilot tied to specific learning goals. Compare student work completed with AI access to later work completed independently, where that comparison is appropriate and fair. Record the task, the support provided, and the criteria used to assess performance.

Useful indicators include:

  • Independent retrieval: Can learners recall the key ideas without the tool?
  • Reasoning quality: Can they explain why a solution works and identify assumptions?
  • Transfer: Can they apply the concept to a new problem rather than repeat the example?
  • Verification: Can they identify and correct unsupported or inaccurate AI claims?
  • Equity and access: Do students with different language, disability, device, or connectivity needs receive appropriate support?
  • Teacher workload: Does the approach improve feedback and learning enough to justify the time required to supervise it?

Do not treat these indicators as a validated universal scale. They are practical questions for local evaluation. If the pilot shows faster task completion but weaker independent explanations, revise the activity before expanding it.

What the evidence does—and does not—show

Research on retrieval practice and feedback provides a strong rationale for asking students to recall and explain knowledge, while research on generative AI in education is developing rapidly. An expert-consensus report can help identify plausible risks and priorities, but it is not the same as a randomized trial demonstrating that a particular classroom routine improves long-term retention.

Schools should therefore avoid two extremes: assuming AI inevitably damages learning, or assuming that more convenient answers automatically mean better learning. The strongest local decisions come from clearly defined learning goals, transparent tool rules, teacher oversight, and evidence from students’ independent work.

A practical lesson sequence

  1. Start with a two-minute retrieval question without AI.
  2. Let students use AI for a limited hint or feedback on their attempt.
  3. Require them to verify at least one important claim or step.
  4. Ask for a short explanation in their own words.
  5. Finish with an independent exit question and revisit the concept later.

This sequence does not require every school to purchase a new platform. It can be implemented with existing classroom materials and an approved tool, or adapted to a no-AI lesson where student privacy or access is a concern.

Conclusion

The educational question is not whether students should always avoid AI or always use it. It is whether the design of the activity leaves learners doing the mental work that the lesson is meant to develop. Retrieval before assistance, hints instead of instant solutions, explanation and verification, delayed independent practice, and clear learner responsibility provide a cautious starting point.

These practices should be treated as research-informed design principles to test—not as a guarantee of improved memory. Schools should monitor independent learning outcomes, review evidence as it develops, and adjust their approach when the results do not support the intended benefit.

Sources and further reading

Publié le — Laisser un commentaire

AI Assessment Design in Higher Education: 7 Evidence-Informed Changes

University students discussing a project together around a laptop, illustrating oral explanation and collaborative assessment

As generative AI becomes a routine part of study, the central question for universities is no longer simply whether students can use it. It is whether an assessment still provides valid evidence of what a student knows, can explain, and can do. AI assessment design should therefore start with the learning outcome—not with a detector or a blanket ban.

The timing is important. On 22 September 2026, the European Commission published a summary of two new reports on digital education. Its review of generative AI says that better task performance does not automatically mean better learning, and that benefits depend partly on whether students actively engage with the content. Separately, the UK Quality Assurance Agency (QAA) reported in July that inconsistent AI rules and practices can create confusion and unequal student experiences. UNESCO’s Institute for Information Technologies in Education is holding a webinar on assessment in higher education on 27 October 2026, reflecting how urgently institutions are rethinking the issue.

This guide turns that evidence into seven practical changes. It does not claim that one assessment model suits every subject; the right design depends on the skill being assessed, student needs, available staff time, and the consequences of an incorrect judgement.

Why AI assessment design needs to change

Take-home essays, coding assignments, reports, and short-answer tasks may still be useful. The problem arises when a task can be completed by a general-purpose AI system but the grade is meant to certify that the student independently possesses the underlying skill. In that case, the submitted product may reveal more about the tool than the learner.

A 2026 systematic review published in Assessment & Evaluation in Higher Education distinguishes “AI-resistant” assessment—which tries to restrict AI access—from “AI-resilient” assessment, which continues to measure meaningful human capability even when AI is available. The review synthesised 47 peer-reviewed studies alongside policy documents and sector reports, and cautioned against treating AI detection as the primary response. That is a useful design lens, not proof that every suggested method works equally well in every discipline.

The QAA’s report, The Perfect Storm: AI, assessment and a sector under pressure, identifies risks involving assessment validity, parity of student experience, trust, foundational skills, and institutional capacity. Its recommendations include substantive training for staff and students, involving student voices in policy, and improving consistency. A clear assignment brief is therefore part of assessment quality—not just an administrative extra.

What recent evidence does—and does not—tell us

The European Commission’s 22 September 2026 summary reports that four in ten EU young people aged 16–24 used generative AI for formal education in 2025. It also notes that only 29.7% of EU teachers surveyed in TALIS 2024 had taken professional development related to AI for teaching and learning. These figures describe use and training in a particular region; they should not be treated as global estimates.

The Commission’s review makes an important distinction: AI may help students perform a task, yet the resulting performance does not necessarily demonstrate durable learning. That finding supports assessments that include explanation, independent transfer, and opportunities to check what learners can do without assistance when unaided competence is itself a course outcome.

There are limits. Research on fast-changing AI tools is developing, and findings from one discipline or institution may not transfer directly to another. A July 2026 workshop report from computing educators documents practical strategies such as oral and interactive assessment, process evidence, rubric redesign, and evaluating AI-produced work. The authors explicitly describe it as a report of professional discussion rather than a controlled research study. Use such examples as ideas to pilot, not as proof of impact.

Seven evidence-informed changes to assessment design

1. Start with the capability the grade is meant to certify

Write the learning outcome in observable terms before deciding whether AI should be permitted. Is the student expected to recall core knowledge, interpret evidence, solve a problem, communicate a recommendation, or collaborate effectively with AI? These are different capabilities and may need different evidence.

For each outcome, state what counts as acceptable evidence. If students must learn to calculate a result by hand, include a suitable unaided task. If the goal is to evaluate AI-generated analysis, then tool use can be part of the assessment—but students should still demonstrate that they can judge its quality.

2. Make the rules specific to each task

A single course-wide sentence such as “AI is allowed” or “AI is prohibited” leaves too much open to interpretation. Tell students which uses are allowed for each assessment: brainstorming, language editing, coding assistance, generating a first draft, or producing the final answer. State whether students must disclose use, retain prompts or outputs, cite generated material, or submit a brief process note.

Explain the educational reason behind the rule. A no-AI task may be appropriate when independent performance is the outcome; an AI-permitted task may be better when professional practice includes tool use. Consistency does not mean identical rules for every assignment. It means that differences are deliberate, visible, and connected to learning goals.

3. Collect a small amount of process evidence

Instead of grading only the final submission, ask for a proportionate trace of how the work developed: an initial plan, selected sources, a draft, a revision note, test results, or a short explanation of a major decision. Choose evidence that helps you judge the learning outcome, not a large paperwork burden.

Process evidence is not a perfect authorship detector. Drafts and notes can also be generated or edited with AI. Their value is that they create useful moments for feedback and make the student’s decisions discussable. Tell learners in advance what to save and how it will be assessed.

4. Add a short oral or interactive check where it matters

A brief conversation can reveal whether a student understands a claim, method, calculation, design choice, or limitation in their submitted work. Ask the student to explain one decision, interpret a changed scenario, or identify what would make their conclusion unreliable.

Oral checks need careful implementation. Extemporaneous speaking can disadvantage students with language, disability, or anxiety-related needs, and individual interviews may not scale to large cohorts. Offer accessible alternatives—such as recorded explanations, structured written responses, demonstrations, or small-group questioning—and use a common rubric. The goal is to check understanding, not to reward confidence or accent.

5. Ask students to critique and improve AI output

In suitable subjects, provide a deliberately imperfect AI-generated answer, explanation, code sample, lesson plan, or evidence summary. Ask learners to identify errors, verify claims against sources, test the output, explain why a proposed solution fails, and produce a corrected version.

This can assess judgement that matters in real work. But students must have enough subject knowledge to recognise a plausible mistake; otherwise the task rewards guesswork. Require references to course concepts, data, tests, or authoritative sources rather than accepting “the AI was wrong” as an explanation.

6. Use authentic tasks with meaningful choices and constraints

Give students a real or realistic problem with a specific audience, context, dataset, case, or constraint. Ask them to justify the question they chose, explain trade-offs, and adapt their work when a condition changes. A local case study or unfamiliar dataset can make the reasoning more visible than a generic prompt.

Authenticity alone does not make an assignment AI-proof. Models can generate plausible case analyses and project plans. The stronger design asks students to make consequential decisions, support them with evidence, and respond to follow-up questions. Keep the task achievable and provide enough scaffolding so that openness does not simply increase confusion.

7. Grade reasoning, verification, and transfer—not polish alone

Rubrics should distinguish the quality of the final product from the quality of the thinking that supports it. Depending on the discipline, criteria might include accuracy, evidence selection, reasoning, testing, acknowledgement of uncertainty, revision in response to feedback, and the ability to apply a principle to a new case.

Do not make “AI use” a vague penalty or bonus. If using AI is allowed, assess whether the student chose an appropriate use, checked the result, and took responsibility for the final work. If AI is not allowed for a particular task, explain the conditions and the evidence that will be used to assess performance. Share examples of strong work and borderline cases so that students can interpret the rubric.

A practical assessment blueprint

For a course built around a research report, for example, an instructor could combine:

  • Early diagnostic: a short low-stakes task to check essential concepts before students begin the project.
  • Milestone: a research question, source log, or draft argument with feedback.
  • Final product: the report, solution, or artefact, assessed against transparent subject-specific criteria.
  • Verification: a brief oral explanation, demonstration, or structured response to a changed scenario.
  • Reflection: a short note identifying a consequential revision, a limitation, and how evidence was checked.

This is an illustrative sequence, not a validated universal formula. Adjust the components and weighting to the course outcomes, cohort size, accessibility needs, and workload. Avoid adding every component to every task; one well-chosen checkpoint may be more useful than a burdensome portfolio.

How to pilot changes without overwhelming staff

  1. Choose one high-stakes assignment. Identify where the submitted product may no longer provide convincing evidence of the intended capability.
  2. Map the outcome to evidence. Decide what students must demonstrate and which parts, if any, may use AI.
  3. Rewrite the brief and rubric together. Add examples, disclosure rules, permitted uses, and accessible alternatives.
  4. Run a small pilot. Ask a colleague to review the instructions; collect student questions and note where grading becomes difficult.
  5. Review learning evidence. Compare the quality of reasoning, performance on follow-up tasks, student experience, marking time, and differences in access to tools. Do not treat satisfaction or faster completion alone as proof of learning.

Institutions can build on their existing AI evaluation work. See Prowad’s evidence checklist for evaluating AI learning tools and its five-step framework for institutional AI integration. For the learning side of the problem, the article on AI chatbots and higher-order thinking in STEM explores how prompts can support explanation and reflection rather than simply deliver answers.

What institutions should avoid

  • Relying on AI detectors as decisive proof. Detection is not a substitute for valid assessment design, transparent rules, and fair procedures.
  • Assuming every student has equal access. Paid tools, device quality, internet access, disability accommodations, and familiarity with prompting can affect performance.
  • Confusing a polished submission with deep learning. Include evidence that matches the capability being certified.
  • Making every task an oral exam. Use multiple, accessible forms of evidence and consider staff workload.
  • Changing rules without student input or training. Explain the purpose of the assessment and provide a consistent course-level approach.

Conclusion: design for valid evidence, not a race against AI

The most durable response to generative AI is not to keep inventing tasks that a model cannot complete today. It is to ask what knowledge and judgement learners must develop, then gather evidence that those capabilities are genuinely present. Some outcomes require unaided practice; others benefit from transparent AI collaboration. Good assessment makes that distinction explicit, combines appropriate evidence, and remains fair to students with different needs and resources.

As the European Commission, QAA, and UNESCO discussions indicate, this is a pedagogical and institutional challenge as much as a technical one. Start with one assignment, make the intended learning visible, and evaluate whether the redesign improves the quality of evidence—not merely whether it makes AI use harder.

Further reading and sources

Publié le — Laisser un commentaire

AI Training at Work: What a 2,574-Employee Trial Found

Professionals discussing a workplace training activity in an office meeting

Workplace training platforms increasingly promise to personalise learning: diagnose a skills gap, serve the next activity, and adapt the path as an employee progresses. But does adaptive delivery improve learning, or does it simply make training feel more modern? A 2026 field experiment involving 2,574 utility employees offers a useful, qualified answer. The results are encouraging, but they also show why organisations should measure knowledge and transfer—not just completion rates or user satisfaction.

This article examines the study, explains what it can and cannot establish, and proposes a practical evaluation plan for organisations considering AI training at work.

What the 2026 workplace-training study tested

Tang and colleagues reported a three-wave, matched-pair cluster-randomised field experiment in six county-level power-supply companies within one Chinese provincial electric utility. Of 3,000 employees invited, 2,574 were included in the analysis. Participants received either knowledge-graph-driven adaptive training or traditional uniform training covering the same syllabus.

The adaptive system used learner-related information to route participants through training content. The researchers assessed training self-efficacy, knowledge and intention to transfer what was learned to work. Knowledge and transfer intention were measured again at a six-week follow-up. The study appeared in Frontiers in Psychology in 2026.

Main finding: the adaptive-training group showed small advantages in training self-efficacy, intention to transfer learning, and knowledge. The reported standardised effects were approximately 0.26 for self-efficacy, 0.25 for transfer intention, and 0.29 for knowledge at the second measurement. At six weeks, the knowledge advantage remained around 0.26 standard deviations.

These are modest effects, not evidence that AI transforms every training programme. In practical terms, the results suggest that a well-designed adaptive system may improve some learning outcomes, but organisations should not promise large productivity gains on the basis of this single study.

Why the findings matter for AI training at work

Workplace learning differs from a school lesson. Employees need to remember procedures, diagnose problems, make decisions under real constraints, and apply skills after the course ends. A training system that personalises the next lesson is useful only if the learner gains knowledge that can be used safely and reliably on the job.

The study is notable because it examined employees in a real utility context rather than relying solely on student samples or laboratory tasks. Its follow-up also moves beyond immediate reactions to a training session. However, the measured outcome was knowledge at six weeks—not a direct audit of workplace performance, error rates, safety incidents or organisational productivity.

For organisations, the most defensible interpretation is therefore narrow: this particular adaptive training package was associated with small, persistent knowledge advantages in the studied setting. Whether the same result would occur in retail, healthcare, manufacturing, public administration or remote knowledge work remains an empirical question. For a broader view of how AI may support workforce skills systems, see our guide to AI in vocational education and training.

What may explain the benefit?

1. Less unnecessary cognitive load

The researchers found that the adaptive condition was associated with lower extraneous cognitive load, with a reported effect of about −0.34 standard deviations. Extraneous load refers to mental effort caused by avoidable features of instruction—for example, confusing navigation, irrelevant material or a poor sequence of activities. Reducing this burden can leave more capacity for the skill being learned.

But cognitive load is not one simple quantity. The study also found a higher intrinsic-load measure in the adaptive condition. That is a reminder that demanding content may still require effort; the goal is not to make every task effortless, but to remove avoidable friction while preserving the thinking needed to master the skill.

2. A better fit between content and the learner

Perceived personalisation fit was also associated with favourable outcomes. Employees may engage more when the content feels relevant to their current capability and job needs. Yet a system should not confuse personalisation with continually giving a learner easier work. A useful pathway can revisit foundational skills, introduce appropriately difficult scenarios, and require the employee to demonstrate competence before moving on.

3. A structured learning pathway

The intervention combined adaptive routing with a particular delivery system. The authors explicitly note that the comparison cannot isolate the effect of the algorithm alone: the adaptive and uniform conditions differed in delivery medium as well as routing. The observed result belongs to the package as tested, not to personalisation as an abstract feature.

Six questions to ask before buying an adaptive training platform

  1. What skill is the system meant to improve? Define the job task and the observable standard before choosing a platform. “AI-powered learning” is not a learning objective.
  2. Does it diagnose a meaningful gap? Ask what evidence drives the next activity: a knowledge check, demonstrated performance, self-report, or an opaque prediction. Weak inputs can produce confidently personalised but unsuitable pathways.
  3. Does it preserve productive difficulty? The system should provide scaffolding without removing the practice, retrieval and decision-making that the employee must later perform independently.
  4. Can learners and trainers understand the pathway? Employees should know why an activity was assigned and how to request a review. Trainers need a way to correct mistaken recommendations.
  5. What happens to learner data? Establish what is collected, who can see it, how long it is retained, whether it is used in employment decisions, and how employees can challenge inaccurate records.
  6. Is there evidence beyond completion and satisfaction? Require a baseline measure, a comparable assessment, a delayed follow-up and—where feasible—an independent measure of job performance.

These checks complement Prowad’s broader evidence checklist for evaluating AI learning tools. The setting differs, but the central principle is the same: assess the learning outcome and the risks, not merely the feature list.

A practical evaluation plan for employers and training teams

Organisations do not need to begin with a large, expensive deployment. A small pilot can test whether the proposed system helps a defined group learn a specific task.

Step 1: Define a job-relevant outcome

Choose one capability, such as troubleshooting a routine fault, applying a compliance procedure, or handling a customer scenario. Set a clear performance rubric and record the starting level. If the target is safety-critical, involve the relevant technical and safety specialists in defining the standard.

Step 2: Compare like with like

Where feasible, compare adaptive training with the current programme using the same learning objectives, time allowance and assessment standard. Random assignment is stronger than comparing volunteers with non-volunteers, because the groups may differ before training begins. If randomisation is impractical, document the differences and avoid treating the comparison as definitive causal evidence.

Step 3: Measure three stages

  • Immediate learning: Can participants answer questions or demonstrate the skill after training?
  • Retention: Can they still retrieve and apply the knowledge several weeks later without the platform supplying the answer?
  • Transfer: Can they perform the relevant task in a realistic work setting, with appropriate supervision and safety controls?

Completion, time-on-task and satisfaction can help explain participation, but they are not substitutes for these outcomes. For a related discussion of feedback design, see why AI feedback is not the same as learning.

Step 4: Check who benefits—and who does not

Average results can conceal unequal experiences. Examine outcomes by role, prior experience, language needs, disability-related access requirements and starting skill level where it is lawful, ethical and statistically appropriate to do so. The study reported exploratory differences by experience, with larger benefits among more experienced employees. That finding should be treated as a hypothesis for replication, not a universal rule for designing training.

Step 5: Set a decision rule before the pilot

Agree in advance what level of improvement would justify the cost and what safety, privacy or fairness problems would stop the deployment. Include trainer time, integration, maintenance, accessibility and employee support in the cost calculation. A system that produces a small test-score gain but adds substantial administrative burden may not be the best option.

What the evidence does not yet prove

Several limitations matter. First, the trial was conducted in six companies within one provincial utility in China. It does not establish that the same effects will generalise to other sectors, countries, languages or organisational cultures. Second, the adaptive and comparison conditions differed in delivery medium as well as routing, so the study cannot attribute the entire effect to the adaptive algorithm. Third, the reported knowledge outcome at six weeks is not the same as independently observed job performance or long-term organisational impact.

More broadly, the 2026 scoping review by Pham and colleagues mapped 59 studies of AI and data-supported workplace learning. It describes uses such as skill-gap analysis, personalised training, feedback and recommendations, while highlighting fragmented systems, data-governance concerns and the need for more longitudinal and experimental evidence. The literature is developing, but it is not yet a licence to treat every AI-enabled learning feature as proven.

For context on how AI intersects with formal skills development, the OECD’s 2026 report on AI in vocational education and training examines the implications for curricula, qualifications and occupational standards. Organisations should connect their own training experiments to those wider workforce and qualification requirements rather than treating software adoption as a strategy in itself.

Conclusion: buy evidence, not the word “adaptive”

The 2,574-employee field experiment provides a useful signal: a particular knowledge-graph-driven adaptive training package produced small advantages in knowledge and related training outcomes, with the knowledge difference still present at six weeks. Its real value is not a blanket endorsement of AI training, but a clearer set of questions about personalisation, cognitive load and evaluation.

For employers, the practical next step is to pilot one job-relevant skill, compare outcomes fairly, check retention and transfer, protect employee data, and scale only when the benefits justify the cost. AI can help organise practice; the organisation remains responsible for ensuring that employees can perform the work.

References and further reading