At what point should assistance be authorized?
Track 01 · Managers and Business Leads · English edition
What you will learn to do
organize access to the tool according to the skill the activity seeks to develop.
Fictional pedagogical case: a premium services company is preparing to automate its refunds.
The course
A training manager is preparing an exercise on an ambiguous case. She is hesitating between allowing the assistant immediately and prohibiting it for the entire session.
The choice depends on the objective. If she wants to observe the participant's ability to formulate an initial analysis, immediate access to a complete answer may make this observation difficult. If she wants to evaluate their ability to verify an automated proposal, the presence of the tool is part of the exercise.
Time without assistance must therefore serve a precise function. It is not intended to make the task painful. It allows for the collection of initial reasoning or the verification of a skill necessary for human takeover.
An activity can begin with a short individual decision. The participant notes the rule they would use and the information they are missing. They then consult the assistant and explain the changes made to their answer.
The trainer can distinguish a justified correction from simple alignment with the tool. They examine what caused the decision to change: a source found, an inconsistency spotted, or solely the confidence of the produced text.
The setup must remain compatible with the participants' needs, particularly accessibility adaptations. The use of technical aid must not be confused, without examination, with the delegation of the reasoning being evaluated.
Your decision
You want to evaluate the choice of a reimbursement rule. Define a period of individual work, followed by a useful use of the assistant.
Formulate an answer before opening the answer key.
Open the reasoned answer key
First, ask for a proposed rule and a brief justification. Then, allow the assistant to search for relevant passages. The participant submits a revised decision, indicating which element changed their analysis.
The activity makes the evolution of reasoning observable. Its duration and modalities will be adjusted after testing.
Production to keep
moment of assistance and competence observed before its use.
Evaluation criterion
The participant explains what changed their reasoning.
Sources and references
- UNESCO, Guidance for Generative AI in Education and Research, 2023
- Roediger and Karpicke, Test-enhanced learning, 2006
- McDaniel, Roediger and McDermott, Generalizing test-enhanced learning, 2007
The case and the answer key are VOCE pedagogical constructions; the references do not validate the effectiveness of this training.