LEARNING / ASSESSMENT DESIGN
Beyond course completion: assessing technology-risk judgement.
A completion record tells a manager that an employee finished a course. A separate question is whether the assessment gives useful evidence of how that person would approach a relevant decision. This guide proposes a way to review that evidence without treating a quiz result as proof of workplace behaviour.
Start with a decision employees actually face.
Choose a situation relevant to the audience, such as an unexpected message asking for an action. Define the judgement being assessed before choosing a question format. Is the learner expected to notice a warning sign, select an approved response or identify when more information is needed?
Ask the relevant subject owner to approve the response and its explanation. The learning team should not invent a security procedure to make an exercise easier to write.
Look at recognition, action and explanation.
A review can separate three elements: what the learner noticed, what action they selected and why that action fits the situation. These are proposed assessment-design questions, not claims about the outcomes of a particular course.
- Recognition: which details matter to the decision?
- Action: which option follows the approved procedure?
- Explanation: what makes that option appropriate here?
For example, a fictional activity might ask a learner to select a response and then identify the evidence behind it. Feedback should connect the reasoning to approved material rather than simply repeat “correct” or “incorrect”.
Check whether the question tests the intended skill.
Try the activity with representative reviewers. Ask whether the scenario contains enough context, whether more than one answer could reasonably be defended and whether the wording introduces irrelevant difficulty.
For multilingual courses, review meaning, terminology and answer rationale across versions. Agree how ambiguous questions will be corrected and how policy changes will trigger updates.
Keep different kinds of evidence separate.
Completion, answers, explanations and observations of workplace practice answer different questions. Report each according to what was actually captured. Do not turn a course pass rate into a claim that incidents decreased or that all employees now act safely.
Any wider evaluation needs a defined scope, appropriate evidence and a clear account of its limitations. Learning-record and assessment-reporting capabilities should be confirmed against the organisation’s actual platform.
A practical starting point.
Select one existing activity. Write down the decision it tests, the evidence needed to answer it and the approved explanation. If reviewers disagree, resolve the ambiguity before expanding the question bank.
Explore the related technology-risk learning design example ↗