Evenely
Back to blogFormación

How to create questions that assess understanding, not just memory

Equipo EvenelySeptember 7, 20269 min read

Remembering a definition can be useful, but it does not prove that someone can recognise a situation, select a criterion or apply what they have learned. In training, the difference between a memory question and an understanding question lies in the mental action it requires.

Questions that make people think

A good question does more than verify whether someone knows the answer. It makes visible how they interpret information and which criterion they use to decide.

Memory and understanding are not the same

Recall questions ask people to retrieve a fact: a date, a name, a step or a definition. They are useful when that fact must be readily available, but they reveal little about the ability to use it.

Memory question

What is the required response time for a high-priority incident?

Understanding question

A customer reports an incident that blocks a critical task. What should you do first, and why?

The second question may still involve the response time, but it requires the learner to recognise the context, prioritise and apply a process. This reveals deeper understanding as well as possible errors in judgement.

Six changes that improve a question

1. From repeating to applying

Instead of asking for a definition, present a situation in which the idea is needed. The learner must identify when it applies and what could happen if it is used incorrectly.

2. From recognising words to distinguishing criteria

Two options may appear reasonable, but only one uses the correct criterion. The challenge should come from understanding the difference, not from decoding confusing wording.

3. From generic cases to recognisable contexts

Include only the information someone would need at work: the objective, a constraint, a relevant fact and a possible consequence. Context should add meaning, not noise.

4. From absurd distractors to plausible mistakes

The most useful wrong answers represent real misunderstandings: skipping a step, prioritising the wrong indicator, acting too early or treating an exception as the rule.

5. From one answer to a sequence

A first decision can lead to a second question: what information is missing, how the decision should be communicated or what would change under a new constraint.

6. From correcting to explaining

Feedback should clarify the criterion rather than merely display “correct” or “incorrect”. A hint, a consequence or a reflective question can help before the full solution is revealed.

Before-and-after examples

Instead of askingTry askingWhat it reveals
What does active listening mean?Which response would best show that you understood the customer's concern?Application of the concept.
What are the stages of the process?The team has validated the information but has not assigned owners. Which stage is still incomplete?Recognition of the sequence.
What is personal data?Which of these files requires the greatest care before it is shared, and why?Classification and judgement.
What is the returns policy?A customer requests an out-of-window return because of a documented defect. What information should you check before replying?Use of rules and exceptions.

Formats that assess understanding

Decision scenario

Present a short situation and ask for the most appropriate action.

Put steps in order

Checks whether the learner understands the logic of a sequence.

Spot the error

Show an imperfect action and ask what should be changed.

Compare alternatives

Requires the learner to weigh benefits, risks or conditions of use.

Choose a justification

Separates a lucky guess from a decision based on the right criterion.

Add a new constraint

Checks whether the learner adapts when the context changes.

How to write useful answer options

  • Make every option plausible: an obviously silly answer does not assess understanding.
  • Keep options similar in length: the correct answer should not stand out visually.
  • Avoid grammatical clues: every option should fit the question stem.
  • Link each error to a misconception: this makes the results actionable.
  • Do not turn the question into a trap: precision should come from the criterion, not from an ambiguous word.

Feedback is part of the question

When someone makes a mistake, the system response can invite them to review the decision. Instead of immediately revealing the solution, it can show a consequence, highlight a relevant fact or ask a supporting question.

Example of progressive feedback

“This option resolves the immediate urgency, but leaves the team without information that could prevent a repeat. Which step would you add before closing the incident?”

Which data is worth analysing

Accuracy is only the starting point. It can also be useful to examine which distractors are selected, how many attempts are needed, which hints are opened and where response time rises. These patterns can reveal confusing content and shared misconceptions.

An important caution

A single question should not be used to draw broad conclusions about a person. In training, results are primarily useful for guiding feedback, improving content and offering further practice.

Checklist

  • Does the question require application, comparison, interpretation or justification?
  • Does the context contain only the information that is needed?
  • Do the incorrect options represent real mistakes?
  • Is one answer clearly better according to a defined criterion?
  • Does the feedback explain that criterion?
  • Are the wording and format accessible?

From content to decision

When a question requires the learner to use a criterion, it stops being a simple memory check and becomes a learning opportunity.

With Evenely, you can create quizzes, scenarios and feedback journeys through the subscription editor, or commission a fully tailored experience.