Evenely
Back to blogRecruitment

Accessibility in gamified experiences: how to avoid leaving participants behind

Equipo EvenelyJuly 22, 20268 min read

A gamified assessment can help observe how someone makes decisions, prioritises information or responds to a professional situation. Its game-like appearance, however, does not reduce the organisation’s responsibility when the resulting data influences an employment decision.

Design principle

The goal is not to collect everything technology can measure. It is to use only the data needed to assess defined, explainable criteria related to the role.

Note: these are general design and governance criteria. Each process requires review based on its country, purpose and technology.

What data can an assessment generate?

Beyond answers, a digital experience may record timing, decision order, changes, scores, technical data, candidate-generated content and inferences about competencies.

Access data

Identity, email, device and technical logs.

Activity data

Answers, timing, attempts, changes and decisions.

Derived data

Scores, rankings and professional inferences.

These signals do not all have the same value. Response time may reflect language, accessibility, connection or device rather than the competency being assessed.

Twelve principles for a responsible process

1. Define the purpose of each data point

Document the competency, indicator, relationship to the role, access, retention and influence on the decision.

2. Apply data minimisation

Collect only what is necessary. Storing every click or second increases risk without automatically improving selection quality.

3. Inform candidates clearly

Explain who runs the assessment, what is collected, why it is used, whether automated analysis is involved, retention and support channels.

4. Do not treat a checkbox as a universal solution

Taking part does not mean accepting every future use. Secondary purposes must be defined and assessed separately.

5. Maintain meaningful human review

Reviewers must understand the score, identify anomalies, consider alternative explanations, correct errors and be able to override the system.

6. Validate what the assessment measures

Justify why tasks and metrics represent role competencies, and avoid turning weak signals into complex personality claims.

7. Look for bias in content and scoring

Review cultural references, language, speed, technology requirements, historical data and apparently neutral variables that may disadvantage groups.

8. Avoid invasive or weakly validated inferences

Treat voice, face, emotion, non-verbal behaviour and sensitive data with particular caution. Apparent precision is not proof of validity.

9. Evaluate the provider

Check hosting, subprocessors, security, data reuse, deletion, technical documentation, incident handling and audit capabilities.

10. Define retention periods

Separate access data, responses, reports and security logs. When the purpose ends, delete or effectively anonymise the data.

11. Allow correction and challenge

Provide a channel for interruptions, data errors or adjustment needs. A technical incident should not become a permanent exclusion.

12. Design an accessible experience

An assessment that relies on speed, sound, precise vision or one device may create inequality even if it processes everyone’s data in the same way.

An explainable decision chain

  1. Objective: the competency or knowledge to observe.
  2. Activity: the situation that produces relevant evidence.
  3. Data: the answer or behaviour recorded.
  4. Interpretation: what can and cannot be concluded.
  5. Review: who validates the result and considers context.
  6. Decision: how it combines with other evidence.

Checklist before using the assessment

  • Every data point has a documented purpose.
  • Candidates understand what is assessed and how data is used.
  • Speed matters only when relevant to the role.
  • Important decisions include effective human review.
  • Bias, accessibility and technical conditions have been tested.
  • Retention, security and deletion rules are defined.
  • There is a channel for incidents, corrections and review.

Responsible technology

A gamified assessment can provide useful evidence without becoming a black box. Responsible design connects every mechanic, data point and decision to a clear purpose.