This standard is about devising user tests and analysing, evaluating and reporting the data obtained from them. This is likely to be an iterative process during development of interactive media projects.
Interactive media projects can involve any type of interactive media content, products or services for multi-platform or multi-channel use, including, but not restricted to, games, websites, applications or online marketing campaigns and can also include the use of immersive technology. (Immersive technology can include, but is not restricted to, Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR).)
This standard is for anyone involved in user testing of interactive media projects.
Performance criteria
You must be able to:
Obtain current project information required for user testing
Carry out a thorough analysis of project information to identify which aspects of projects are to be tested
Specify assessment criteria which will meet project requirements
Select testing methods, tasks and activities which can generate valid data and which meet project parameters
Decide how test data is to be collected and design appropriate data collection instruments
Devise ways to mitigate factors which may affect test results
Specify end-user samples which are representative of target audiences and will provide sufficient valid test data
Select and recruit appropriate test observers or facilitators to meet testing requirements
Prepare clear instructions with relevant information for all the people involved
Collate test results
Analyse and evaluate test results against assessment criteria to identify issues and problems
Rate issues and problems for severity, ease of fixing and impact on projects
Document your findings in an appropriate format for circulation to relevant colleagues
Knowledge and understanding
You need to know and understand:
the range of data that can be tested including useability, quality, fitness for purpose, overall design, integration of design elements
how to obtain information about projects and parameters including design objectives, client requirements, design constraints, functional specifications, functionality, features, target audience
the principles of interaction design and issues of usability and accessibility including the use of real-time animation
how to obtain and analyse project information to identify end-user characteristics, requirements, expectations, tasks and goals
ethical issues relating to user testing including privacy, confidentiality, diversity, inclusivity, accessibility, emotional intelligence and behavioural psychology
the features, benefits and disadvantages of low-tech techniques for conducting usability tests including questionnaires, interviews, focus groups, surveys, user observation
how to prepare test scripts, interview questions and survey forms
the features, benefits and disadvantages of high-tech automated techniques for conducting usability tests including eye-tracking, server logs, analytics and other scripted processes
the role of test observers and facilitators and when it is appropriate to use them
information required by test observers and facilitators including test objectives, assessment criteria, and their role in the process and why it is important to brief them
how to produce instructions for end users which contain sufficient information for them to carry out tests without unnecessarily influencing results
what factors may affect test results including equipment, environment, clarity of task instructions, leading questions, awareness of being observed
collation, analysis and evaluation techniques for qualitative and quantitative data
project reporting formats and who needs to receive them
how to write a well-researched and clearly worded report
Overview
This standard is about devising user tests and analysing, evaluating and reporting the data obtained from them. This is likely to be an iterative process during development of interactive media projects.
Interactive media projects can involve any type of interactive media content, products or services for multi-platform or multi-channel use, including, but not restricted to, games, websites, applications or online marketing campaigns and can also include the use of immersive technology. (Immersive technology can include, but is not restricted to, Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR).)
This standard is for anyone involved in user testing of interactive media projects.
Performance criteria
You must be able to:
Knowledge and understanding
You need to know and understand: