Recommendations for researchers

For researchers wanting to embed EDI in usability research we recommend that they are guided by three key principles: (1) they should ensure participants feel a sense of value, (2) they need to establish trust, and (3) they need to enable agency so that participants feel in control and are able to make their own decisions. Researchers need to consider these principles when setting up and planning the usability test, during the test and post-session after the usability test has been completed.

Sense of value

• Explain how your study adds value and could benefit participants and or the wider community. When: Set up and planning.

• Recognise participants' expertise. Make clear the value the participant adds to the study. When: Set up and planning, During session, and Post-session.

• Recognise the full time and effort of participation: offer compensation and pay expenses. When: Set up and planning, and Post-session.

• Include participants in the study design, including setting study objectives and usability tasks. When: Set up and planning.

• Learn from your participants about the experience of taking part in your study. When: Post-session.

Establish trust

• Enable participants to validate both the study and research team by providing comprehensive information upfront. When: Set up and planning.

• Be transparent in everything you do. For example, explain why participants are or are not selected. When: Set up and planning, During session, and Post-session.

• Use simple and clear language for all communication. Carefully structure documents and other information sources. When: Set up and planning, During session, and Post-session.

• Keep participants safe. Inform them about the available support and your safeguarding procedures. Check that participants are comfortable during and after the study. Be ready to intervene if a user feels unsafe. When: Set up and planning, During session, and Post-session.

• Keep checking for consent and do not change the goal posts. When: Set up and planning, During session, and Post-session.

Enable agency

• Enable participants to decide if the study is accessible by providing upfront information on practicalities and what can be adjusted. Give users the opportunity to say what they would like. When: Set up and planning, During session, and Post-session.

• Use simple and clear language for all communication. Carefully structure documents and other information sources. When: Set up and planning, During session, and Post-session.

• Tell participants in advance what is going to happen, so they have time to plan and that there are no surprises. When: Set up and planning.

• Provide opportunities for questions. When: Set up and planning, During session, and Post-session.

• Be flexible, offer meaningful choices and do this from the start. When: Set up and planning, During session, and Post-session.

• Allow participants to change how they participate throughout the study. When: Set up and planning, During session, and Post-session.

• Design studies so that participants can take their time. Factor in breaks. When: Set up and planning, and During session. 

Please feel free to use and share these recommendations. When doing so we would appreciate that you cite this source: Rutter, S., Zamani, E., McKenna-Aspell, J., & Wang, Y. (2024). Embedding equality, diversity and inclusion in usability testing: recommendations and a research agenda. International Journal of Human-Computer Studies, 103278.