Usability Testing Planning a usability test Lab Outline

Usability Testing Planning a usability test

Lab Outline ● ● ● Review difference between heuristic evaluations and usability tests Complete a usability test using a test script and think aloud protocol Complete a usability questionnaire Recap assignment 1 usability testing sections Review what methods may suit different objectives Learning Objectives ● Understand aspects of usability testing ● Be able to carry out a basic usability evaluation ● Be able evaluate the effectiveness of different usability testing methods for different contexts

Heuristic Evaluations VS Usability Testing Heuristic Evaluation ● ● ● ● Evaluation by expert Reviews against best practice Experts understandards for usability Cheaper than usability testing Quicker than usability test Not all usability issues relate to heuristics Doesn’t tell us which problems users face most often Not real end users Usability Testing ● ● ● Testing on real users Video of issues can be compelling Often reveals problems experts and developers never consider Need to carefully choose focus of usability testing More expensive than heuristic evaluation Takes more time to complete Usability testing vs expert reviews: https: //www. uxmatters. com/mt/archives/2009/10/usability-testing-versus-expert-reviews. php

Usability Testing A light-hearted overview of usability testing: https: //www. youtube. com/watch? v=3 Qg 80 q. Tfzg. U

Testing and evaluation methods depend on: ● ● ● Time Budget Stage in development How quickly team needs results Functions you are evaluating What your team wants to find out

Think Aloud Protocol ● Shows thought processes of user ● Users verbalise tasks not opinion of site ● Can bring hidden thoughts out into the open https: //www. youtube. com/watch? v=n. J 2 ud. Ljdsx 4

Task: Practice Usability Test - www. coggle. it In a group of 2 or 3: ● Carry out a basic usability test using think aloud protocol ● Use the script provided below to introduce the test Website: coggle. it Scenario: You want to use coggle. it to create a ‘mindmap’ of what is required in Assignment 1; you are especially interested in brainstorming all of the details in the test plan section. Script: https: //www. sensible. com/downloads/test-script. pdf

Think Aloud Prompts If the user forgets to think aloud, encourage him/her to do so by saying: ● ● ● What can you do here? What are you doing now? What just happened? Is that what you expected to see? What did you see first? What caught your eye? Taken from a test plan that uses think aloud protocol.

WAI Site Usability Testing Questions Complete the following Google Form: https: //goo. gl/forms/sr. Rco 4 Uln 4 m. Xu. Xq. F 3 This is the questionnaire from the lecture slide. Fill it out and reflect on how useful it would be for the evaluation we’ve just completed and the site we are using for the assessment.

Questionnaire WAI Site Usability Testing Questions: https: //www. w 3. org/WAI/EO/Drafts/UCD/questions. html Complete on Google Form: https: //goo. gl/forms/3 x 9 Ou. Yfl. LHEBVpbx 1

Post Test Survey For our last activity I'm going to give you a short questionnaire that I would like you to fill out. The questionnaire will give you a series of statements about the Web Accessibility Initiative Web site. I would like you to rate your agreement with each statement. While you fill out the questionnaire, I will step into the observation booth to see if our observers have any further questions. 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. The homepage is attractive. The overall site is attractive. The site's graphics are pleasing. The site has a good balance of graphics versus text. The colors used throughout the site are attractive. The typography (lettering, headings, titles) is attractive. The homepage's content makes me want to explore the site further. It is easy to find my way around the site. I can get to information quickly. It is fun to explore the site. It is easy to remember where to find things. Information is layered effectively on different screens. The homepage is attention-getting. Information is easy to read. Information is written in a style that suits me. 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. Screens have the right amount of information. The site effectively communicates the company's identity. The information is relevant to my professional needs. The site is designed with me in mind. The site's content interests me. The site's content would keep me coming back. The site has characteristics that make it especially appealing. The site reflects progressive, leading edge design. The site is exciting. The site is well-suited to first-time visitors. The site is well-suited to repeat visitors. The site has a clear purpose. I always felt I knew what it was possible to do next. It is clear how screen elements (e. g. , pop-ups, scrolling lists, menu options, etc. ) work. 15. My mistakes were easy to correct.

Review Questions What data do you feel would have been useful to record during the practice usability test? Do you think the questions in the questionnaire would have been useful? Are there any usability testing methods we didn’t use that you think could have been useful? Why do you think the test script contained the questions it did?

Format in Assignment 1 ● ● ● ● Product under test Test Objectives Participants Required Tasks to Undertake Data Collection Test Procedure Analysis Results

Test Objectives The test objectives should clearly and succinctly outline: ● The focus ● Method ○ ○ Test conditions Data to be gathered ● What is hoped to be established Example of generic test objectives from usability. gov https: //www. usability. gov/how-to-and-tools/resources/templates/usability-test-plan -template. html

Participants ● ● ● Should represent target audience Consider multiple groups of end users Good to have spread of abilities Outline the attributes you would like them to have Should not have been involved in development Read more: https: //www. usability. gov/how-to-and-tools/methods/recruiting-usability-test-participants. html

Tasks for usability tests should be chosen carefully to focus on the key areas of the interface targeted for usability testing. They should represent goals a real user would be likely to have when the use the site. They are normally grouped into scenarios. From: https: //www. usability. gov/how-to-and-tools/methods/planning-usability-testing. html

Data Gathering and Measurement Quantitative Data: ● ● Completion/success rate - can the user complete the task Errors - how many mistakes does the user make per task Efficiency/time - how much time did it take to complete the task Subjective satisfaction (questionnaire) Qualitative Data: ● ● Observations about pathways participants took Problems experienced Comments/recommendations Answers to open-ended questions Excellent resources on measurement in usability testing https: //usabilitygeek. com/usability-metrics-a-guide-to-quantify-system-usability/ https: //www. nngroup. com/articles/usability-metrics/

Test Procedure Imagine someone else will be running the test for you. You should consider things like: ● ● What equipment will be needed What information the users will need to be given How long the session is How data will be recorded and how many facilitators will be needed If in doubt, be thorough. Imagine you are someone reading the instructions who is unfamiliar with the test.

Data Analyses Think about what the data you are collecting will look like once you have completed your testing. How will you analyse it and communicate it to others? Data can be simple information relating to issues found in the interface or more complex data relating to frequency and severity of errors. Reporting: https: //www. usability. gov/how-to-and-tools/methods/reporting-usability-test-results. html https: //www. usability. gov/how-to-and-tools/resources/templates/report-template-usability-test. html

Reporting There are various different ways to report both quantitative and qualitative data from tests; make sure it matches your original objectives. https: //www. usability. gov/how-to-and-tools/methods/reporting-usability-test-results. html https: //www. usability. gov/how-to-and-tools/resources/templates/report-template-usability-test. html http: //www. sage-research. com/v 4/sage_usability_study_report_example. pdf

Example of Test Plan Make use of usability. gov Usability. gov has a lot of information including an example of a Usability Test Plan: https: //www. usability. gov/how-to-and-tools/resources/templates/usability-test-plantemplate. html