Usability Test Plans CSSE 376 Software Quality Assurance

Usability Test Plans CSSE 376 Software Quality Assurance Rose-Hulman Institute of Technology April 20, 2007 1

Outline § Purpose of Test Plans § Suggested Format 2

Purpose of Test Plans § § Blueprint for test Communication with development team Describes needed resources Milestone for testing 3

Suggested Format 1. Purpose 2. Problem Statement 3. User profile 4. Method 5. Task list 6. Environment/ equipment 7. Test monitor role 8. Evaluation measures 9. Report contents 4

Problem Statement § High-level reason for performing test § Describe what you expect to achieve from testing § don't be vague § make sure that objective can be measured § Example: § Is help easier to access via a shortcut key or the mouse? 5

User Profile § § § Describe end users of product Cover all important attributes Cover important ranges 6

Example User Profile Attribute Range Distribution Computer experience none to 10 years Age 18 -55 years Gender male/female 10% none 25% 1 year 65% 1+ years 50% 18 -25 40% 25 -50 10% over 50 85% male 7

Cartoon of the Day 8

Method Describe major steps of testing 1. 2. 3. 4. Participant greeting Orientation Performance test Participant debriefing 9

Task List § Tasks to be performed by participants § Describe Successful Completion Criteria (SCC) § Include Maximum Time to Complete (MTC) 10

Task List Example Task Description 1 Select region of data 2 3 Detail SCC: Correct values selected MTC: 2. 0 sec Choose chart SCC: Correct type selected type MTC: 2. 0 sec Assign labels SCC: Correct labels assigned MTC: 10. 0 sec 11

Environment/Equipment § Describe environment that you are attempting to simulate § desk arrangement § availability of other materials § lighting, noise level § Equipment needed to perform testing 12

Test Monitor Role § Explain how test monitor will interact with participants § Describe tasks that the monitor will perform 13

Evaluation Measures § Data that will be collected § performance § time to complete tasks § number of errors by type § preference § usefulness of product § ease of learning/use 14

Report Contents § What you will report at the conclusion of testing § major sections of report § schedule for dissemination § Does not include analysis 15