Usability Testing

Usability testing is a way to get direct feedback from the users of your application or website. It is a method that objectively identifes usability problems because it measures user task performance rather than relying on verbal user feedback or preferences. User task performance data can be collected and compared to benchmarks or specific usability objectives. For example, one usability objective of a customer database application may be "Users can enter a new customer into the database with no more than 2 errors." In a usability test, the ability of the application to meet project usability objectives can be measured.

Usability testing aims to enhance application ease of use, learning, and end user satisfaction. The process of usability testing involves recruiting participants who accurately reflect the user profile(s) of the application and observing them perform work tasks with the software (actual or prototype). Participants are given specific tasks related to the usability objectives of the project. Participants' actions and experiences are recorded (video, audio and/or note-taking) and numeric data is collected regarding user performance. The participants' data is compared to the usability objectives and a report documents the results.

The test can be performed formally in a usability laboratory, or informally in an office, conference room, or the user's environment. Prior to usability testing, the usability consultant will provide direction and assistance, as needed, on all activities required to prepare for and conduct a usability test.

Requirements:

To complete this activity, Client would provide:

• An individual or team with responsibility for assisting with the test. Staff must be available to assist in all aspects of planning the usability test as well as observing and assisting in conducting the test. Client need not participate in the data analysis or report writing but is invited to participate, if desirable. Usability consultant will provide direction on selecting suitable test participants but client is ultimately responsible for the recruiting.
• Any usability benchmarks or competitive testing data, if applicable.
• All necessary hardware and software to run the application. Functioning prototype or "in-production" system.
• Access to the application or website, 2 weeks prior to the start of the test.
• Usability laboratory or a usability location (office, conference room, or other), usability equipment (videocamera, PC, etc.), and any other materials necessary. Rental of laboratory and/or equipment is possible if Client does not currently possess the necessary materials.

Deliverables:

Usability Test Plan:

A usability test plan will be created containing the following:

• Usability objectives: A set of realistic, measurable usability objectives will be specified.
• Usability measurements: A set of measurements will be defined. Measurements may include some of the following or may be unique to the application.
  • Task time
  • Completion rate
  • Error Rate
  • Error Free Rate
  • Problem severity
  • End user satisfaction
• Task scenarios: Task scenarios will be written. The number and complexity of scenarios will be based on the usability objectives.

Participant Recruiting:

Usability consultant will assist in identifying correct participants for testing, correct recruiting questions, and direction on recruiting practices. (Recruiting of participants is not included but may be available upon request) The appropriate number of participants will be determined by the usability objectives (range of 8-12 is generally sufficient).

Usability Test Results Presentation (and/or Report) :

A presentation will be delivered to the client which includes:

• An overview of the test results
• Data collected during the test
• A list of usability problems identified
• A list of recommended solutions to the problems found.

Usability test reports with all details are available upon request but require additional work time.