Usability Testing 600

Aoraki local module
7 credits=70 hours
Level 6

Knowledge assumed from
UT500, IN500, IN600

Topics & Weightings
Part 1 Foundation 25%
Part 2 Experimentation 25%
Part 3 Application 25%
Part 4 Documentation 25%

Learning Outcomes

1. Discuss elements of usability, UT tools, practice and ethics.
2. Set up a usability testing suite.
3. Run and manage a series of usability tests.
4. Record, process and present usability testing data.

Content

Part 1 Foundation

1.1 Elements of usability.

1.1.1 Elements of usability:
- user profiles
- age
- culture
- task orientation
- learning curves
- learnability over efficiency
- accelerators
- error trapping
- satisfaction
- task, functional and competitive analysis
- performance measures, benchmarks
- objectives vs interpretative
- help files and manuals
- tutorials
- demonstration versions of software
- viewlets

1.2 Usability testing tools, practice and ethics.

1.2.1 Usability testing tools:
- passive observation
- active involvement
- thinking aloud
- closed circuit TV
- GUI recording
- eye tracking
- helmet mounted cam

1.2.2 Usability testing practice:
- setting up a usability testing facility
- conducting tests in a scientific manner
- questionnaires and interviews
- focus groups
- presenting results in a usable way
- oral presentation
- written presentation
- producing a commercial quality report

1.2.3 Usability testing ethics:
- respect for testers
- testing the interface, not the testers
- providing for testers needs
- controlling the dissemination of results

Part 2 Experimentation

2.1 Set up a usability testing suite.

2.1.1 Set up the test facility:
- identify a suitable space
- negotiate access
- establish a computer test suite

2.1.2 Control the environment:
- operating system
- dual boot OS/VMWare
- OS parameters
- monitor settings
- color space
- calibration
- resolution
- standardise the browser settings
- desktop browsers
- device browsers
- document the settings

2.1.3 Design and trial tests:
- reference UT principles
- design tests
- low-cost tests
- closed circuit TV
- eye tracking
- GUI recording
- trial and refine the tests
- create test procedures
- provide documentation

Part 3 Application

3.1 Run and manage a series of usability tests.

3.1.1 Identify a usability testing requirement.

3.1.2 Propose and design a series of tests.

3.1.3 Run a series of tests.

3.1.4 Manage the tests.

Part 4 Documentation

4.1 Record, process and present usability testing data.

4.1.1 Record the test results:
- keep paper records
- store any screen recordings, scripts, AV outputs
- record and produce transcripts of any interviews
- record and produce transcripts of any focus groups

4.1.2 Process the results:
- apply statistical methods where appropriate
- tabulate the results where appropriate
- chart the results where appropriate

4.1.3 Present the results:
- prepare a short presentation
- present to a small group of stakeholders
- facilitate a discussion and/or invite questions

Guideline: It is envisaged that the group will make the best use of available resources. A small polytechnic may use low-cost methods as described by Nielsen, and a big polytech with extensive resources may make use of screen and camera technologies in designing and running the tests. In either case it is expected that a sufficient sample will be collected to make some kind of statistical analysis viable.

Key resources:

J.Nielsen (1993). Usability engineering. New York: Academic Press.

useit.com: Jakob Nielsen's Website http://www.useit.com

AP,DWM-2,UT,SL,2003-6,ver_0.2