Ad Hoc Review

We used this session to get a baseline of how well subjects would do on an ad hoc review of a requirements document. We estimated it to take about 2-3 hours, and our subjects actually spent 2.8 hours on average.

Description and Training

We provided an overview of the assignment and defect classification. This handout also contains some instructions to the subjects which you will need to change for your own environment - we assigned each session of the experiment as a homework exercise, and expected the fault lists to be submitted via email.
We also gave a lecture in which we provided an example of each of the defect types in our classification. These examples came from this requirements document for a video store.

Handouts

None.

Experimental Artifacts

A requirements document for an ATM was used in our run of the session.
(If you are in an environment where you can divide your subjects into two groups and not worry about communication between the groups, you may also wish to assign this requirements document for a parking garage to half of your subjects, in order to avoid document-specific results.)

Data Collection and Questionnaires

Form 1.1 was provided as a template for submitting the fault list and a questionnaire.

Web Accessibility