Download: PDF.
“Studying the Characteristics of a `Good' GUI Test Suite” by Qing Xie and Atif M. Memon. In Proceedings of the 17th IEEE International Symposium on Software Reliability Engineering (ISSRE 2006), Nov. 2006.
The widespread deployment of graphical-user interfaces (GUIs) has increased the overall complexity of testing. A GUI test designer needs to perform the daunting task of adequately testing the GUI, which typically has very large input interaction spaces, while considering tradeoffs between GUI test suite characteristics such as the number of test cases (each modeled as a sequence of events), their lengths, and the event composition of each test case. There are no published empirical studies on GUI testing that a GUI test designer may reference to make decisions about these characteristics. Consequently, in practice, very few GUI testers know how to design their test suites. This paper takes the first step towards assisting in GUI test design by presenting an empirical study that evaluates the effect of these characteristics on testing cost and fault detection effectiveness. The results show that two factors significantly effect the fault-detection effectiveness of a test suite: (1) the diversity of states in which an event executes and (2) the event coverage of the suite. Test designers need to improve the diversity of states in which each event executes by developing a large number of short test cases to detect the majority of “shallow” faults, which are artifacts of modern GUI design. Additional resources should be used to develop a small number of long test cases to detect a small number of “deep” faults.
Download: PDF.
BibTeX entry:
@inproceedings{XieMemonISSRE2006,
author = {Qing Xie and Atif M. Memon},
title = {Studying the Characteristics of a `Good' {GUI} Test Suite},
booktitle = {Proceedings of the 17th IEEE International Symposium on
Software Reliability Engineering (ISSRE 2006)},
publisher = {IEEE Computer Society Press},
month = nov,
year = {2006}
}
Back to Atif Memon's Publications.