Faults' Context Matters

Download: PDF.

“Faults' Context Matters” by Jaymie Strecker and Atif M. Memon. In Proceedings of The Fourth International Workshop on Software Quality Assurance (SOQUA '07); co-located with The 6th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, (Dubrovnik, Croatia), Sep. 2007.

Abstract

When choosing a testing technique, practitioners want to know which one will detect the faults that matter most to them in the programs that they plan to test. Do empirical evaluations of testing techniques provide this information? More often than not, they report how many faults in a carefully chosen “representative” sample the evaluated techniques detect. But the population of faults that such a sample would represent depends heavily on the faults' context or environment — as does the cost of failing to detect those faults. If empirical studies are to provide information that a practitioner can apply outside the context of the study, they must characterize the faults studied in a way that translates across contexts. A testing technique's fault-detecting abilities could then be interpreted relative to the fault characterization. In this paper, we present a list of criteria that a fault characterization must meet in order to be fit for this task, and we evaluate several well-known fault characterizations against the criteria. Two families of characterizations are found to satisfy the criteria: those based on graph models of programs and those based on faults' detection by testing techniques.

Download: PDF.

BibTeX entry:

@inproceedings{StreckerMemonSOQUA2007,
   author = {Jaymie Strecker and Atif M. Memon},
   title = {Faults' Context Matters},
   booktitle = {Proceedings of The Fourth International Workshop on
	Software Quality Assurance (SOQUA '07); co-located with The 6th
	joint meeting of the European Software Engineering Conference and
	the ACM SIGSOFT Symposium on the Foundations of Software
	Engineering},
   address = {Dubrovnik, Croatia},
   month = sep,
   year = {2007}
}

Back to Atif Memon's Publications.