A Model-based Distributed Continuous Quality Assurance Process to Enhance the Quality of Service of Evolving Performance-intensive Software Systems

Download: PDF.

“A Model-based Distributed Continuous Quality Assurance Process to Enhance the Quality of Service of Evolving Performance-intensive Software Systems” by Cemal Yilmaz, Arvind S. Krishna. Atif M. Memon, Adam Porter, Douglas C. Schmidt, Aniruddha Gokhale, and Balachandran Natarajan, in Proceedings of The Remote Analysis and Measurement of Software Systems (RAMSS 2004), May 2004.

Abstract

Time and resource constraints often force developers of highly configurable systems, such as that found in performance-intensive software, to assess their system's performance on very few configurations and to extrapolate from these to the entire configuration space, which allows many performance bottlenecks and sources of QoS degradation to escape detection until systems are fielded. To improve the assessment of performance across large configuration spaces, we present a model-based approach to developing and deploying a new distributed continuous quality assurance (DCQA) process. Our approach builds upon and extends the Skoll environment, which is developing and validating novel software QA processes and tools that leverage the extensive computing resources of worldwide user communities in a distributed, continuous manner to significantly and rapidly improve software quality. This paper describes how our new DCQA performance assessment process enables developers to run formally-designed screening experiments that isolate the most significant options. After that, exhaustive experiments (on the now much smaller configuration space) are conducted. We implemented this process using model-based software tools and executed it in the Skoll environment to demonstrate its effectiveness via two experiments on widely used QoS-enabled middleware. Our results show that model-based DCQA processes improves developer insight into the effect of system changes on performance at an acceptable cost.

Download: PDF.

BibTeX entry:

@inproceedings{YilmazRAMSS2004,
   author = {Cemal Yilmaz and Arvind S. Krishna and Atif M. Memon and Adam
	Porter and Douglas C. Schmidt and Aniruddha Gokhale and
	Balachandran Natarajan},
   title = {A Model-based Distributed Continuous Quality Assurance Process
	to Enhance the Quality of Service of Evolving
	Performance-intensive Software Systems},
   booktitle = {Proceedings of The Remote Analysis and Measurement of
	Software Systems (RAMSS 2004)},
   month = may,
   year = {2004}
}

Back to Atif Memon's Publications.