PUMA
Istituto di Scienza e Tecnologie dell'Informazione     
Bertolino A., Miranda B., Pietrantuono R., Russo S. Adaptive coverage and operational profile-based testing for reliability improvement. In: ICSE 2017 - IEEE/ACM 39th International Conference on Software Engineering (Buenos Aires, Argentina, 20-28 May 2017). Proceedings, pp. 541 - 551. IEEE, 2017.
 
 
Abstract
(English)
We introduce covrel, an adaptive software testing approach based on the combined use of operational profile and coverage spectrum, with the ultimate goal of improving the delivered reliability of the program under test. Operational profile-based testing is a black-box technique that selects test cases having the largest impact on failure probability in operation; as such, it is considered well suited when reliability is a major concern. Program spectrum is a characterization of a program's behavior in terms of the code entities (e.g., branches, statements, functions) that are covered as the program executes. The driving idea of covrel is to complement operational profile information with white-box coverage measures based on count spectra, so as to dynamically select the most effective test cases for reliability improvement. In particular, we bias operational profile-based test selection towards those entities covered less frequently. We assess the approach by experiments with 18 versions from 4 subjects commonly used in software testing research, comparing results with traditional operational and coverage testing. Results show that exploiting operational and coverage data in a combined adaptive way actually pays in terms of reliability improvement, with covrel overcoming conventional operational testing in more than 80% of the cases.
URL: http://ieeexplore.ieee.org/document/7985692/
DOI: 10.1109/ICSE.2017.56
Subject Testing
Reliability
Operational profile
Program count spectrum
D.2.5 SOFTWARE EGINEERING. Testing and Debugging
B.8.1 PERFORMANCE AND RELIABILITY. Reliability, Testing, and Fault-Tolerance


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional