We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Random Testing: Theoretical Results and Practical Implications.
- Authors
Arcuri, Andrea; Iqbal, Muhammad Zohaib; Briand, Lionel
- Abstract
A substantial amount of work has shed light on whether random testing is actually a useful testing technique. Despite its simplicity, several successful real-world applications have been reported in the literature. Although it is not going to solve all possible testing problems, random testing appears to be an essential tool in the hands of software testers. In this paper, we review and analyze the debate about random testing. Its benefits and drawbacks are discussed. Novel results addressing general questions about random testing are also presented, such as how long does random testing need, on average, to achieve testing targets (e.g., coverage), how does it scale, and how likely is it to yield similar results if we rerun it on the same testing problem (predictability). Due to its simplicity that makes the mathematical analysis of random testing tractable, we provide precise and rigorous answers to these questions. Results show that there are practical situations in which random testing is a viable option. Our theorems are backed up by simulations and we show how they can be applied to most types of software and testing criteria. In light of these results, we then assess the validity of empirical analyzes reported in the literature and derive guidelines for both practitioners and scientists.
- Subjects
COMPUTER software; PROBLEM solving; MATHEMATICAL analysis; RANDOM variables; SCHUR functions; COMPUTER algorithms
- Publication
IEEE Transactions on Software Engineering, 2012, Vol 38, Issue 2, p258
- ISSN
0098-5589
- Publication type
Article
- DOI
10.1109/TSE.2011.121