Test generation is easy: we can generate piles of tests randomly, by model checker mutation analysis of formal specifications, through path coverage, etc. But just increasing the quantity of tests may not be a cost-effective way of increasing the quality of the test. The number of tests, and hence the cost of maintaining and running large test sets, can increase exponentially with the increase in real coverage. We present a number of automated methods to pick out a smaller set of tests that still have good coverage. The first method is finding a subset of tests with equal coverage for a test criterion. To do this, we must measure the coverage for a test set, given a test criterion. Some possible test criteria are path coverage, n-switch, specification mutation, and branch coverage. We use a greedy algorithm to choose tests satisfying requirements of the criterion. Second, tests that are prefixes of other, longer tests or duplicates may be dropped. Finally, the cross section of a requirement is the reciprocal number of tests that satisfy it. We can choose tests with the highest resolution, that is, tests satisfying requirements with the smallest cross section, since these are likely to be the most sensitive tests.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Winnowing tests: Getting quality coverage from a model checker without quantity


    Contributors:
    Black, P.E. (author) / Ranville, S. (author)


    Publication date :

    2001-01-01


    Size :

    312936 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Winnowing Tests: Getting Quality Coverage From a Model Checker Without Quantity

    Black, P. E. | British Library Conference Proceedings | 2001



    Modeling and Marshaling: Making Tests from Model Checker Counterexamples

    Black, P. E. / IEEE / AIAA | British Library Conference Proceedings | 2000


    CHECKER

    YOSHINO MITSUNORI / KITANO TETSUJI | European Patent Office | 2019

    Free access

    TRAJECTORY CHECKER

    THOMAS STEPHEN L / ALAHMAD BADER | European Patent Office | 2022

    Free access