Software testing and software fault tolerance are two major techniques for developing reliable software systems, yet limited empirical data are available in the literature to evaluate their effectiveness. We conducted a major experiment to engage 34 programming teams to independently develop multiple software versions for an industry-scale critical flight application, and collected faults detected in these program versions. To evaluate the effectiveness of software testing and software fault tolerance, mutants were created by injecting real faults occurred in the development stage. The nature, manifestation, detection, and correlation of these faults were carefully investigated. The results show that coverage testing is generally an effective means to detecting software faults, but the effectiveness of testing coverage is not equivalent to that of mutation coverage, which is a more truthful indicator of testing quality. We also found that exact faults found among versions are very limited. This result supports software fault tolerance by design diversity as a creditable approach for software reliability engineering. Finally we conducted domain analysis approach for test case generation, and concluded that it is a promising technique for software testing purpose.


    Access

    Access via TIB

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An empirical study on testing and fault tolerance for software reliability engineering


    Contributors:
    Lyu, M.R. (author) / Huang, Zubin (author) / Sze, S.K.S. (author) / Cai, Xia (author)


    Publication date :

    2003


    Size :

    12 Seiten, 36 Quellen




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English





    Automating software fault tolerance

    Wild, Christian | NTRS | 1987


    Software Fault Tolerance in a Clustered Architecture: Techniques and Reliability Modeling

    IEEE; Aerospace and Electronics Systems Society | British Library Conference Proceedings | 1999


    Software Fault‐Tolerance Techniques

    Yang, Mengfei / Hua, Gengxin / Feng, Yanjun et al. | Wiley | 2017


    Automating software fault tolerance

    WILD, CHRISTIAN | AIAA | 1987