In order to be certified by the FAA, airborne software must comply with the DO-178B standard. For the unit testing of safety-critical software, this standard requires the testing process to meet a source code coverage criterion called Modified Condition/Decision Coverage. This part of the standard is controversial in the aviation community, partially because of perceived high cost and low effectiveness. Arguments have been made that the criterion is unrelated to the safety of the software and does not find errors that are not detected by functional testing. In this paper, we present the results of an empirical study that compared functional testing and functional testing augmented with test cases to satisfy MC/DC coverage. The evaluation was performed during the testing of the attitude control software for the HETE-2 (High Energy Transient Explorer) scientific satellite (since that time, the software has been modified). We found in our study that the test cases generated to satisfy the MC/DC coverage requirement detected important errors nor detectable by functional testing. We also found that although MC/DC coverage testing took a considerable amount of resources (about 40% of the total testing time), it was not significantly more difficult than satisfying condition/decision coverage and it found errors that could not have been found with that lower level of structural coverage.
An empirical evaluation of the MC/DC coverage criterion on the HETE-2 satellite software
19th DASC. 19th Digital Avionics Systems Conference. Proceedings (Cat. No.00CH37126) ; 1 ; 1B6/1-1B6/7 vol.1
2000-01-01
722895 byte
Conference paper
Electronic Resource
English
An Empirical Evaluation of the MC/DC Coverage Criterion of the HETE-2 Satellite Software
British Library Conference Proceedings | 2000
|Ontstekingsgevaar Hete Oppervlakken
British Library Online Contents | 1997
New concept of small satellite, HETE-2 and its sci...
AIAA | 2005
|Alexis and Hete: Two small, low cost, scientific satellite systems
British Library Conference Proceedings | 1993
|Hete pleken op satelietbeelden
Online Contents | 2006