Let’s continue with our discussion of common mistakes. DO-254 and DO-178C have numerous objectives related to verification, which can be accomplished through reviews, analysis, or test.  The results of these activities must be retained. A common mistake in these processes center on retention (or lack thereof) of verification records associated with reviews and analysis as well as retention of test results. This, in addition to review of the final verification results (tests and analysis), is an area that applicants commonly miss or do not give proper emphasis.

Verification records should contain a clear correlation to the pass/fail criteria, which could be a development standard or a test result.  These verification records should contain the author/reviewer, date, and any HW/SW items used in the test, including their versions. Any failures or issues found should be correlated to the standard that has been violated.

Test results should be clearly linked to their associated tests and requirements and should be reviewed and summarized in the verification results documents (i.e., HVR/SVR).

Test Results should be reviewed to be sure that the actual and expected results are giving the same correct results and that the tests are passing.

Results of reviews, which must also be retained, are important because they provide numerous types of evidence, such as compliance to plans, standards, and processes, and (and for DAL A and B projects) can provide evidence of independence.