1 / 5

Toward Replacing Structure-Based Testing with Analysis

Toward Replacing Structure-Based Testing with Analysis. Vdot Santhanam Boeing. Structure-Based Testing. DO-178B measures efficacy of software verification through structural coverage measures Level C – Statement Coverage Level B – Decision Coverage

ingo
Download Presentation

Toward Replacing Structure-Based Testing with Analysis

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Toward Replacing Structure-Based Testing with Analysis Vdot Santhanam Boeing

  2. Structure-Based Testing • DO-178B measures efficacy of software verification through structural coverage measures • Level C – Statement Coverage • Level B – Decision Coverage • Level A – Modified Condition/Decision Coverage • Often this leads to significant amount of time spent achieving structural coverage for the sake of coverage

  3. Certification • Contrary to EASA and MoD practices, the FAA has not embraced analysis as a means of software verification • There are no requirements to perform even simple forms of analysis • We’d like to see that culture change because it will • Reduce the cost of verification • Enhance the reliability of the process • Improve our confidence in the software • With DO-178C planning starting, the time is right

  4. Where Do We Want To Go? • Would like to see • Varying degrees of analysis by assurance level, e.g., • Set-use analysis for level C • Range-constraint analysis for level B • Exception and memory leak analysis; RMA for level A • Alternate form of credit for verification-by-analysis (in lieu of structural coverage testing)

  5. Research Needed • Devise analysis techniques that achieve the same/similar objectives as testing • Devise new, more powerful techniques that can surpass testing in cost-effectiveness • Stream-line research toward more pragmatic applications for existing formal techniques (rather than pursue the elusive goal of proving programs correct)

More Related