NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
Towards a Theory for Integration of Mathematical Verification and Empirical TestingFrom the viewpoint of a project manager responsible for the V&V (verification and validation) of a software system, mathematical verification techniques provide a possibly useful orthogonal dimension to otherwise standard empirical testing. However, the value they add to an empirical testing regime both in terms of coverage and in fault detection has been difficult to quantify. Furthermore, potential cost savings from replacing testing with mathematical verification techniques cannot be realized until the tradeoffs and synergies can be formulated. Integration of formal verification with empirical testing is also difficult because the idealized view of mathematical verification providing a correctness proof with total coverage is unrealistic and does not reflect the limitations imposed by computational complexity of mathematical techniques. This paper first describes a framework based on software reliability and formalized fault models for a theory of software design fault detection - and hence the utility of various tools for debugging. It then describes a utility model for integrating mathematical and empirical techniques with respect to fault detection and coverage analysis. It then considers the optimal combination of black-box testing, white-box (structural) testing, and formal methods in V&V of a software system. Using case studies from NASA software systems, it then demonstrates how this utility model can be used in practice.
Document ID
20020061267
Acquisition Source
Ames Research Center
Document Type
Conference Paper
Authors
Lowry, Michael
(NASA Ames Research Center Moffett Field, CA United States)
Boyd, Mark
(NASA Ames Research Center Moffett Field, CA United States)
Kulkarni, Deepak
(NASA Ames Research Center Moffett Field, CA United States)
Date Acquired
August 20, 2013
Publication Date
January 1, 1998
Subject Category
Computer Programming And Software
Report/Patent Number
ASE-Paper-133
Meeting Information
Meeting: ASE ''98 Conference
Location: Honolulu, HI
Country: United States
Start Date: October 1, 1998
Funding Number(s)
PROJECT: RTOP 519-50-22
Distribution Limits
Public
Copyright
Work of the US Gov. Public Use Permitted.

Available Downloads

There are no available downloads for this record.
No Preview Available