NTRS - NASA Technical Reports Server

Back to Results
Model Generation to Support Model-Based Testing Applied on NASA DAT - An Experience ReportModel-based Testing (MBT), where a model of the system under tests (SUT) behavior is used to automatically generate executable test cases, is a promising and versatile testing technology. Nevertheless, adoption of MBT technologies in industry is slow and many testing tasks are performed via manually created executable test cases (i.e. test programs such as JUnit). In order to adopt MBT, testers must learn how to construct models and use these models to generate test cases, which might be a hurdle. An interesting observation in our previous work is that the existing manually created test cases often provided invaluable insights for the manual creation of the testing models of the system. In this paper we present an approach that allows the tester to first create and debug a set of test cases. When the tester is happy with the test cases, the next step is to automatically generate a model from the test cases. The generated model is derived from the test cases, which are actions that the system can perform (e.g. a button clicks) and their expected outputs in form of assert statements (e.g. assert data entered). The model is a Finite State Machine (FSM) model that can be employed with little or no manual changes to generate additional test cases for the SUT. We successfully applied the approach in a feasibility study to the NASA Data Access Toolkit (DAT), which is a web-based GUI. One compelling finding is that the test cases that were generated from the automatically generated models were able to detect issues that were not detected by the original set of manually created test cases. We present the findings from the case study and discuss best practices for incorporating model generation techniques into an existing testing process.
Document ID
Document Type
Conference Paper
Schulze, Christoph (Maryland Univ. College Park, MD, United States)
Lindvall, Mikael (Maryland Univ. College Park, MD, United States)
Bjorgvinsson, Sigurthor (Maryland Univ. College Park, MD, United States)
Wiegand, Robert E. (NASA Goddard Space Flight Center Greenbelt, MD, United States)
Date Acquired
August 20, 2018
Publication Date
November 2, 2015
Subject Category
Mathematical and Computer Sciences (General)
Report/Patent Number
Meeting Information
IEEE International Symposium on Software Reliability Engineering (ISSRE) 2015(Gaithersburg, MD)
Distribution Limits
Use by or on behalf of the US Gov. Permitted.
State Machines
Model Generation
Model-based Testing

Available Downloads

NameType 20180004562.pdf STI