QWE2002 Paper 4T

Dr. Nancy Eickelmann & Mr. Allan Willey
(Motorola Labs)

Traceability and Reproducability in Integrated System Test Environments

Key Points

Presentation Abstract

This paper examines software architectural constraints in relation to software and system test automation environments. The MATE architecture requires a mapping of multiple views of the environment including structure, functionality, process and data. An overview of the environment is represented by mapping the test functionality to hardware and software structures of the environment. An architectural representation provides a foundation for evaluating the impact of architectural and COTS choices on system test engineers and test managers. This paper discusses the integration of COTS tools into MATE including DOORS, Primavera, ClearQuest and ClearCase; the development of standardized test management support TMS; and the automation of the system test process. The MATE architecture is described and a detailed discussion of test automation and tool integration issues is undertaken. Software architectural analysis is used to determine if a specific structural decomposition and the functional allo cation to system structures supports or impedes certain qualities. Changes to an ATE such as enhancements to system functionality, improvements to performance (space and time), and reuse of components, data representation and changes to processing algorithm are all sensitive to system architectural constraints.

About the Author

Dr. Nancy Eickelmann is currently a research scientist for Motorola Labs and is leading the Motorola software and system test process measurement and evaluation research initiative. Prior to joining Motorola she was program manager at the NASA/WVU Software Research Laboratory, her research focused on integrating the Balanced Scorecard into the NASA context to provide a measurement framework for software test technology improvements. Before joining NASA she was a member of the Advanced Programs Research Group at MCC where she developed a measurement framework for guiding the decision-making process in product line development. Dr. Eickelmann began her research career as a member of the technical staff at Hughes Research Laboratory (HRL) in Malibu, California while completing her doctorate at the University of California, Irvine. She was named a Hughes Doctoral Fellow while working at HRL and received several research awards while working with Dr. Debra Richardson's Formal Methods and Software Testing Group at UCI. Dr. Eickelmann has collaborated internationally on research projects for defense systems, space station applications, space shuttle and global software.

Allan Willey is a Memb er of Technical Staff at Motorola Labs in the Software and System Engineering Lab (SSERL). Allan leads the "Motorola Automated Test Environments" (MATE) Team. These applied researchers are developing techniques to improve the capabilities of software development groups to test new products. Projects using various advanced statistical analysis techniques, formal modeling, and simulation techniques are being carried out to assess their value for improving delivered product quality, as well as their impact on productivity and testing time. The MATE Team collaborates closely with development organizations in various Motorola product groups to transition successful results. Allan holds an AB in philosophy from the College of William and Mary, and both a BS in mathematics and an MBA in management sciences from George Washington University.