xxxxxxx x
xxxxxxxxxxxx xx
xxxxxxxxxxxx xxxx
xxxxxxxxx xxxxx
xxxxxxxx xxxxx
xxxxxxxx xxxxx xxx x
xxxxxx xxxxx xxxxxxx xx
xx xxx xxxxxxxxx xxx
x xxxxxxxxxx xxxx
xxxxxx xxxxx
xx xxxxxx xxxxxx
xx xxx xxxxxx xxxxxxx
xxx xxxxx xxxxxx xxxxxxx
xxxx xxxxxx xxxxxx xxxxxxx
xxxx xxxxxxx xxxxxxx
xxx xxxxxxxx xxxxxxx
xxx xx xxxxxxxx xxxxxxx
xxx xxxxxxxx xxxxxxx
xx xxxxxxxx xxxxxxxxx
xx xxxxxxxxx xxxxxxx
xxxxxxxxx xx xxxxx
xxxxxxx xxxxxxxxx xxx xxxxx
xxxxxxxxxxxxxxxxxxxxxxxx xxxx xxxx
xxxxxxxxxxxxxxxxxxxxxxxx xxxxx xxxx
xxxxxxxxxxxxxxxxxxxx xxxxxx xxxx
xx xxxxxxxx xxxxxx xxxx
xxxxxx xxxxx
xxxxxx xxxxx
xxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxx
xxxxxxxxxxxxxxx xxxxxxxxxxxxxxxx
+===================================================+
+===================================================+
+======= Testing Techniques Newsletter (TTN) =======+
+======= ON-LINE EDITION =======+
+======= May 1994 =======+
+===================================================+
+===================================================+
TESTING TECHNIQUES NEWSLETTER (TTN) is E-mailed on a monthly basis to
support the Software Research, Inc. (SR) community and to provide infor-
mation of general use to the testing community.
(c) Copyright Software Research, Inc. 1994. Permission to copy and/or
re-distribute is hereby granted to any recipient of the TTN On-Line so
long as the document/file is kept intact and this copyright statement
appears with it.
TRADEMARKS: Software TestWorks, STW, STW/Regression, STW/Coverage,
STW/Advisor, X11 Virtual Display System, X11virtual and the SR logo are
trademarks of Software Research, Inc. All other systems are either
trademarks or registered trademarks of their respective companies.
========================================================================
INSIDE THIS ISSUE:
o Editorial: Software Test Tools Considered Harmful?
o X11 Virtual Display System: Virtually Free Offer Extended
o 7th International Software Quality Week (QW '94): Synopsis of
May 17-20, 1994 Conference Proceedings
o 8th Conference on Software Engineering Education
o International Journal of Reliability, Quality and Safety
Engineering
o Technical Articles of Interest
o Calendar of Events
o TTN Submittal Policy
o TTN Subscription Information
========================================================================
--->>> EDITORIAL: SOFTWARE TEST TOOLS CONSIDERED HARMFUL? <<<---
========================================================================
Why such a controversial title, one that emulates Dr. E.W. Dijkstra's
famous ``GOTO Statement Considered Harmful'' letter that set off the
structured programming revolution (which, in turn, led to the object-
oriented programming revolution)?
The reason is simple: The market for software test tools is growing at a
faster rate than the rest of the software development market. Even
though software testing and tools to automate software testing have been
around for many years, the market is still in its infancy. As a result,
many vendors use terms without clear definitions and oversell their
solutions. In the software test community purveyors of products would
have you believe that their solution will solve all of your quality
problems.
The good news is the industry growth has created a competitive situation
in which some good products are offered. I know that competition always
has improved our product line, and it's a fair assumption that will be
true for others as well.
The bad news, however, is no single-function test tool solution is going
to completely solve anyone's testing problem, even as slick sales and
marketing will have you believe. Having actually seen some of these
pitches, I have to admit that they really are clever at sweeping the
hard parts of the software test problem under the proverbial rug! Cau-
tion is advised.
Software Research (SR) has been working on software testing problems and
their solutions for over fifteen years. I, myself, have been involved
in the software testing field since the early 1970's! Through my
experiences, one thing about the software testing field is unquestion-
ably true: The problem of achieving good quality software, using test
tools and every other imaginable possible solution, was, is, and will
remain both a technically subtle and deep problem for which there is no
quick fix.
The CASE "silver-bullet" that never materialized is not here for CAST
either. Moreover, software testing is a multi-faceted problem and
requires multi-faceted solutions.
I believe SR's Software TestWorks (STW) tool suite made up of three bun-
dles of tools (STW/Regression, STW/Coverage, and STW/Advisor), is a
strong base for general software testing solutions. On the other hand,
I also know no single product or even STW's entire collection of 12
separate tools, is the total test solution. For this reason, SR will
continue to expand its product line and to work with others in partner-
ship, to add to its solution. In a recent partnership with Interactive
Development Environments (IDE), for example, STW was integrated with
IDE's products to create an end-to-end automated specification-based and
software test solution.
Over time, the products that provide real solutions and deliver genuine
value will prevail. You have my assurance: SR will be here to help you
when other short-term single point solutions fail to measure up when the
going gets tough.
--Dr. Edward Miller
President of SR
========================================================================
--- X11 VIRTUAL DISPLAY SYSTEM: VIRTUALLY FREE OFFER EXTENDED ---
========================================================================
Due to popular demand, the X11 Virtual Display System (X11virtual)
*free* software offer has been extended to May 31, 1994.
X11virtual is an exciting new technology from SR that allows you to run
multiple copies of graphical user interface (GUI) applications and
scripts in the background, just as if each one was connected to a
separate screen. This technology was developed for load generation from
a single workstation. X11virtual can be used with SR's testing tools,
or any other vendors' testing tools. It can also be used by anyone
wishing to put a screen-intensive application into the background, free-
ing the screen for other uses.
X11virtual is based on the X11R5 server and runs on the following plat-
forms:
> Sun SPARC SunOS 4.1.x
> Sun SPARC Solaris 2.2.x
> Silicon Graphics Inc. (SGI) under IRIX 5.x,
> RS/6000 under AIX 3.2.x.
--- AVAILABILITY ---
SR has been offering the X11virtual software *free* to all requesters
since March 15, 1994. The software has no protection, so it can be used
on any system. There is a $45 media (QIC-150 cartridge or 4mm DAT),
copying, postage and handling fee payable by check or money order prior
to shipment.
--- ORDERING ---
To obtain your copy of X11virtual, fill out a one-page registration form
and pay $45.00 for materials and shipping. Make requests for the
X11virtual Registration Form to:
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
-= Software Research, Inc. =-
=-= ATTN: X11virtual Registration =-=
=-= 901 Minnesota Street =-=
=-= San Francisco, CA 94107 USA USA =-=
=-= FAX: [1] (415) 550-3030 =-=
-= E-mail: virtual@soft.com =-
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
--- ADDITIONAL INFORMATION ---
Address E-mail requests for further information about the X11 Virtual
Display System to "virtual@soft.com".
========================================================================
---- 7th INTERNATIONAL SOFTWARE QUALITY WEEK ----
---- Synopsis of May 17-20, 1994 Conference ----
========================================================================
Software Research Institute's (a not-for-profit subsidiary of SR) 7th
International Software Quality Week (QW '94) held in San Francisco, May
17-20, was the most successful Quality Week conference so far.
More than 630 conference and exposition attendees, encompassing over 300
different companies from throughout the U.S. and from 12 foreign coun-
tries, participated in this year's theme, "Maintaining Competitiveness".
The QW '94 theme focused on advances in software test technology, qual-
ity control, risk management, software safety, and test automation tech-
niques.
QW '94 provided presentations addressing a wide range of issues with
respect to advances in software analysis methodologies and automated
test methods that can effectively help an organization implement a
manageable, well-defined repeatable process. Seven plenary sessions,
ten tutorial/seminars and 38 regular papers were presented by industry
experts, academics and practitioners in QA/QC/Testing, including the
following seven keynote speakers:
* Dr. Boris Beizer (ANALYSIS): "On Being Competitive"
* Mr. Robert Binder (Independent Consultant): "Testing Object-Oriented
Systems: State of the Art, State of the Practice"
* Mr. Walter Ellis (Software Process and Metrics, Washington, DC):
"National Software Council: Staus of the Initiative"
* Dr. Herb Hecht (SoHaR): "Software Dependability in Distributed Sys-
tems"
* Dr. Monika Muellerburg (GMD): "Why Systematic Testing is Difficult:
The Problem of the Sample"
* Dr. John Musa (Bell Laboratories): "Software Reliability Engineering
Practice"
* Mr. Shel Siegel (Objective Quality): "Where Are the Software Quality
Leaders and What Are They Doing?"
Attendees had the opportunity to select presentations from a four-track
Technical Program focusing on Technology, Application and Management
issues. The Technology track included discussion of reporting R&D
results, relating academic experiences, and dealing with future techno-
logies. Implementing techniques with advanced methods, such as CASE or
special technical methods, was the focus of the Applications track. The
Management track examined how to plan, manage, access, and evaluate at a
process or project level, with special emphasis placed on real-world
experiences.
The technical content of this year's conference was enhanced by two spe-
cial debates examining some of today's most relevant methodologies, as
well as the special mini-tutorial "What's on in Europe? European Soft-
ware Quality Initiatives?" presented by Mr. Hans-Juergen Kugler (K&M
Technologies, Ltd.). Available space for the renowned, two-day Vendor
Exhibit was sold out, with 28 selected vendors present. Paralleling the
Vendor Exhibit, 11 papers were featured in the refereed Vendors Presen-
tation track.
A limited number of the bound copies of the QW '94 Conference Proceed-
ings are available for $250 per copy from SR and the QW '94 Tutorial
Notes are available for $100 per copy.
For further information: E-mail: "qw@soft.com"
Phone: (415) 550-3020
FAX: (415) 550-3030
The goal of the Quality Week series is to create an on-going publicly
accessible platform where researchers and Quality Assurance and Software
Test professionals, as well as users at every level, can communicate and
exchange experience and technology. An updated Eigth International
Quality Week is set for May of 1995 in San Francisco, California.
========================================================================
--- 8TH CONFERENCE ON SOFTWARE ENGINEERING EDUCATION ---
--- March 29 - April 1, 1995 ---
--- New Orleans, Louisiana ---
--- ---
--- --- CALL FOR PARTICIPATION --- ---
========================================================================
--- CONFERENCE OBJECTIVE ---
The CSEE's purpose is to influence educational directions, stimulate new
approaches, promote collaboration, and generate interactive exchanges
among all educational stakeholders. The conference attracts interna-
tional participation and attendees from industry, academia, and govern-
ment. Educators, trainers, managers, and administrators gather together
to exchange ideas about how to enhance software engineering training and
education.
This year the conference aims to comprehensively examine the current
status, methods and accountability of software engineering education.
Are we affecting practice? Are we improving both our educational process
and the product? Are we aligned in our approaches?
Come share your views, concerns, techniques, and experiences on the fol-
lowing issues:
> Impact of education on practice.
> Education and training goals.
> Teachers, Managers and Practitioners.
> Process improvement: required knowledge and skills.
> Technology: Teaching reengineering, model-based software engineer-
ing; domain engineering, software reuse, architectures, and soft-
ware repositories.
> Industry-Academia collaboration.
> Training and education management.
> Delivery: New technologies, use of learning aids and laboratories,
and evaluating delivery alternatives.
--- SUBMISSION GUIDELINES AND PROCEDURES ---
Papers are requested that present new ideas or approaches or that
describe practice and experience. Proposals for panels examining contr-
oversial topics and designed to facilitate audience participation are
encouraged, as well as proposals for half- and full-day tutorials. The
CSEE conference invites innovative suggestions for informal meetings
such as workshops, poster sessions, or birds-of-a-feather sessions.
Submit five copies of a paper or proposal. Indicate only the title and
beginning text of the submission on the first page of a paper. Provide
a separate cover sheet with title, all authors' names, affiliations,
complete addresses, telephone numbers, and E-mail addresses.
Accepted contributions will appear in the conference proceedings, pub-
lished as Lecture Notes in Computer Science by Springer-Verlag.
--- IMPORTANT DATES ---
Deadline for submissions July 15, 1994
Notification of acceptances September 9, 1994
Final versions due October 12, 1994
Send submissions to:
Mary Ellen Rizzo Phone: (412) 268-3007
Software Engineering Institute FAX: (412) 268-5758
Carnegie Mellon University E-mail: education@sei.cmu.edu
Pittsburgh, PA 15213-3890
========================================================================
--- INTERNATIONAL JOURNAL OF ---
--- RELIABILITY, QUALITY AND SAFETY ENGINEERING ---
--- ---
--- --- CALL FOR PAPERS --- ---
========================================================================
With its inaugural issue just published, the International Journal of
Reliability, Quality and Safety Engineering is a new, refereed, high-
quality journal which will be published four times a year.
Papers addressing related engineering topics are welcome and should be
submitted to the Editor-in-Chief:
Professor H. Pham
Department of Industrial Engineering
Rutgers University, P.O. Box 909
Piscataway, NJ 08855 USA
Phone: (908) 932-5471
Fax: (908) 932-5467
E-mail: hopham@princess.rutgers.edu
PLEASE RECOMMEND THIS JOURNAL TO YOUR LIBRARY. Selected addresses to
World Scientific Publisher:
1060 Main Street, River Edge NJ 07661, USA
Toll-free: (800) 227 7526
FAX: (201) 487 9656
73 Lynton Mead Totteridge, London N20 8DH, UK
Phone: (44) 81 446 2461
FAX: (44) 81 446 3356
Farrer Road, P.O. BOX 128, Singapore 9128
Phone: (65) 382 5663
FAX: (65) 382 5919
========================================================================
------------->>> TECHNICAL ARTICLES OF INTEREST <<<-------------
========================================================================
The following articles address software testing techniques or quality
assurance issues that may be of interest:
* "Metrics: Establishing a Process", W. Keuffel, Software Develop-
ment, May 1994.
* "Of Quality and Requirements", C. Cargill, UniForum Monthly, May
1994.
* "Testing...Testing...", P. Koltun, Cross Talk (published by the
Department of Defense Software Technology Support Center), May
1994.
* "Improving the Testing Process Using the SEI CMM", G. T. Daich,
Cross Talk, ibid., May 1994.
========================================================================
------------------->>> CALENDAR OF EVENTS <<<-------------------
========================================================================
The following is a partial list of upcoming events of interest. ("o"
indicates Software Research will participate in these events.)
+ June 7-9, 1994: Assessment of Quality Software Development
Washington, D.C.
Contact: Ez Nahouraii
Industry Education Counseling
Phone: 408-265-1960
o June 13-16, 1994: USPDI '94
Washington, D.C.
Contact: Martha Woods
USPDI,Inc.
Phone: 301-445-4405
+ June 15-17, 1994: 24th Annual International Symposium on
Fault-Tolerant Computing
Austin,Texas
Contact: Billene Mercer
Phone: 512-327-4012; FAX: 512-327-8132
+ July 26-28, 1994: Software Quality Management
Edinburgh, SCOTLAND
Contact: Sue Owen
Conference Secretariat,
Wessex Institute of Technology
Phone: 44 (0) 703 293223
========================================================================
--------->>> TTN SUBMITTAL POLICY <<<---------
--------->>> CALENDAR OF EVENTS AND CALL FOR PAPERS <<<---------
========================================================================
The TTN On-Line edition is forwarded on the 15th of each month to sub-
scribers via InterNet. To have your event listed in an upcoming issue,
please E-mail a description of your event or Call for Papers or Partici-
pation to "ttn@soft.com".
The TTN On-Line submittal policy is as follows:
o Submission deadlines indicated in "Calls for Papers" should pro-
vide at least a 1-month lead time from the TTN On-Line issue date.
For example, submission deadlines for "Calls for Papers" in the
January issue of TTN On-Line would be for February and beyond.
o Length of submitted items should not exceed 68 lines (one page).
o Publication of submitted items is determined by Software Research,
Inc., and may be edited as necessary.
========================================================================
-------------->>> TTN SUBSCRIPTION INFORMATION <<<--------------
========================================================================
To request a FREE subscription or submit articles, please E-mail
"ttn@soft.com". For subscriptions, please use the keywords "Request-
TTN" or "subscribe" in the Subject line of your E-mail header. To have
your name added to the subscription list for the quarterly hard-copy
version of the TTN -- which contains additional information beyond the
monthly electronic version -- include your name, company, and postal
address.
To cancel your subscription, include the phrase "unsubscribe" or
"UNrequest-TTN" in the Subject line.
Note: To order back copies of the TTN On-Line (August 1993 onward),
please specify the month and year when E-mailing requests to
"ttn@soft.com".
TESTING TECHNIQUES NEWSLETTER
Software Research, Inc.
901 Minnesota Street
San Francisco, CA 94107 USA
Phone: (415) 550-3020
Toll Free: (800) 942-SOFT
FAX: (415) 550-3030
E-mail: ttn@soft.com
## End ##