AU9833/ch35/frame Page 405 Friday, March 17, 2000 11:20 AM

Section VI
Modern
Maintenance Tools
Software testing functions within maintenance departments must cope
with the demands for software to provide more complex functions and fea-
tures. Maintenance tools cover a wide range of activities and enable de-
partments to build and enhance applications more effectively.
This section provides an overview of some popular maintenance test
tools and demonstrates how they can improve the quality and productivity
of a maintenance effort.
The objectives of this section are to
• Describe when a maintenance tool is useful.
• Provide a testing maintenance tool selection checklist.
• Discuss types of maintenance tools.
• Provide descriptions of modern and popular testing maintenance
tools.

405

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 407 Friday, March 17, 2000 11:20 AM

Part 35
Introduction to
Maintenance Tools
Many testing tools are available today. Some of these tools are used for new
development, and many are also especially suited to the maintenance area.
Software testing is facilitated by the effective use of maintenance tools. In
testing maintenance changes to software, the tester identifies the types of
maintenance tools used by the maintenance team and determines whether
they will be helpful in testing.
Software maintenance tools are computer programs that can be used in
development, analysis, testing, maintenance, and management of other
computer programs and their documentation. This section discusses
some maintenance tools that can be useful in maintaining software sys-
tems.
Generally, there are two maintenance tool categories: technical and
management. Management maintenance tools assist the maintenance man-
ager in controlling and tracking all of the maintenance tasks. Some of the
software maintenance tools in this category are discussed in the following
sections.
Technical maintenance tools help analyze, change the source code and
documentation, and test the system. A regression testing tool is an exam-
ple of an automated technical tool to test the system repeatedly. It may be
useful under the following circumstances:
• Tests need to be run every build of an application, e.g., time consum-
ing, unreliability, and inconsistency using human resources.
• Tests are required using multiple data values for the same actions.
• Tests require detailed information from system internals such as SQL,
GUI attributes that require an automated approach.

MAINTENANCE TESTING MAINTENANCE TOOL SELECTION CHECKLIST

Finding the appropriate maintenance tool can be difficult, and several
questions need to be answered before selecting a maintenance tool. Exhib-
it 1 lists questions to help the maintenance test team evaluate and select a
maintenance tool.
407

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 408 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 1. Testing Tool Selection Checklist

Item Yes No N/A Comments

1. How easy is the tool for your
maintenance testers to use?

2. Is it something that can be picked

up quickly, or is a lot of training
required?

3. Do any of the team members

already have experience using the
maintenance tool?

4. If training is necessary, are classes,

books, or other forms of instruction
available?

5. Will the maintenance tool work

effectively on the computer system
currently in place?

6. Or are more memory, faster

processors, etc., going to be
needed?

7. Is the maintenance tool itself easy

to use?

8. Does it have a user-friendly

interface?

9. Is it prone to user error?

10. Is the tool physically capable of

testing your application? Many
maintenance tools can only test in a
non-GUI environment, while others
in GUI environments.

11. Can the maintenance tool handle

full project testing? That is, is it able
to run hundreds if not thousands of
test cases for extended periods of
time?

12. Can the tool run for long periods of

time without crashing, or is the tool
itself full of bugs?

408

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 409 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 1. (Continued) Testing Tool Selection Checklist

Item Yes No N/A Comments

13. Talk to customers who currently
use or have previously used the
maintenance tool. Did it meet their
needs?

14. How similar were their testing

needs to yours and how well did the
maintenance tool perform?

15. Try to select a maintenance tool

that is advanced enough so the
costs of updating tests don’t
overwhelm any benefits.

16. If a demo version is available, try it

out before you make any decisions.

17. Does the price of the maintenance

tool fit in the QA Department or
company budget?

18. Does the maintenance tool meet the

requirements of the company
maintenance and testing
methodology?

19. If required, does the tool cover

black-box and white-box features?

20. Does the tool handle problem

tracking effectively?

21. Does the tool automatically

correlate a defect to a test case for
regression testing?

22. Does the test library management

system handle change control,
version control, and configuration?

23. Does the tool capture metric

information?

24. Does the tool provide management

reporting and historical trends?

409

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 410 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

TYPES OF MAINTENANCE TOOLS

This section is a taxonomy of testing tool types followed by a review of spe-
cific tool vendor products. (Also see Section IV — Modern Testing Tools,
for other test tools, vendor names, and contact information.)

Code Complexity Tools

Metrics characterize software with numerical measures of complexity,
which allows software engineers to identify software components that
would be difficult to test or maintain.
Software complexity is one of the most pertinent metrics of computer
programs, and its aim is to objectively associate a number with a program,
based upon the presence or absence of certain characteristics of the soft-
ware such as the number of errors left in the software; effort to design, test,
or maintain a software product; development time; maintenance cost; etc.
The importance of software complexity lies in the fact that knowing the
complexity of a specific software product or its module enables one to
• Predict the cost of maintenance
• Assess the development time, effort, and cost
• Identify critical modules or parts of the software
• Compare programs, modules, programmers based upon according to
software complexity
(See McCabe’s McCabe QA.)

Regression Testing Tools

Each code change, enhancement, bug fix, and platform port necessitates re-
testing the entire application to ensure that the change has not hindered the
quality. Manual testing can no longer keep pace in this rapidly developing en-
vironment. A regression maintenance testing tool facilitates the automation
of the testing process, from test development to execution. Reusable test
scripts are created that test and automatically verify the system’s function-
ality. Prior to a release, one can execute these tests in an unattended mode,
which fosters the detection of defects and ensures quality deliverables.
(See SunTest’s JavaStar 1.2, Test Station, WinRunner 5, Xrunner, Rational
Robot, and Rational TestFactory.)

Load and Performance Maintenance Tools

The purpose of maintenance load testing tools is to simulate a production
environment to determine that normal or above-normal volumes of trans-
actions can be completed successfully in an expected time frame. These
tools test the availability and capacity of system resources, such as CPU,
disk, memory, channel, and communication lines.

410

Copyright © 2000 CRC Press, LLC

 AU9833/ch35/frame Page 411 Friday, March 17, 2000 11:20 AM
Exhibit 2. Vendor vs. Maintenance Tool Type (alphabetic order)

Runtime
Code Load/ Problem CM/Process Web Code Error
Vendor Name Complexity Regression Performance Management Management Site Coverage Analysis
ClearCase x
ClearCase x
MultiSite
ClearDDTS x
ClearQuest x
JavaLoad x
JavaStar 1.2 x
LoadRunner x
McCabe QA x x

Introduction to Maintenance Tools

Other x
Maintenance
Toolsa
Performance x
Studio
PreVue x
Rational Robot x
Rational Visual x
Quantify
411

Copyright © 2000 CRC Press, LLC

 AU9833/ch35/frame Page 412 Friday, March 17, 2000 11:20 AM
412

MODERN MAINTENANCE TOOLS

Exhibit 2. (Continued) Vendor vs. Maintenance Tool Type (alphabetic order)

Runtime
Code Load/ Problem CM/Process Web Code Error
Vendor Name Complexity Regression Performance Management Management Site Coverage Analysis
Rational Purify x
6.0
Rational x x x
TestFactory
Rational Visual x
PureCoverage
6.0
SQA SiteCheck x
Test Station x
TestStudio
WinRunner 5 x
Xrunner x

aSee Exhibits 3 through 8.

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 413 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

(See JavaLoad, LoadRunner, PreVue, Performance Studio, and Rational Vi-

sual Quantity.)

Problem Management Tools

Problem management tools fulfill two major functions: call tracking and
problem tracking. Call tracking targets problems reported by customers of-
ten over telephone lines, receives inputs from a variety of geographically
disperse locations, assigns a responsible person to the problem, and pro-
vides status monitoring and reporting.
Problem tracking handles development process management, change
management authorization, task management (who, what, when, due date,
status); provides statistics, metrics gathering, and reporting; manages his-
torical records and facilitation of understanding; and integrates configura-
tion management and testing tools.
Maintenance organizations need call tracking or problem tracking, or
both. Many organizations choose to integrate their problem management
and configuration management tools to gain better control of their devel-
opment activities and to improve quality. Problem management tools may
be purchased in any of at least three distinct packaging methods:
• Stand-alone, no integration with other tools
• Purchased separately, but integrated with one or more companion
software engineering tools such as configuration management and
test tools—may be from the same or from different vendors
• Bundled with other software engineering tools, usually a configuration
management tool from the same vendor
(See ClearQuest and ClearDDTS.)

Configuration/Process Management Tools

Some maintenance tools provide configuration management, not develop-
ment process management, others provide both but to varying degrees.
Software configuration management tools are concerned with labeling,
tracking, and controlling changes in the software elements of a system.
They control the evolution of a software system by managing versions of
its software components and their relationships.
They identify all the interrelated components of software and control
their evolution throughout the various life cycle phases. Software configu-
ration management tools ensure that design and code are defined and can-
not be changed without a review of the effect of the change itself and its
documentation.
A process management tool controls all the software development phas-
es and activities from requirements to maintenance. These tools are used
to assure a repeatable, optimized development process. An example of
413

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 414 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

how they might be utilized in the maintenance environment is to verify that

a problem report existed and had been approved for fixing and that the as-
sociated design, documentation, and review activities have been complet-
ed before allowing the code to be “checked in” again.
It is important to be certain to determine what form of management is
most important for your project, then be certain the tools you consider
provide that function.
(See ClearCase and ClearCase MultiSite.)

Web Site Test Tools

Web sites are essentially client/server applications—with web servers and
“browser” clients. Web site management tools are designed to help the
Webmaster or business manager manage every aspect of a rapidly chang-
ing site. It helps detect and repair defects in the structural integrity of their
sites, e.g., broken links, orphaned pages, potential performance problems
on Web sites, etc.
(See SQA SiteCheck and Exhibits 3 through 8.)

Code Coverage Tools

The purpose of coverage analysis tools is to monitor the system while a dy-
namic testing tool is executing. They are a form of white-box testing in
which there is knowledge about the internal structure of the program of
the system. Information is provided on how thorough the test was. Graphic
analysis displays how much the system was covered during the test, such
as the percentage of code executed and in which locations. This will pro-
vide the tester with information on weaknesses in the test design, which
can be solved with additional test cases. Unit and integration coverage is
provided with these tools. Unit coverage entails the coverage of the code
and paths within a single program unit. Integration coverage comprises the
interfaces between program units to determine the linkage between them.
(See McCabe QA, Rational TestFactory, and Rational Visual PureCoverage.)

Runtime Error Analysis Tools

A runtime error analysis tool automatically finds defects in an application
and optionally builds a set of test scripts that optimize code coverage. It is
a dynamic testing tool that exercises the application, exploring every op-
tion and selection. It then automatically generates a set of test scripts that
cover both your application’s user interface and source code to the great-
est extent possible in the smallest number of steps. It also indicates which
source code paths have been exercised and identifies untested lines and
functions. It automatically detects program defects.
(See Rational Purify and Rational TestFactory.)
414

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 415 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 3. Java Testing Tools

Tool Name Tool Vendor Description

AppletLoad RadView Part of Radview’s WebLoad tool set; for
Software performance testing of Applets and Java-
Implemented protocols.
AssertMate RST RST’s code assertion toolkit for Java
programmers and class level testers.
Assure for Javaa KAI Java debugging pool—monitors memory,
references, object creation, and lock
acquisitions. Finds thread deadlocks,
stalls, data race conditions,
synchronization errors. Results displayed
in browser with pointers to source code.
For Win95/NT, Solaris.
DeepCover for RST Code coverage tool for Java from RST. For
Java Solaris and Win95/NT.
DevPartner for CompuWare NuMega/Compuware’s
Java Corp. debugging/productivity tool to detect and
diagnose Java bugs and performance
problems, thread and event analysis,
coverage analysis.
Documentary Power Automated source code documentation
for Java Software tool; produces HTML documentation to all
classes, methods, etc., in project as well as
other reference information; for Windows,
Solaris, HPUX.
Jprobe Profiler KL Group Java optimization and monitoring tool,
allows drilling down to hotspots using nine
performance metrics.
jtest! ParaSoft ParaSoft’s automated white box Java test
tool.
Krakatau Power Software metrics tool includes more than 70
Metrics for Java Software OO, procedural, complexity, and size
metrics related to reusability,
maintainability, testability, and clarity. Has
online advisor for quality improvement;
text, graphical, and HTML reporting
capabilities. For Windows, Solaris, HPUX.

415

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 416 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 3. (Continued) Java Testing Tools

Tool Name Tool Vendor Description

Metamata Java Metamata Suite of tools for analysis of Java source
Code Analysis code quality, complexity and quality
Tools metrics, debugging, and more.
Optimizelt Intuitive Java language profiling tool, analyzes use
Systems of memory and CPU resources to find
bottlenecks and to solve Java performance
problems.
RSM Squared Code metrics tool for C/C++/Java—style
compliance, LOC, complexity, class
metrics, hyperlinks to source, HTML
reports. Runs on Win3.1/95/NT, Unix.
SilkBeans Segue Segue’s Java test tool; part of their Silk Web
Test tool suite.
TCAT for Java TestWorks Code coverage analyzer and code analysis
for Java applets; written in Java. For Unix.
TotalMetric RST RST’s Code metrics and OO metrics tool
for Java.
Visual Test McCabe & McCabe Visual Testing ToolSet and
Associates McCabe Quality ToolSet, with Java
coverage and metrics capabilities.
VTune Intel Intel’s performance tuning tool for
applications running on Intel processors;
includes Java support.

Cross-Reference Maintenance Tools

One of the most useful aids to maintenance is the cross-reference list that ac-
companies the compiler source listing. It usually provides a concise, ordered
analysis of the data variables, including the location and number of times the
variables are used, as well as other pertinent information about the program.
In large systems, it is often difficult to determine which modules are called
or used by other programs and where in the system a specific module or pa-
rameter is used. What is often needed is the capacity to produce and devel-
op a cross-reference listing on an inter-program basis rather than on an intra-
program basis. This information can be obtained from some of the available
cross-reference generators. Such information is useful to the maintenance
staff attempting to backtrack to determine where an error occurred.

416

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 417 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 4. Web Link Checking Tools

Tool Name Tool Vendor Description

Alert Viablesoft Link check tool; evaluation version
Linkrunner ware available. For Win95/98/NT.
CyberSpyder Aman Shareware link checker by Aman Software;
Link Test Software capabilities include specified URL
exclusions, ID/Password entries, test
resumption at interruption point, page size
analysis, ‘what’s new’ reporting. For
Win3.1/95/NT.
I-Control Web Future Link checker; evaluation version available;
Weaver ArtForms for Win95/NT.
InfoLink BiggByte Link checker program from BiggByte
Software Software; can be automatically scheduled;
includes FTP link checking; multiple page
list and site list capabilities; customizable
reports; changed-link checking; results can
be exported to database. Freeware and
evaluation versions available.
Linkalarm LinkAlarm Low cost on-the-Web link checker; free trial
period available. Automatically scheduled
reporting by e-mail.
Linkbot Tetranset Tetranet’s tool for checking links, missing
Software page titles, slow pages, stale content, site
mapping; from local drive or remote
server. Evaluation copy available; for
Win95/NT.
Link Scan Electronic Electronic Software Publishing Co.’s link
Software checker/site mapping tool; capabilities
Publishing include automated retesting of problem
Corp. links, randomized order checking; can
check for bad links due to specified
problems such as server-not-found,
unauthorized-access, doc-not-found,
relocations, timeouts. Includes capabilities
for central management of large multiple
intranet/Internet sites. Evaluation copy
available. For UNIX and NT servers.
Requires Perl 5.
RiadaLinx! Riada Link checker; evaluation copy available;
International for Win95/NT.

417

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 418 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 4. (Continued) Web Link Checking Tools

Tool Name Tool Vendor Description

Surf! Segue Link-testing tool used in Seque’s Live
Quality-Web Site Web test tool suite.
Theseus Matter Form Link checker for Mac; evaluation version
Media available.

Exhibit 5. HTML Validation Tools

Tool Name Tool Vendor Description

CSE 3310 HTML Al Internet Shareware HTML validator for Win95/NT.
Validator Solutions (This tool is also integrated into the
‘HomeSite’ Web development/authoring
tool.)
Spyglass HTML SpyGlass Free standalone local-drive HTML
Validator validator. Color-coded display, errors in
list can link directly to error location in
page; editable corrections within display;
selectable validation levels; for Win95.

Comparator Maintenance Tools

Comparators are software maintenance tools that accept two or more sets
of input and generate a report that lists the discrepancies between the in-
put data sets. This maintenance tool can be used for finding changes in
such areas as the source code, input data, and program output and is ex-
tremely useful in ascertaining whether a change made to the system
caused it to fail or work differently. A comparator can also be used to en-
sure that one set of test results is identical to a previous set or to identify
where the results have changed.
Most comparators are developed for a specific system. They may be
general in nature or work on specific parts of the system and perform spe-
cific functions. They are relatively simple to build and are very valuable
maintenance tools.
A comparator is a program used to compare two versions of source data
to determine whether the two versions are identical or to specifically identi-
fy where any differences in the versions occur. Comparators are most effec-
tive during software testing and maintenance when periodic modifications
to the software are anticipated.

418

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 419 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 6. Web Regression Tools

Tool Name Tool Vendor Description

Astra Quick Mercury Mercury’s product for functional testing of Wed-
Test Interactive based e-business applications; can emulate
various browser types and versions and HTTP
protocols. For Win95/NT.
AutoTester AutoTester, AutoTester Corp.’s link check and site test tool;
Web Inc. includes scripting capabilities, automated
documentation, reporting functionality, and the
ability to test Java applets and ActiveX. Works
with MSIE or Netscape browsers. For
Win95/NT/AIX/ Solaris/Tandem/NextStep.
Compuware’s Compuware QARun for functional/regression testing of Web,
QARun Corp. character-based, and GUI systems; for Win95/NT.
e-Tester RSW Software Web functional/regression test tool from RSW.
Includes record/playback, scripting language;
can test image maps, frames, forms, links,
ActiveX, Applets, VBScript, JavaScript. Includes
SiteSpider site element detection and mapping
tool, and a ‘Data Banks’ feature for data-driven
automated testing. Supports external custom
test logic via External Callout Facility. Special
test extensions for Net Dynamics, Web Objects,
Cold Fusion, Microsoft, and Silverstream.
Evaluation version available. For Win95/98/NT.
FormAgent Ventura VCI’s FormAgent for automated form-filling; can
Commun- be configured for multiple users. Can be adapted
ications for partial automation of forms-based Web
testing. Evaluation copy available; for Win95/NT,
NS3.0+, MSIE3.x.
SilkTest Segue Seque’s Web testing tool for functional and
regression testing; includes capabilities for
testing Java applets, HTML, ActiveX, images;
works with MSIE, Netscape, includes
capture/playback capabilities.
WebART WebART WebART, from OCLC, Inc., tool for functional,
regression, and performance testing. Includes
capture/playback/ and scripting language; can
simulate 100–200 users in load testing.
Evaluation copy available. For Win3.1/95/NT.

419

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 420 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 7. Web Security Tools

Tool Name Tool Vendor Description

HostCheck DMW Suite of security test and management tools
from DMW Worldwide. Checks for presence of
sniffers and insecure network configuration,
secure file removal by repetitive overwriting of
location, checks for preexisting security
problems against vulnerability database,
file/directory permissions management and
monitoring, password security testing, user
management and account security checking,
security reporting and test scheduling. For
UNIX platforms.
WebTrends Web Trends Web site tool to detect and fix security
Security Corp. problems. Includes periodically updated
Analyzer Expert knowledge base. For Win95/98/NT.
Compuware’s Compuware QARun for functional/regression testing of
QARun Corp. Web, character-based, and GUI systems; for
Win95/NT.
Netsonar Cisco Cisco’s product for detecting and reporting on
Systems Internet server and network vulnerabilities;
risk management; network mapping. Require
Solaris and Netscape browser.
Inspectorscan Shavlik Shavlik Technologies’ security analysis and
Technologies reporting tool; for NT.
Netective Site Netect Ltd. Netect’s product for analyzing internal and
external security vulnerabilities. For Solaris.
CyberCop Network NT security auditing tool from Network
SCANNER Associates Associates for intranets, Web servers,
firewalls, and screening routers.
COAST Coast Purdue University’s computer security site;
Security Security includes extensive collection of links
Archive Archive organized by subject to security tools, info
resources, etc. Tools list of more than 100
security tools includes many test tools such
as CRACK, COPS, IPSend, Tiger, Secure Sun,
etc.; all tools listed are available for download
from the COAST site.
NukeNabber DSI For monitoring TCP and UDP ports for
intrusions; includes tracer utilities. Freeware
from DSI; for Win95/98/NT.

420

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 421 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 7. (Continued) Web Security Tools

Tool Name Tool Vendor Description

NetRecon Axent Axent Technology’s tools for testing
vulnerability of network systems and
resources from inside or outside the firewall;
exploits IP and non-IP-based protocols;
selective targeting capabilities; creates HTML
reports; ‘Intruder Alert’ capability for 7x24
monitoring. Probes any platform type. Runs
on NT4.0.
L0phtCrack L0pht Password auditing/security check tool from
L0pht. Site also has Internet security advisory
collections. Shareware. For Win95/NT.
Internet ISS Internet Security Systems’ test tool for
Scanner network vulnerability analysis and decision
Toolset support. Can perform scheduled and selective
security probes of network services,
operating systems, configurations,
applications, CGI, and routers for intranets,
firewalls, Web servers. For NT/95, AIX, HP-UX,
Solaris, SunOS, Linux.

Comparator (Windows File Revision Feature). With Windows File Revision

feature one can compare two version of a document. The two documents
being compared must have different file names or the same filename in dif-
ferent folders. To use this feature under Windows 95:
1. Open the edited version of the document.
2. On the Tools menu, click Revisions.
3. Click Compare Versions.
4. Click the name of the original document, or type its name in the File
Name box.
5. Accept or reject the revisions.

Diagnostic Routines
Diagnostic Routines assists the maintenance staff by reducing the amount of
time and effort required for problem resolution. Some common routines are:
• Trace—Generates an audit trail of actual operations during execution.
• Breakpoint—Interrupts program execution to initiate debugging
activities.
• Save/restart—Salvages program execution status at any point to per-
mit evaluation and reinitiation.
• Dump—Gives listings (usually unformatted or partially formatted) of
all or selected portions of the program in main storage at a specific
point in time.

421

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 422 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 8. Web Management Tools

Tool Name Tool Vendor Description

Adobe SiteMill Adobe Adobe’s product for Web site management,
Systems Inc. link checking/updating, page authoring and
editing; available as add-on for PageMill; for
Macintosh.
Astra Mercury Mercury’s Web site management tool; scans
SiteManager Interactive Web site and highlights functional areas
with color-coded links and URLs to provide
a visual map of site. Site map includes
HTML, cgi scripts, applets, etc. Shows
broken links, access problems, compares
maps as site changes, identifies usage
patterns and validates dynamically
generated pages. Change
management/tracking. Evaluation copy
available. For Win95/NT.
BazaarAnalyzer BazaarSoft, Aquas Software’s Web management and
Pro Inc. analysis tool; runs on Web server, interface
via any Java-enabled browser. Manage
multiple sites, users, security; customizable
Web report, realtime alerting for broken
links, etc.; visitor analysis. For NT, Solaris,
HP, Linux, SGI/IRIX, BSD/BSDI.
Blueprint Brooklyn Web site analysis and management tool,
North includes link checker, site mapper,
Software reporting statistics, integrated ftp and
Works, Inc. uploading. For Win95/NT.
Chisel Digital Multifunction tool for behavior and
Technology, performance testing of live network
Inc. applications. Load and stress testing;
verifies firewall effectiveness; supports
HTTP, FTP, ping, SNMP, telnet, TCP, UDP,
ODBC database applications. Can create
and save user-defined test scenarios.
Requires NT and MSIE.

422

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 423 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 8. (Continued) Web Management Tools

Tool Name Tool Vendor Description

COAST Coast Coast Software, Inc. WebMaster site
WebMaster Software management tool; for Web site file
management, link checking, site version
comparisons, page download timing and
estimating, server log file reporting.
Includes HTML editor and file manager,
page display verification, global search and
replace. Evaluation copy available. For
Win95/WinNT.
Cold fusion Allaire Corp. Allaire’s Web development environment
includes integrated test Web server for
immediate site testing, automatic database
query tester, version control. Evaluation
version available. For Win95/NT/Solaris.
DynaBase Inso Corp. Inso’s Web site publishing and development
management product for multi-user control,
version control, link verification, and site
deployment. Capabilities include remote
access, multiple editions, deployment.
Capabilities include remote access, multiple
editions, dynamic publishing.
e-Monitor RSW Software Web tool from RSW for 7x24 Web site
monitoring. Can utilize test scripts created
with their e-Tester tool; allows wide range of
corrective action and notification
responses. Includes a wizard script
generator that generates scripts in standard
Visual Basic. Evaluation version available.
For Win95/98/NT.
Equalizer Coyote Point Load balancing server appliance and site
Systems management tool from Coyote Point
Systems. Web-based interface for load
balancing administration, server failure
detection, real-time server monitoring of
server response time, number of pending
requests, etc.
HotMetalPro SoftQuad SoftQuad’s Web development tool for Web
site authoring/development/management,
includes capabilities link management, site
mapping. For Win95/98/NT.

423

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 424 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 8. (Continued) Web Management Tools

Tool Name Tool Vendor Description

HP Firehunter Hewlett HP’s tool for monitoring, diagnosis, and
Packard management of Internet services; including
performance, fault detection, reporting.
Supports a variety of platforms.
HTML Grinder Matterform Matterform Media’s Web site management/
Media authoring software with multi-file find and
replace, file name management, TOC-
builder, more. Evaluation version available.
For Mac.
HTML Talicom HTML validator, global search-and-replace.
PowerTools Data stamper, spell checker, Meta manager,
image tag checker, HTML-to-text converter,
customizable reports. Link checker.
Validates against various HTML versions,
NS and MSIE extensions; has updatable
rulebase. From Talicom. Free 30-day
evaluation copy. For Win3.1/95/NT.
Interwoven Interwoven, Web development, version control, access
Team Site Inc. control, and publishing control tool; works
with many servers, OS’s, and platforms.
Intranet International VitalSign Software’s suite of products for
Solutions Network dynamically monitoring faults, response
Services times, congestion, downtime, bottlenecks,
timeouts, performance changes for intranet
systems. For NT.
Microsoft Microsoft Microsoft’s ‘Front Page’ Web site authoring
FrontPage Corp. and site management tool; includes site
management capabilities, link checking, etc.
Evaluation copy available.
Microsoft Microsoft Web site development, maintenance,
SiteServer Corp. management tool includes site mapping,
link checker, publishing control, site
analysis; formerly MS Backoffice Live:
WebMapper and also formerly NetCarta
WebMapper until bought out by Microsoft.
For MS Internet Server on NT.

424

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 425 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 8. (Continued) Web Management Tools

Tool Name Tool Vendor Description

MS Visual Microsoft Microsoft’s version 5.0 of their software
Source Safe Corp. version control tool; includes site change
management, Web link checker, site
mapping; can integrate with MS FrontPage.
For Win3.1/95/NT/DOS/UNIX/Mac.
NETClarity LANQuest Suite of browser-based Intranet
performance management and diagnostic
tools from LANQuest. Find network
bottlenecks; capacity planning and analysis.
NetDialect Uniscape Multilingual Web site management solution;
uses a scalable Oracle database that reuses
translation memory across multiple
sites/projects simultaneously. Extracts
information kernels from their native HTML
files, then checks extracted information
against an accumulating repository of
translated sentences, key words, or
glossaries. Translated strings are
automatically populated in the translation
editor. Human or machine translation
completes the translation process. After
review for quality, the native file is
automatically reassembled with the
translated/updated information.
OpenDeploy Interwoven Interwoven’s configurable control system
for deploying from development to
production environments. Includes
automated deployment, security, and
encryption capabilities. Rollback
capabilities if used in conjunction with their
TeamSite product.
PowerMapper Electum For customizable automated site mapping,
Multimedia HTML validation, link checking. Evaluation
copy available; for Win95/NT and MSIE 3.0
or later.
ServerCheck Netmechanic Netmechanic’s on-the-Web tool checks a
Web server’s performance periodically for 8
hours; the resulting report sent by e-mail
includes comparisons to other servers. Site
also includes a link-checker, HTML
validator, spell checker.

425

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 426 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 8. (Continued) Web Management Tools

Tool Name Tool Vendor Description

Site Scope Freshwater Freshwater Software’s product for site
Software monitoring and maintenance. Runs on
servers and monitors server performance,
links, connections, logs, etc., and provides
notifications of problems. Includes
published API for creating custom monitors.
Monitors mimic users end-to-end actions.
For NT or Unix.
Site/C Locutus ‘Set-and-forget’ utility for periodic server
Codeware monitoring for Web server connection
problems, link problems; e-mail
notifications, logging capabilities.
Evaluation version available; for Win95/NT.
SiteBoss Opposite Opposite Software’s tool for Web site
Software management, meta tag management, spell
checking, diagnosis, repair, and
optimization; global search and replace,
HTML-to-text converter, link checker, HTML
validator; integrated HTML editor and
browser. Updatable rulebase. Evaluation
copy available for Win95/NT.
SITEMAN Greyscale Web site management and editing tool
Systems collection from Greyscale Systems. Link
checking. Global search and replace.
Checks for orphan files. Call HTML editor
from within program. Has freeware and
shareware versions. Evaluation copy
available. For Win31./95/NT.
SiteSweeper Site Web site analysis tool checks for broken
Technologies, links, slow pages, missing meta tags, missing
Inc. alt tags, etc. Creates browser-viewable
reports, analyzes local or remote sites,
includes image cataloging with thumbnails.
Evaluation copy available. Free on-the-Web
demo also available. Runs on Win/95/NT.

426

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 427 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Exhibit 8. (Continued) Web Management Tools

Tool Name Tool Vendor Description

SM-Web Service Web site performance measurement
Metrics service, measures from the end-user’s
perspective. Monitors various statistics
such as Response Time, Throughput, End-
to-End Time Comparison among 10 Select
Cities.
SQA Sitecheck Rational Rational’s Web site management tool
Software Corp. includes link checker, finds slow pages,
simulates both Netscape and MSIE
browsers. SSL support. For Win95/NT. 30
day evaluation copy available.
StoryServer Vignette Corp. For Web site collaborative content,
Web System publishing, management, and maintenance.
Supports servers on Solaris, NT 4.0. Can
optimize pages based on incoming browser,
supports various attributes including: CSS,
Cookies, DynaHTML, Frames, Java,
JavaScript, Lynx, Macintosh, MSIE versions,
Netscape versions, Tables, WebTV.
Supports Oracle, Sybase, Informix, UC2, SQL
Server, via native APIs. Supports NS
Enterprise Server, Apache, OpenMarket, MS
IIS; supports NSAPI to Netscape, ISAPI to
Microsoft IIS and Fast CGI to Apache and
OMI. Requires Java Runtime Environment.
TeamSite Interwoven Interwoven’s collaborative Web site
production control, administration, and
management product for enterprise-wide
Internet and intranet projects. Includes
version control, browser interface,
comparison capability, file edit merging,
variable lock controls. Client side requires
NS 3.01+ or MSIE 3.01+; server side
compatible with many available Web
servers.

427

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 428 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Exhibit 8. (Continued) Web Management Tools

Tool Name Tool Vendor Description

TestWorks/Web Software Collection of Web test tools for
Research capture/playback, load testing, Java testing
from Software Research, Inc. Includes their
CAPBAK/Web for Web test tool, XVirtual
load generation tool, and TCAT for Java test
coverage tool. For Win95/NT and UNIX
platforms.
Unicenter TNG Computer Site management application from
w/Web Associates, Computer Associates includes access and
Management Inc. security control, monitoring, logging,
Option metrics, server management, network
management. For MS and Netscape Web
servers.
WebSite CyberTeam Web-content workflow management system
Director with browser-based interface includes
configurable workflow management, e-mail
submission of Web content, and e-mail
notifications; allows defining and applying
existing workflow and approval rules to Web
content management process. For NT, UNIX
systems.
WebSite Pro Solutions Web site management tool from Pro
Manager Solutions Software; link checker, change
management. Evaluation version available.
For Win95/NT.
WebTrends Web Trends Web site management tool including log
Enterprise Suite Corp. analysis, link analysis and quality control,
content management and site visualization,
alerting, monitoring and recovery, proxy
server traffic analysis and reporting
WireTap Platinum Continuously monitors and manages
network, intranet, and Internet
performance; provides real-time Web traffic
analysis, and monitors Web and SQL
transaction response times. From Platinum
Technologies. Supports AIX, HP-UX, Solaris,
NT.

Compilers often provide diagnostic capabilities that can assist program-

mers in analyzing the execution flow and capturing a myriad of data at pre-
determined points in the process. In the hands of a skilled maintenance
428

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 429 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

programmer, these diagnostics can help identify the sections of code that
cause the error as well as identify what is taking place there.
Although these aids are extremely useful, they are after-the-fact mainte-
nance tools used to help determine what has gone wrong with an opera-
tional system. Far more useful are diagnostic capabilities designed and
implemented within the source code as it is developed. This type of diag-
nostic is normally disabled but can be turned on through the use of one or
more control parameters.

Application Utility Libraries

Most operating systems provide support and utility libraries that contain
standard functional routines (e.g., square roots, sine, cosine, absolute val-
ues). In addition, high-order language compilers have many built-in func-
tions that can be used by the programmer to perform standard functions.
Just as these libraries provide standardized routines to perform processes
that are common to many applications, large systems should have a proce-
dure library that contains routines common to various segments of the ap-
plication system. These functions and utility routines should be available
to everyone working on the system, from the developer to the maintenance
staff. Application support utility libraries assist by
• Saving time (the programmer need not reinvent the wheel).
• Simplifying the changing of common code by changing all programs
that use a module. This usually requires relinking or recompiling each
affected program, but it eliminates the need to change lines of code in
each program.
• Providing wider availability of utility procedures developed by one
person or group to all persons working on the system.
• Facilitating maintenance of the system by keeping the code in a cen-
tral library or set of libraries.
In addition to the stored library routines, all the source code for the ap-
plication system should be stored in a centralized, online library. Access to
this library should be controlled by a librarian who maintains the integrity
of the library and the code.

Online Documentation Libraries

System documentation usually consists of one or more hard-copy folders
or files stored at a central location. The need for the maintenance staff to
have access to these documentation folders and the need to keep the doc-
umentation up to date and secure are sometimes at cross-purposes. It is
therefore recommended that as much documentation as is practical also
be kept online in documentation libraries that the maintenance staff can
access at any time. A librarian should control updating of this library.

429

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 430 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Online/Interactive Change and Debugging Facilities

Interactive debugging provides significant advantages over the batch
method because of the convenience and speed of modification. With inter-
active processing, the maintenance programmer can analyze the problem
area, make changes to a test version of the system, and test and debug the
system immediately. The alternative—submitting a batch job to perform
the testing—requires much more time to complete. Although this may be
necessary in some cases because of system size or resource requirements,
most maintenance activities (even perfective maintenance) are highly crit-
ical problems that must be addressed and solved as quickly as possible. In-
teractive processing provides a continuity that enables greater
concentration on the problem and quicker response to the tests. Although
estimates of the increase in productivity vary widely, there is clearly a sub-
stantial improvement when the maintenance programmer has online inter-
active processing capabilities.

VENDOR TOOL DESCRIPTIONS

The following is an overview of some of the major software maintenance
tool vendors. No one tool is favored over another. Exhibit 2 cross-referenc-
es the tool vendors with the tool types.

McCabe’s McCabe QA
Product Description. This tool provides a comprehensive solution to the
following issues: (1) What is the quality of the system? (2) Has it been con-
structed in an efficient and effective manner to minimize testing and main-
tenance costs? (3) How can we accurately measure risk and improve
quality while still meeting critical deadlines? (4) Have new versions of the
software increased or degraded the quality?
With its interactive, visual environment, one can quickly and objectively
gauge the quality of the code. The tool combines cutting-edge graphical
technology and industry standards of measurement to help focus resourc-
es where they will have the greatest impact on your projects.

Product Features.

• Module-by-module metric calculations that help identify where a pro-

gram is more likely to contain errors.
• Graphical displays represent the structure of code and the metrics
rankings to provide easy and valuable assessment of even large
systems.
• A database of software characteristics including metrics and flow-
graphs, used as a valuable resource for future software changes and
upgrades.
• Metrics
430

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 431 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

— McCabe Cyclomatic Complexity

— McCabe Essential Complexity
— Module Design Complexity
— Integration Complexity
— Lines of Code
— Halstead

Platforms Supported.

Sun Solaris 2.5.1 (Motif Only) Ada, C

PC Windows NT 4.0, Windows 95 C++, COBOL, FORTRAN
IBM AIX 4.2 Java, Visual Basic
HP HP-UX 10.2
SGI IRIX 5.3

SunTest’s JavaStar 1.2

Product Description. JavaStar is a tool for testing Java applications and
applets through their graphical user interfaces (GUI). This tool helps you
test your application by allowing you to record and automatically play
back a series of user actions (e.g., typing, mouse clicks) on your applica-
tion. At any time during playback, you can compare the state of your appli-
cation with previous results; this allows you to automatically compare the
behavior of your Java application on a number of platforms, and from one
release version to the next.
JavaStar also supports powerful scripting and comparison capabilities
for very thorough testing.
JavaStar is a very cost-effective way to test Java programs. You don’t have
to learn a new or difficult special-purpose proprietary testing language sim-
ply to make or modify your test scripts. Your code is Java, so use Java.

Product Features.

• Runs on JDK 1.x or JDK2 compatible platforms and environments: it’s tru-
ly cross-platform. JavaStar leverages the benefits of Java technology for
GUI regression testing. It is the first testing tool to test at the language
level and the only GUI tool that runs anywhere that Java applications
and applets run. Java’s “write once, run anywhere” advantage simpli-
fies the test creation process with only one set of tests to create and
maintain, providing immediate return on investment.
• Developers and QA engineers can speak the same language. JavaStar’s
scripting language is Java. Since JavaStar’s tests are written in the Java
programming language, there are no machine-dependent scripting lan-
guages to learn, so QA engineers and developers are finally able to
431

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 432 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

work with a common language. Defects discovered during testing can

be reproduced right on the developer’s machine, increasing their con-
fidence and understanding of test results.
• Improved test thoroughness and accuracy: use Java to test Java. Using
the exact same test code to test an application on every platform in-
creases test consistency and accuracy.
• Lowered total cost of ownership. Because JavaStar is written in Java
and its scripting language is Java, only one tool needs to be learned
and the same test will run on all platforms. This makes it is easier to
learn and use than multiple-platform-specific tools, less expensive to
support, and less expensive for total cost of ownership. This frees up
test resources, reduces development cycle time, and improves overall
software quality.
• Internationalization: use the same test for internationalized versions. Be-
cause JavaStar is running in the same process as a Java application, a
test executes as intended regardless of the language the application’s
GUI displays, even if objects in the GUI have been moved around on
the screen. This has substantial bottom line impact on developers
who develop internationalized versions of applications.
• JavaStar’s modular approach provides a quick way to build robust tests.
Small, focused test scripts are quickly linked together into robust
test suites using the point-and-click interface of the JavaStar Visual
Test Composer. New tests can be created with these reusable task-
specific test components to reduce the time and cost of developing
applications.
• Automatically creates a virtual tester. JavaStar creates a virtual tester
that behaves as a human tester would. JavaStar drives the application
to a certain point, compares the data on screen and the state of com-
ponents with previously captured expected results. JavaStar’s auto-
mation makes testing faster, easier, and more cost-effective.
• Advanced GUI and API test capabilities show JavaStar’s power and flex-
ibility. JavaStar has fully editable Java scripting, GUI mapping, and vi-
sual-test composition. Through JavaStar, testers can access what
appears in the GUI as well as control and verify non-GUI (API) events.
Access to both GUI and API levels of the application increases a QA en-
gineer’s ability to produce rigorous, accurate tests.
• Monitor real-time results or detailed reports. JavaStar displays a test’s ex-
ecution graphically, flashing each node as it executes. QA engineers can
track a test’s real-time execution, review the detailed results in JavaS-
tar’s Results Viewer when convenient, or extract a report to HTML.
• Easy updates to multiple tests with declaration files. JavaStar makes it
possible to update a whole collection of tests by simply editing one file
they all reference. This reduces test maintenance when an application
changes during the development lifecycle and produces significant
time savings.
432

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 433 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

• Increases test versatility by removing hard data. JavaStar’s tests are eas-
ily parameterizable, which makes it easy to change values in a test by
replacing hard-coded data with references to data stored in external
files. Tests that are independent of specific data have wider usability
so fewer modules can be combined to make more varied tests.

System Requirements.

• 5 MB RAM
• 4 MB disk space
• Any additional requirements of the object under test

Platforms Supported. Developed completely in the Java language, and

designed to run on all Java-compatible platforms. Requires a JDK 1.1.x or
JDK 2 compliant Java Virtual Machine.

Rational Robot
Product Description. Rational Robot allows one to create, modify, and
run automated tests on Web, ERP, and client/server applications. It is the
only test automation solution that offers reusability and portability of test
recordings across Windows platforms to provide one recording that plays
back on all Windows platforms.
Rational Robot includes comprehensive Object Testing of object prop-
erties and data for C++ and other integrated development environments
(IDEs).

Product Features.

• Part of a seamlessly integrated product suite for testing Windows NT,

Windows 98, and Windows 95 client/server and Internet applications
to deliver one of the industry’s leading solution for testing cross-Win-
dows client/server and Internet applications.
• Uses Object Testing to completely test 32-bit Windows objects and
components, including ActiveX Controls, OLE Controls (OCXs), Visual
Basic Controls (VBXs), Visual Basic objects, PowerBuilder objects, Or-
acle Developer/2000 objects, Win32 controls, and more.
• Delivers Rational’s Object-Oriented Recording technology to provide
the fastest, most intuitive test creation with the shortest learning
curve.
• Includes SQABasic an integrated, Visual Basic syntax-compatible
scripting environment to deliver the full power of an integrated pro-
gramming environment for script development.
• Includes seamlessly integrated Web site testing power with Rational
SiteCheck, to deliver comprehensive Web site analysis, performance
measurement, and repair technology.

433

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 434 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

System Requirements.

Memory: 16 MB; 24 MB recommended

Disk Space: 40 MB
Computer: PC with 486 processor; Pentium-class processor recom-
mended

Platforms Supported. Windows 98, Windows 95, or Windows NT

Rational TestFactory
Product Description. Rational TestFactory automatically detects runtime
errors without user assistance and generates optimal scripts for regres-
sion testing. It is a unique automated software quality tool that does for
quality engineers what the word processor did for writers. Rational
TestFactory finds reliability defects in Visual Basic applications automati-
cally, without recording or scripting.
This tool delivers on the promise of automated testing by exhaustively
and automatically exercising the application to test every path through it
for reliability defects. Whereas functionality testing requires user interven-
tion, organizations can now perform reliability testing with Rational
TestFactory automatically, without user intervention.
Rational TestFactory automates the tedious and error-prone aspects of
reliability testing. Rational TestAccelerator helps you perform this reliabil-
ity testing even faster by harnessing multiple computers to perform testing
in parallel. Rational TestFactory lets you divide automated test develop-
ment into a series of steps. Rational TestAccelerator lets you develop and
run these steps on multiple computers. Rational TestAccelerator performs
test generation and test execution in parallel, so you finish reliability test-
ing faster.

Product Features.

• Finds defects in your applications automatically, without recording or

scripting.
• Exhaustively and automatically exercises your application to test ev-
ery path through it for defects.
• Creates optimized test scripts that can be used with Rational Robot
for regression testing.
• Tests more of your application.

System Requirements.

• Rational TestFactory:

434

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 435 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

— 64 MB, 166 MHz

— 300 MB disk space for Rational TestStudio
• Rational TestAccelerator:
— 64 MB, 133 MHz
— 92 MB disk space

Platforms Supported.

• Rational TestFactory:
— Windows NT, Windows’95, or Windows’98 Visual Basic 4, 5, or 6
• Rational TestAccelerator:
— Windows NT, Windows’95, or Windows’98

AutoTester’s Test Station Tool

Product Description. AutoTester Test Station is the automated testing so-
lution designed specifically to help one increase the quality of character-
based PC and host applications. AutoTester provides immediate produc-
tivity through capture/replay style test creation, yet stores the tests as
well-documented, easily maintainable, object-aware tests. Both the skilled
developer and expert application user benefit from AutoTester. The prod-
uct includes an easy to use menu-driven interface as well as a powerful
command set for advanced scripting needs.
Test Station and Test Library Manager work in tandem to give one the pre-
mier automated testing solution for character-based PC, midrange and main-
frame applications. Test Station is an integrated environment that allows
virtually anyone to develop, document, and execute a comprehensive auto-
mated test library. Test Library Manager is a central repository for the test
library components that provides change and version control and global
maintenance for tests across an entire application development life cycle.

Product Features.
• Flexible test capture—Lets one build consistent, documented tests
that can be used over the life of the application from tester to tester
and release to release. With Test Station, tests can be captured at any
point in the software development process.
• Unattended test execution—Tests are intelligent scripts that provide
dynamic verification of application responses against expected re-
sults, duplicating expectations and decision points. When unexpected
application responses occur during test execution, the tests identify
those responses and react accordingly. Recovery options log the de-
tails of application failures and then continue the testing process if
possible. In addition, Test Station’s playback synchronization pro-
vides proper test playback regardless of system performance.

435

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 436 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

• Reusability and maintainability—Helps one develop an automated test

library that can be easily modified to account for new or different ap-
plication behavior over time. For ease of maintenance, tests can be ed-
ited while in the application and then executed immediately, or they
can be edited off-line with Test Station or any text editor.
• Documentation and reporting—Each step of every test is automatically
documented in English for ease of understanding. Tests are identified
with detailed descriptions, test case numbers, and test requirement
identifiers for cross-reference purposes. After test execution, detailed
results are available on-line or in report format for immediate review
and analysis.
• Scripting—Includes the AutoTester Scripting Language. Designed to
supplement the capabilities of Test Station, this language is a powerful
command set that can accommodate unique testing needs and pro-
vide general task automation functionality.

System Requirements.

• Test Station:
— IBM PC 386 or 100% compatible machines
— MS-DOS or PC-DOS 5.0 or higher
— 326K conventional memory or 30K with LIM 4.0 compliant expand-
ed memory manager or DPMI 0.9 compliant extended memory man-
ager
— 10 MB minimum storage requirements
— Supports most network terminal emulation and communications
protocols, including IBM 3270, IBM 5250 (AS400), Hewlett-Packard
2392, Tandem 6530 and Unisys
• Windows 3.X:
— IBM PC-386 or greater and 100% compatibles
— 4 MB minimum memory plus Windows system requirements
— 10 MB minimum disk storage
— Supports Wall Data Rumba (Office 2.1A) and Attachmate Extra!
V4.3A terminal emulation
• Windows’95 and Windows NT-16-BIT:
— IBM PC-486 or greater and 100% compatibles
— 4 MB minimum memory plus Windows’95 or Windows NT system
requirements
— 8 MB minimum disk storage per installed copy
• OS/2:
— IBM PC-486 or greater and 100% compatibles
— 4 MB minimum memory plus OS/2 system requirements
— 10 MB minimum disk storage
— Supports IBM OS/2 Communications Manager terminal emulation

Platforms Supported.
436

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 437 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

• Windows 3.1x
• Windows’95
• Windows NT – V4.x local testing 16-BIT applications only; no emula-
tion supported

Mercury’s WinRunner Tool 5

Product Description. WinRunner provides an easy way to test cli-
ent/server GUI applications. It simplifies test automation, providing a pow-
erful, productive, and cost-effective test solution. And with WinRunner’s
RapidTest scripting, new testers can overcome the initial barriers to test
automation by giving the test script development process instant momen-
tum. Application testers and developers can now get high quality software
without compromising on-time deployment for Windows, Windows’95, and
Windows NT.
WinRunner 4.0 features a powerful new approach to testing, RapidTest.
RapidTest automatically creates a full suite of GUI tests from the applica-
tion. RapidTest gets users started fast; instead of requiring users to create
their first set of tests manually; they can use a Wizard to create test scripts
directly from the application.
Today, test automation has successfully replaced manual test execution
with automated test execution. But when it comes to building the automat-
ed tests, most conventional testing tools still rely exclusively on one-line-
at-a-time scripting techniques like programming and object-oriented re-
cording. These conventional tools merely transfer the burden from manual
testing to manual test development.

Product Features.

Visually Integrated Scripting features:

• Visual Testing for powerful, flexible test creation productivity.
• Interpreted Development Workspace with test script interpreter and
Multiple Document Interface for simple management of script
development.
• Powerful Script Language to test everything that needs to be tested.
• Exception Handing with built-in routines for automatic recovery.
• Powerful Script Debugger to quickly “test” and fix scripts when prob-
lems occur.
• Flexible Verification to know exactly whether the application is working.
• New Visual Reporting that integrates high-level summary reports with
detailed records for every test verification result, in a new, interactive
reporting tool.
Script Mapping features:

437

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 438 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

• Handles application changes automatically, using Script Mapping for

adaptable and reusable tests.
• Learns the application hierarchy, organizing objects by window. It also
handles independent GUI maps for separate applications simulta-
neously, and can invoke them automatically during testing.
• GUI map provides a single point of control for multiple tests by updat-
ing one attribute of an object in the map—its effect updates all scripts
automatically.
• Includes an interactive editing tool for viewing or modifying the map
file. Users can choose which attributes to track for which objects, and
what to name the objects in the test script, affording complete flexibility
for defining how WinRunner looks for and identifies application objects.
Custom Control features:
• Integrated object support for major development tools and industry
standard controls.
• Open API for custom controls to enable users to define their own test-
ing support for objects.
• Analog recording and text recognition as an alternative for verification.
Powerful Client/Server GUI Test Automation:
• Provides a new, fully documented Open Testing API enabling users to
create full automated testing support for custom objects—capture, re-
play, and verification.
• Supports point-to-point mouse movements, bitmap comparisons or
bitmapped test based on fixed window coordinates.
• Can automate tests that depend on movement between fixed window
coordinates, such as in graphical or drawing programs and programs
that do not have GUI objects.
• Text recognition makes it possible to read text displayed by these ob-
jects as alphanumeric data and provides the ability to perform key
test operations when hooks are not available to retrieve text data from
displayed objects.
System Requirements.

• Minimum 16 MB RAM
• Minimum 16 MB disk space

Platforms Supported.

• Windows’95
• Windows NT

438

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 439 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Mercury’s XRunner (Unix) Tool 4

Product Description. XRunner offers a toolset for GUI test automation to
run quickly and smoothly. Its fully integrated Visual Testing environment
makes test development easier by incorporating simplified test script man-
agement, point-and-click selection, interactive debugging and more. To
help one get started, XRunner’s Script Wizard learns the application by
navigating its way through all available UI paths to create a complex test
script suite. With XRunner, one is guaranteed that GUI application testing
is fast, reliable, and complete across all UNIX platforms.
XRunner extends a powerful set of automated testing utilities to ensure
GUI reducing the time and expertise needed for creating, running, and
maintaining automated tests. XRunner runs on all UNIX platforms and may
be ported for testing across multiple environments such as Microsoft’s
Windows 3.x, Window’95 and Windows NT. One can develop a test once on
one platform, and replay it on another for added versatility.

Product Features.

Automated GUI Regression Testing features:

• XRunner runs on all UNIX platforms and may be ported for testing
across multiple environments.
• RapidTestTM Script Wizard, which automatically learns the entire ap-
plication and generates tests for unattended regression testing.
• Visual Testing environment for combining object-oriented recording.
• Point-and-click test generation and test script logic into a single envi-
ronment.
• Flexible verification and replay options.
• Sophisticated reporting tools.
• Portability across multiple platforms and more.
Automatic Test Generation features:
• A GUI Regression Test, which captures a baseline checkpoint of GUI at-
tributes for every window that opens.
• A Bitmap Regression Test, which compares bitmaps between versions
by creating a screen capture for every window that opens.
• A User Interface (UI) Test, which checks adherence to X Window UI
conventions for every window that opens.
• A Template Test, which creates a test framework for future use.
Fully Integrated Scripting Environment features:
• Provides flexibility to create test scripts as one uses the application
and offers point-and-click, recording, and programming.

439

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 440 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

• Records actions performed on a widget, such as selecting an item from

a list or pressing a specific button, XRunner records a context-sensi-
tive test script. XRunner is smart enough to select the item or press
the button even when the UI changes.
• XRunner also supports analog test scripts when the tests are depen-
dent upon movements between fixed window coordinates and do not
have individual GUI objects. An analog test script will replay exact
mouse movements or clicks and keystrokes—such as clicking the left
mouse button.
• One can also use the programming method when enhancing tests cre-
ated by recording, adding loops for flow control, setting and using
variables, using conditional branching, filtering and report messaging.
XRunner’s Test Script Language (TSL) is based on the C programming
language with added testing functions. By implementing the program-
ming test method, users can tailor their tests to meet specific func-
tions.
• XRunner’s test script interpreter gives one test development power,
since it supports simultaneous point-and-click test development, re-
cording of user operations, and enhanced test script programming.
• To create the best possible script based on the testing requirements,
XRunner fully supports mixing test script methods rather than requir-
ing one to use them separately. It also provides a interactive debugger
that enables one to “test the tests” for optimal performance.
Flexible Verification features:
• Using a point-and-click verification method of selecting the objects on
the screen, one chooses the type of checkpoint to insert in the test
script.
• Text recognition is a verification option exclusive to XRunner.
• XRunner is the only tool with a complete Optical Character Recogni-
tion (OCR) engine to recognize text such as checking console windows
for error messages.
• XRunner can also verify images, objects, files, and tables. For example,
XRunner supports tables in Oracle Developer/2000 applications.
• Likewise, XRunner provides open systems extensions that will allow
one to launch shell scripts, system utilities, and tools.
• XRunner can also verify Motif programs using WidgetLint, a set of ver-
ification functions used to test Motif applications. XRunner detects
widget color and attachment problems, as well as any unmanaged wid-
gets to help one effectively debug Motif applications. Its open API al-
lows one to implement WidgetLint verification functions.
Enhanced Replay Modes:
• XRunner provides several test script replay modes. Built-in automatic
and custom synchronization allows one to run tests unattend-
440

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 441 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

ed—overnight or during the weekend—to maximize the application

development time.
• In addition, XRunner can run in background mode, freeing up the
workstation during the day. One can continue writing code while
XRunner executes test scripts.
• Provides exception handling to keep test execution on track. Excep-
tion handling offers automatic built-in recovery, including
— Overcoming unexpected conditions and resuming test execution
without halting the test,
— Invoking a series of procedures to dismiss unexpected objects,
— Rewinding test script execution to a previous step,
— Navigating elsewhere in the application,
— Recording errors in the test log along with steps taken to resume
testing,
— Exiting the test when encountering certain surprise conditions.
• XRunner also enables one to define error recovery routines to ensure
reliable replay and keep tests from coming to an abrupt halt.
Interactive Reporting Tool features:
• XRunner’s interactive reporting tool combines a high-level view with
detailed statistics about what bugs were found by the test and where.
• Includes the ability to drill down errors into greater detail, pinpointing
the exact line in a test script. Both graphical and textual reports chart
the testing results for further analysis.
• Interactive reporting identifies bugs that were found by the test both
in summary and in detail. A color-coded tree shows all executed tests
along with their results.
Script Mapping features:
• XRunner handles application changes automatically using Script Map-
ping for Adaptable, Reusable Tests (SMARTest), which automatically
maintains object specific data independent of individual scripts.
• XRunner’s SMARTest monitors GUI application changes automatically
so that the tests will run correctly.
• Automatically creates a SMARTest GUI map for the tested application.
When SMARTest learns the application hierarchy, it captures key ap-
plication attributes and organizes objects hierarchically, window by
window. SMARTest guarantees test scripts will work correctly when
the application changes without requiring rework.
Portability features:
• XRunner’s TSL is designed to port tests across all UNIX and Microsoft
Windows (Windows 3.x, Windows NT, Windows’95) platforms.

441

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 442 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

• It provides the only scalable load testing solution for managing the
risks of client/server systems.

System Requirements.

• 16 MB minimum RAM
• Approximately 100 MB disk space

Platforms Supported.

• UNIX

SunTest’s JavaLoad
Product Description. Implementations of applications and applets writ-
ten for the Java platform have emerged as the leading technology to imple-
ment client/server and Internet-based applications. It is crucial to
understand how these applications behave and react under a variety of
load conditions before they are deployed. JavaLoad software allows devel-
opers to target load testing at every point in an application’s architecture
and the development process. From running GUI clients directly to target-
ing server-side interfaces using protocols like HTTP, CORBA/IIOP, RMI, JD-
BC, or proprietary networked protocols, JavaLoad software helps you
ensure that your Java-technology-based distributed application is sol-
id—end to end.
System developers depend on load testing to isolate potential bottle-
necks or problems before deploying their business-critical Java-technolo-
gy-based applications and applets. Because JavaLoad software is written in
the Java programming language, it can load test your application at every
tier of the system, employing any number of client machines. JavaLoad
software can test clients and servers in a heterogeneous environment—the
norm in real-world enterprises. From a single point of contact, JavaLoad
software stresses your entire system to isolate and identify potential client
and server bottlenecks.

Product Features.

• Cross-platform—Since JavaLoad software is the only load testing tool

written in the Java programming language, only the JavaLoad product
is cross-platform. It will run anywhere your Java-technology-based ap-
plication or applet can. Developers and QA engineers can use one tool
to test distributed Java-technology-based applications on all plat-
forms compatible with Java technology.
• JavaLoad console provides a single-stop testing point of contact, any-
where you are—JavaLoad software’s powerful GUI console provides a
central point of contact, control, and analysis. Even better, you can ac-
cess the Commander network, and control enterprise-wide load test-
442

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 443 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

ing from any machine, anywhere in the network, so your single point
of contact can move with you.
• End-to-end load testing—With JavaLoad software you can design load
tests to meet specific requirements. JavaLoad software can load test
an enterprise application from a pure client perspective or isolate
each server-side interface and protocol. Testing with JavaLoad soft-
ware helps ensure your enterprise application can handle the load it
needs to handle, without creating problems elsewhere.
• Development life cycle load testing—JavaLoad software can be used
throughout the product development life cycle. JavaLoad software is
compelling among load testing tools, because it can validate architec-
tures, benchmark hardware, and stress the integrated system.
• Tightly integrated with JavaStar tool—Coupled with Sun’s JavaStar
product, a Java GUI capture/relay tool, JavaLoad software can concur-
rently invoke numerous JavaStar scripts that faithfully replay user
events using the actual Java-technology-based GUI clients of an enter-
prise application. Using JavaStar timers, any event can be timed and
recorded, reporting the true response time a user will experience un-
der loaded conditions.
• Get load test results at your convenience—Using the JavaLoad console,
from any machine accessible to the JavaLoad test, the JavaLoad prod-
uct conveniently generates reports of all test data, including the num-
ber of simulated users engaged, the average response time per user,
an analysis of the session, and a comparison of different test sessions.
The data are critical not only to finding but also to fixing the problems
that decrease productivity and compromise enterprise information
assets. Because JavaLoad software leverages the Java technology’s
animation capabilities, you can run enterprise-wide load testing, and
see graphical reporting on bottleneck and performance problems all
over the enterprise, in real time. This lets developers find problems,
understand causes more clearly, and fix them more rapidly.
• Telemetry channels monitor each tier of the system—Whether it is client
response time, number of simulated users, or database server data ac-
cess time, any telemetry data that can be expressed as a name-value
pair can be accessed, monitored, and reported—in real time or as a
post-load test report or chart.
• Synchronized test information—JavaLoad software stores all test infor-
mation in the JavaLoad Central Repository including the programs
and data files that comprise the load tests, and all result data generat-
ed from the load sessions. JavaLoad software automatically synchro-
nizes this data across the test network without relying on any file
system protocol such as NFS or FTP. JavaLoad software ensures that
all load tests on each host are running the same version. After running
test sessions, JavaLoad software collects all test results and records

443

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 444 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

them in a central repository, making automatically generated Web-

based load test reports available any time.
• Simulates user activity—With JavaLoad software, load testing is per-
formed by the virtual user. A virtual user can be designed to perform
a list of tasks. The tasks performed by a virtual user can be the invo-
cation of any Java or non-Java technology-based program. This allows
the JavaLoad product to be customized to simulate any user, using ex-
isting tests or creating new ones. Once a virtual user is defined, it can
be replicated and deployed throughout the enterprise network to sim-
ulate real usage loads, no matter where in the enterprise they oc-
cur—in the test lab or the call center floor.
• Completely reusable components—Once designed, any components
you need are always available to you to construct future tests, saving
both time and money.
• Web application load testing—JavaLoad software comes packaged
with a Web plug-in that can capture and replay HTTP events using any
Web browser. The plug-in is designed to capture all HTTP events and
create a Java program that will faithfully replay and time the recorded
events, and ensure that all recorded Web server response codes are
received. When invoked by the JavaLoad product, the plug-in play-
back program can be replicated and distributed over your entire test
network to simulate a few dozen to thousands of users accessing your
Web-based application concurrently.
Today, applications in many sectors, including e-commerce, the Web, te-
lephony, order-entry, ERP, call center, and manufacturing, need load test-
ing. Because Java technology links together heterogeneous environments,
load testing these applications becomes more important than ever.

System Requirements.

• 3 MB RAM per Java virtual machine

• 3 MB RAM per GUI client user
• 60 KB per network user
• Any additional requirements of the system under test

Platforms Supported. Certified Java-compliant platform that conforms to

JDK software, version 1.1.5, 1.1.6, 1.1.7, 1.1.7A.

Mercury’s LoadRunner Tool

Product Description. LoadRunner is the integrated client, server, and
Web load testing tool. It provides a scalable load testing solution for man-
aging the risks of client/server systems. Using a minimum of hardware
resources, LoadRunner provides consistent, repeatable, and measurable
load to exercise a system. It exercises the client, server, and Web system

444

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 445 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

just like real users. It contains a single point of control for client, server,
and Web load testing and supports hundreds or even thousands of virtual
users.
By automating both client and server load testing from a single point
of control, LoadRunner helps developers get an accurate view of system
behavior and performance throughout the application development life
cycle.

Product Features.

Client Load Testing features:

• Exercises the system just like real users, driving real applications
through the virtual clients simultaneously from a single point of control.
• Includes an integrated set of new load testing components: Virtual
User Generator, ScenarioWizard, Visual Controller and Load Analyzer.
• Synchronizes all virtual users to create peak loads, pinpoint bottle-
necks, and isolate problems.
• Records test scripts automatically at GUI, SQL, Web, and terminal lev-
els.
• Aids in isolating problems at client, server, and network level.
Server Load Testing features:
• Supports both two-tier and three-tier client/server architectures.
• Generates an abstract data file of virtual users for non-programmers.
• Generates a simple C code file of virtual users for programmers.
• Verifies data retrieved from the server.
• Supports multiple client/server protocols.
Data Analysis features:
• Presents clear, attractive graphs and reports for analyzing load testing
data.
• Compares data across platform configurations and virtual users to
help isolate and pinpoint problems.
• Displays both code and GUI.
• Measures performance “end-to-end” from client through application
server and to the database.
• Handles GUI changes automatically by maintaining scripts at object
level.
Web Load Testing features:
• Supports HTTP, HTML, and Java applets.
• Defines transactions automatically for individual and groups of HTTP
messages.
• Supports GET, POST, CGI messages.

445

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 446 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

• Creates test scripts by recording the actions of a user or user groups

surfing a Web site.
• Determines maximum number of concurrent users a Web site can
handle.
RTE Load Testing features:
• Records user interactions with character-based applications to create
test scripts.
• Inserts synchronization points automatically on unique text or cursor
positions on the screen.
• Generates a log file for debugging scripts and scenarios.
• Replays RTE virtual user sessions just like a movie recording.
• Verifies values as defined by row, column or screen while server is un-
der peak conditions data from the server visually with an on-line serv-
er monitor.
• Exports data to standard formats (Microsoft Word, Microsoft Excel,
Lotus 1-2-3, e-mail and more).

System Requirements.

• Controller
— 32 MB RAM
— 70 MB disk space
• Virtual Users
— Minimum 2 MB per virtual user
— 256 MB/100 virtual users
— Disk space: 10 MB each

Platforms Supported.

• Windows 3.x
• Windows NT
• Windows’95
• Sun OS, Solaris, HP-UX, IBM AIX, NCR

Client/Server Protocols Supported.

• SQL: Oracle OCI, Oracle UPI, Sybase dbLib, Sybase CtLib, Informix I-
net
• ODBC
• TP Monitors: Tuxedo
• Messaging: WinSocket
• Web: HTTP, Java
• Character-based: TTY, IBM 5250, IBM 3270
• Applications: SAP R/3, Oracle Financials, PeopleSoft, Baan

446

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 447 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Rational’s preVue Tool

Product Description. With preVue, Rational offers enterprisewide testing
solutions. Products and services are provided that reduce risk, lower
costs, and increase user satisfaction when deploying applications for cli-
ent/server, X Window, ASCII, and Web environments.
The newest release of the preVue product line, release 5.0, offers extend-
ed graphical analysis capabilities, expanded client/server support for load
testing, and the new preVue-Web extension. preVue-Web allows perfor-
mance testing of the WW server with thousands of Web users.
preVue-C/S applies heavy user loads to database servers and application
servers to give accurate performance and salability data. Understanding
system limitations and pinpointing potential breakpoints before they are
seen by end users is only possible when a real-life user load is applied to a
server.
preVue-Web records HTTP traffic, downloaded Java applets, user think-
time, number of bytes received, connects and disconnects generated by
any browser, running on any platform. By not requiring any recording soft-
ware to be installed on the client browser or server machines, the traffic re-
corded can be used to generate heavy user loads against a Web server even
as the environment changes. preVue-Web can record Internet and intranet
application traffic from any Windows, Windows’95, Windows NT, MacOS,
OS/2 or UNIX system. preVue-Web software is supported on all major UNIX
platforms and Windows NT.
preVue-X automates both GUI regression testing and load testing for X
Window applications and does not require special hooks into the application
or X libraries. The tool operates at the X protocol level, between the X server
and the X client applications. It operates independently from the graphical
user interface (Open Look, Motif, CDE, etc.), toolkits, and network.
preVue-ASCII (Version 5.0 is a remote terminal emulator (RTE) that rep-
licates users running applications on a system under test (SUT). preVue-
ASCII automates multi-user testing of the applications by replacing both us-
ers and physical devices with software scripts that deliver an accurate
workload of user activity. It cost-effectively measures the quality and per-
formance of the applications under large user loads.

Product Features.

preVue-C/S features:
• Emulates 2-tier and 3-tier network traffic.
• SQL, HTTP, and Tuxedo traffic is captured and automatically turned
into client emulation scripts.

447

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 448 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

• Supports testing of Oracle, Sybase, Informix, and SQL Server data-

bases.
• Presentation-quality data analysis tools.
• Real-time test monitoring.
• Measures server response time under varying user loads.
• Integrated reporting with performance monitoring tools.
• Easily varies the user workload during playback.
• Tests are independent of client operating system and hardware
environment.
preVue-Web features:
• Measures Web server response times under large user loads.
• Automatically captures and plays back HTTP traffic and downloading
of Java applets.
• Accurately emulates and timestamps concurrent responses to multi-
ple HTTP requests.
• Provides emulation of users of any Web browser, running on any client
platform.
• Supported on all major UNIX platforms and Windows NT.
• Integrates with preVue-C/S to test both database and Web servers.
preVue-X features:
• A single tool for both GUI and performance testing.
• Nonintrusive approach lets one “test what you ship.”
• Tests all versions of UNIX, X server, GUI toolkits, etc.
• Automatically generates test scripts reproducing user inputs and sys-
tem responses.
preVue-ASCII features:
• Cost-effectively and accurately emulates large user loads.
• Tests any screen-based application in any operating system environ-
ment.
• Measures the user’s perception of performance-response times at the
user’s terminal.
• Automatically generates test scripts reproducing user inputs and sys-
tem responses.
• Provides the realism of actual users, yet tests are reproducible.
• Support on all major UNIX platforms.
• Uncovers quality and performance problems with new software re-
leases before the users see them.
• Determines how the applications perform with new system hardware
or software upgrades.
• Verifies the quality of applications following Year 2000 code changes.
• Tests the capacity of the current system as the number of users
increases.
448

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 449 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

System Requirements.
N/A

Platforms Supported.

• UNIX
• Windows NT

Rational’s PerformanceStudio
Product Description. PerformanceStudio integrates functional and load
testing with test-system performance and delivers information needed to
make critical deployment and resource planning decisions. It includes
Rational’s award-winning Robot product for script recording and built-in
test-asset management, as well as innovations such as data-smart record-
ing, client-smart pacing, load-smart scheduling, and server-smart play-
back aimed at improving ease-of-use, accuracy, and scalability.

Product Features.

• DataSmart Recording automates the use of multiple transactions

from a single test script.
• LoadSmart Scheduling automates the creation of workloads for 10 or
10,000+ users. Recently, performance-testing technology scored a sig-
nificant new benchmark by simultaneously supporting 30,000 virtual
users during a test run.
• ClientSmart Pacing automates the insertion of production level tim-
ing characteristics.
• ServerSmart Playback ensures the integrity of the results you are pro-
ducing.
These innovations of PerformanceStudio are equally suited to address the
needs of legacy systems such as two and n-tier client server architectures,
ERP, as well as the ever changing e-commerce environments.

System Requirements.

NT Master Station:
• 99 MHz Pentium or higher (166 MHz for test runs greater than 50 vir-
tual users)
• 80 MB free disk space
NT Agent:
• Pentium, 99 MHz Pentium or higher (166 MHz recommended)
• 40 MB free disk space

449

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 450 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Platforms Supported.

• Unix Agent
• Sun Solaris, HP, UX, IBM, AIX, additional port on request

Rational’s Visual Quantify Tool

Product Description. Quantify is a powerful, easy-to-use performance
analysis tool that gives developers an easy way to identify application per-
formance bottlenecks. Using Rational’s patented Object Code Insertion
(OCI) technology, Quantify actually counts the individual machine instruc-
tion cycles it takes to execute an application and records the exact amount
of time the application spends in any given block of code. With Quantify,
developers get the accurate and repeatable performance data they need to
quickly and easily improve application performance.

Product Features.
• Pinpoints performance bottlenecks in all parts of an application, in-
cluding user functions, system calls, shared and third-party libraries.
• Detects performance problems everywhere in Unix applications:
— C and C++ source code
— Third party libraries
— Shared or system libraries
• Detects performance problems everywhere in Windows applications:
— C and C++, Visual Basic, and Java source code
— ActiveX, DirectX, OLE and COM components
— Dynamic Link Libraries (DLLs)
— Third-party DLLs
— Windows operating system code
• Presents accurate, repeatable performance data in an easy to read
graphical displays.
• Offers multiple, complementary views of performance data.
• Collects per-thread performance data.
• Automatically compares runs for fast verification of performance im-
provements.

Platforms Supported.

• UNIX:
— Sun SPARC workstations running SunOS 4.x, Solaris 2.3–2.6
— HP9000 Series 700/800 workstations running HP-UX 9.0.x through
10.30
• Windows NT:
— Intel architecture only
— Windows NT 3.51 or above

450

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 451 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

— Visual C++ 2.2 or above

— Visual Basic 5.0 or above
— Java applications run through the Microsoft Virtual Machine for
Java

Rational’s ClearDDTS
Product Description. ClearDDTS is a change request management prod-
uct specifically designed to track and manage product defects and en-
hancement requests uncovered during product development and quality
assurance testing. It can be tightly integrated with software configuration
management products, such as ClearCase, to help users effectively manage
change throughout the software development life cycle.

Product Features.

• Organizes change requests for easy retrieval.

• Provides an easy-to-use querying facility.
• Offers a Web interface to support multiple platforms and remote
projects.
• Integrates with electronic mail for remote submission and notification.
• Features an SQL interface to the Oracle RDBMS and includes a SQL-
capable database as part of the product.
• Includes management reports—more than 40 types.
• Integrates with ClearCase, ClearGuide, ClearSupport, and other popu-
lar software development and call tracking tools.

System Requirements.

Server:
• Approximately 55 MB of disk space
• At least 32 MB of RAM

Platforms Supported.

• Sun Solaris 2.5, 2.5.1, 2.6

• HP-UX 10.20, 11.00
• DEC OSF1 4.0d
• IBM AIX 4.2x
• SGI IRIX 6.2, 6.4
• Apache 1.2, 1.3.4
• Netscape Enterprise 3.0, 3.01, 3.6
• Microsoft Internet Explorer 4.0 or higher
• Netscape Navigator 3.0 or higher
• Oracle 7.1.6 or higher

451

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 452 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Rational’s ClearQuest
Product Description. Rational ClearQuest is a scalable and configurable
defect tracking/change request management product for tracking and re-
porting on defects and other types of change requests throughout the de-
velopment life cycle. ClearQuest shortens development cycles by unifying
all team members—project managers, QA managers, testers, develop-
ers—in managing software development change.

Product Features.

• Complete out-of-the-box solution includes automatic e-mail submis-

sion and notification, Web interface, Crystal Reports, and Sybase SQL
Anywhere.
• Integrates with software configuration management solutions includ-
ing Rational ClearCase and Microsoft Visual SourceSafe.
• Integrates with testing solutions including Rational Suite TestStudio,
TeamTest, Purify, and more.
• Supports Oracle, SQL Server, SQL Anywhere, and Access databases.
• Enables easy customization of request process lifecycle, database
fields, user interface layout, and more.

System Requirements.

ClearQuest Client
• Windows NT 4.0 with Service Pack 4, or Windows 95/98
• Approximately 80 MB of disk space
• At least 32 MB of RAM (recommended: 64 MB of RAM)
ClearQuest Web Server
• Windows NT Server 4.0 with Service Pack 4
• Microsoft Internet Information Server (IIS) 4.0
• 50 MB of hard disk space
• 128 MB of RAM

Platforms Supported.

• Windows’95/’98/NT
• Microsoft IIS
• Microsoft Internet Explorer
• Netscape Navigator
• Sybase SQL/Anywhere 5.5.04
• Oracle 7.3.4 or higher
• SQL Server 6.5 with Service Pack 5 or SQL Server 7.0

452

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 453 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Rational’s ClearCase
Product Description. ClearCase provides a comprehensive configuration
management solution, including version control, workspace management,
build management, and process control. ClearCase offers a uniquely trans-
parent, nonintrusive approach, and supports multiple platforms and IDEs,
making it easy to deploy and maintain, without forcing you to change your
existing environment, your tools, or the way you work.

Product Features.

• Goes far beyond version control by also offering powerful workspace

management, build management, and process control capabilities.
• Enables parallel development—even across geographically distribut-
ed sites.
• Integrates with Microsoft Developer Studio, PowerBuilder, Oracle De-
veloper/2000, and many of Rational’s software development solutions.
• Provides disconnected usage model, so that users can work at home
with ease and then reliably merge work back into the mainline of de-
velopment.
• Offers advanced build auditing, enabling teams to guarantee what
went into any build.
• Performs automatic, graphical merges of files and directories high-
lighting code conflicts and safely resolving inconsistencies.
• Versions everything that evolves in development—including source
code, binaries, executables, documentation, test suites, libraries, and
directories.
• Tightly integrated with change request management products to track
which defects were fixed in each release.

System Requirements. Client Only: Windows 95, 98

Platforms Supported. Client and server: Windows NT, Solaris, HP, AIX,
SGI, Digital Unix, Sun OS, Siemens Sinix, UnixWare

Rational’s ClearCase MultiSite

Product Description. ClearCase MultiSite is a ClearCase product option
that enables parallel development across geographically distributed
project teams. Available on Windows NT and UNIX, ClearCase MultiSite ex-
tends ClearCase’s reach to team members down the street or across the
world, delivering automated, error-free replication of project databases
and transparent access to all software elements.

453

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 454 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Product Features.

• Features the safest and most reliable means to exchange multi-site

ClearCase repository-based information.
• Automatically resends information in the event of network failure and
recovers repositories in the event of system failure.
• Scales easily to support projects regardless of size of team, location of
members, or platform usage.
• Offers the most efficient means to update team members by only
transmitting incremental changes that appear in ClearCase’s project
repositories. A network resource and time saver.
• Facilitates distributed development across networked and non-net-
worked sites by offering update mechanisms that support both net-
work and tape transfers.

System Requirements. Client only: Windows 95, 98

Platforms Supported. Clent and server: Windows NT, Solaris, HP, AIX, SGI,
Digital Unix, Sun OS, Siemens Sinix, UnixWare

Rational’s SQA SiteCheck Tool

Product Description. SQA SiteCheck is a powerful, yet easy to use, Web-
site management tool for the Intranet or World Wide Web site. It is designed
to help the Webmaster or business manager keep up with every aspect of
the rapidly changing site. The primary purpose of SQA SiteCheck is to de-
tect broken links, orphaned pages, and potential performance problems on
Web sites. SQA SiteCheck helps Webmasters and Web site administrators
detect and repair defects in the structural integrity of their sites.
SQA SiteCheck includes many features that allow it to test Web sites that
use the most current technology to present active content such as HTML
forms and Java applets. It is also capable of testing secure sites making use
of SSL, proxy servers, and multiple security realms to protect the data sent
to and from the site. SQA SiteCheck’s advanced level of integration with
McAfee VirusScan enables one to detect infected documents on a site be-
fore visitors do.

Product Features.

• A fully integrated internal browser and HTML editor.

• Full support of the Secure Sockets Layer (SSL).
• Filters for Web-based forms, frames, Java, JavaScript, ActiveX, and VB-
Script.
• Automatic tracking of moved or orphan pages and broken links.
• Fixes links without needing a separate editor.
• Includes automatic virus scanning.

454

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 455 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

• Pinpoints all slow pages and predicts performance time for all commu-
nication paths.
• Can impersonate both Microsoft Internet Explorer and Netscape Nav-
igator to see the different server responses to the different browsers.
• Integration with SQA Suite: SQA Robot as the Web Site Test Case.

System Requirements.

• 16 MB, 32 MB recommended for NT

• 10 MB
• PC with 486 processor, Pentium-class processor recommended

Platforms Supported.
• Microsoft Windows 95 or Windows NT 4.0 or later
• ActiveScan View requires Microsoft Internet Explorer v3.0 or later

Rational Visual PureCoverage 6.0

Product Description. Comprehensive testing of applications and fast
identification of problem areas throughout the development process is es-
sential to producing high-quality software. However, without tools that
help you identify which parts of the application have and have not exer-
cised in a test run, you’ll waste valuable time trying to guess where the
problem areas are and what you have to do to fix them.
Visual PureCoverage helps you quickly identify untested code, so you
can be sure you’ve checked your entire application for potential problems,
not just part of it. An essential tool for Visual Basic, Visual C++, or Java ap-
plications, Visual PureCoverage will speed testing efforts, save precious
development time, and enable you to deliver higher quality software faster
and within budget.

Product Features.

• Automatically pinpoints untested code.

• No source code or special builds required.
• PowerCov controls the level of data collected.
• Identifies untested code everywhere, including:
— ActiveX, DirectX, OLE, and COM components
— Dynamically linked libraries (DLLs)
— Source code
— Third party controls and DLLs
— System DLLs
• Integrated with Microsoft Visual Studio 6.0
• Supports Visual Basic, Visual C++, and Java applications
• Integrated with Visual Test, and ClearQuest

455

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 456 Friday, March 17, 2000 11:20 AM

MODERN MAINTENANCE TOOLS

Version 6.0 enhancements include:

• Microsoft Visual Studio 6.0 integration.
• Support for Microsoft Visual C++ 6.0 and Microsoft Visual Basic 6.0.
• Now supports merging different executables for determining the cov-
erage of DLL’s that are used by multiple programs.
• Enhanced Visual Basic functionality.
• Integrated with Rational Visual Test and ClearQuest.

System Requirements.

• PC-compatible system, Intel 486 or Pentium processor

• Microsoft Windows NT 4.0 with Service Pack 3 or greater
• 32 MB RAM required, 64 Mb RAM recommended
• Approximately 20 MB free disk space
• 150 MB minimum swap space recommended

Platforms Supported.

• Intel architecture
• Windows NT 4.0 or above (including Japanese Windows NT 4.0)
• Visual Basic 5.0, 6.0
• Visual C++ 4.2-6.0
• Microsoft Visual Studio 5.0, 6.0
• Microsoft VJ++ 1.11 VM build 2553 or higher
• Windows CE applications run in emulation mode on Windows NT; em-
ulation software available with Windows CE SDK

Rational Purify 6.0

Product Description. Run-time or memory-access errors are some of the
most difficult problems for Windows NT programmers to solve. These
problems are even greater when developing software with compo-
nents—whether purchased from third parties, downloaded off the Inter-
net, or reused from a previous project. Errors in these components can be
disastrous and may take weeks to find and fix. Only Purify will pinpoint er-
ror in components as well as any application code you’ve written. Purify
helps you get to the root of your run-time problem so you can quickly fix
the error, rather than spend a lot of time trying to debug it.
With Purify, no special build is required. Just select an executable and
Purify will automatically begin checking for run-time errors and memory
leaks. Integration with Microsoft Visual Studio allows Purify to interact
with the IDE and debugger, and gives developers immediate run-time error
checking without making any changes to any tools in use.

456

Copyright © 2000 CRC Press, LLC

AU9833/ch35/frame Page 457 Friday, March 17, 2000 11:20 AM

Introduction to Maintenance Tools

Product Features.

• Automatically pinpoints hard-to-find run-time errors.

• Checks for run-time errors in all your code, including components.
• Quickly analyzes your executables—no rebuild is required.
• Checks for errors in Windows API calls and OLE methods.
• Lets you control the level of error checking per code module.
• Companion tool for Rational Visual Quantify and Visual PureCoverage,
and integrated with Rational Visual Test and ClearQuest.
• Integrated with Microsoft Visual Studio 6.0.
Version 6.0 enhancements include:
• Microsoft Visual Studio 6.0 Integration
• Support for Visual C++ 6.0
• Significant improvements in instrumented program performance,
making Purify even faster!
• Integrated with Rational Visual Test and ClearQuest.

System Requirements.

• PC-compatible system, Intel 486 or Pentium processor

• Microsoft Windows NT 4.0 with Service Pack 2 or greater
• 32 MB RAM required, 64 MB RAM recommended
• Approximately 20 MB free disk space
• 150 MB minimum swap space recommended

Platforms Supported.

• Intel architecture
• Windows NT 4.0 or above (including Japanese Windows NT 4.0)
• Visual C++ 4.2–6.0
• Visual Studio 5.0, 6.0
• Windows CE applications run in emulation mode on Windows NT; em-
ulation software available with Windows CE SDK

Other Maintenance Tools

See Exhibits 3, 4, 5, 6, 7, and 8.

457

Copyright © 2000 CRC Press, LLC