Name: Visual Test
Company: Rational
Company: Rational
Web Site: http://www.rational.com/products/visualtest/
Category: capture & playback, test suite management
Languages: any, but special integration with Visual C++
Platforms: Windows, integrated with Microsoft Developer Studio
Description: Test cases and suites described as program (in special TestBasic language) rather than scripts. Develop test programs, manage suites of tests. May write tests by hand or Scenario Recorder can record session and make into a test (capture & playback). Tests created by the Scenario Recorder can be edited. Can write failure tests to catch exceptions. System testing only, not unit testing.
Category: capture & playback, test suite management
Languages: any, but special integration with Visual C++
Platforms: Windows, integrated with Microsoft Developer Studio
Description: Test cases and suites described as program (in special TestBasic language) rather than scripts. Develop test programs, manage suites of tests. May write tests by hand or Scenario Recorder can record session and make into a test (capture & playback). Tests created by the Scenario Recorder can be edited. Can write failure tests to catch exceptions. System testing only, not unit testing.
Name: SQA Suite
Company: Rational
Web Site: http://www.rational.com/products/sqasuite/
Category: capture & playback, test suite management, simulation of network conditions
Languages: "focused on IS and Internet developers using Visual Basic®, PowerBuilder®, and Developer/2000"
Platforms: Windows
Description: Integrated collection of tools:
Company: Rational
Web Site: http://www.rational.com/products/sqasuite/
Category: capture & playback, test suite management, simulation of network conditions
Languages: "focused on IS and Internet developers using Visual Basic®, PowerBuilder®, and Developer/2000"
Platforms: Windows
Description: Integrated collection of tools:
- testing of Windows client-server applications (Web servers)
- can port test cases across Windows platforms
- SQA Repository: database of information about tests & results, accessible over the Internet for use of testers on multiple machines
- SQA WebEntry: lets users query & modify the repository over the Internet (other applications update the repository also)
- SQA Manager: helps manage a QA team, including notifying team members of defects via e-mail
- SQA Robot: creates & runs test cases. Uses capture & playback to create tests scripts, which may be edited. Collects performance data.
- SQA Process: a formal methodology for testing client/server applications (you get software, a written guide and a few days with a consultant to help set up a QA strategy for your organization)
- SQA LoadTest: helps test performance with heavy loads by simulating multiple users (running the same test case with different data each time)
- Tests created by capture & playback will work even after changes to Web pages
- Integrated with Rational development and requirements tools, which can log requirements to be tested.
Name: SQA TestFoundation for PeopleSoft applications
Company: Rational
Web Site: http://www.rational.com/products/testfoundation/
Category: capture & playback, test suite management, simulation of network conditions
Languages: PeopleSoft
Description: PeopleSoft offers customizable packages for business use, including accounting, materials management, distribution, manufacturing, and human resources. Rational has taken much of SQA Suite and integrated it with PeopleSoft packages, including some new customized features.
Company: Rational
Web Site: http://www.rational.com/products/testfoundation/
Category: capture & playback, test suite management, simulation of network conditions
Languages: PeopleSoft
Description: PeopleSoft offers customizable packages for business use, including accounting, materials management, distribution, manufacturing, and human resources. Rational has taken much of SQA Suite and integrated it with PeopleSoft packages, including some new customized features.
Name: PureCoverage
Company: Rational
Web Site: http://www.rational.com/products/pure_coverage
Category: coverage tool
Languages: C, C++, Fortran
Platforms: Unix
Description: Measures program coverage -- by function, block, or line. Customizable graphical user-interface, updated dynamically as tests are run. Supports C and C++ programming environments; also says it "detects untested code with or without source code". Integrated with Purify.
Company: Rational
Web Site: http://www.rational.com/products/pure_coverage
Category: coverage tool
Languages: C, C++, Fortran
Platforms: Unix
Description: Measures program coverage -- by function, block, or line. Customizable graphical user-interface, updated dynamically as tests are run. Supports C and C++ programming environments; also says it "detects untested code with or without source code". Integrated with Purify.
Name: Purify
Company: Rational
Web Site: http://www.rational.com/products/purify
Category: property verification (run-time errors)
Languages: can identify errors in any code, even without source, but handles source code for C, C++, Fortran
Platforms: Windows & Unix
Description: Run-time error detection for Windows and Unix platforms. Checks for memory leaks and other run-time errors (using uninitialized memory, array bounds violations, etc.) by inserting object code before every load and store instruction. Can check code even if source is not available.
Company: Rational
Web Site: http://www.rational.com/products/purify
Category: property verification (run-time errors)
Languages: can identify errors in any code, even without source, but handles source code for C, C++, Fortran
Platforms: Windows & Unix
Description: Run-time error detection for Windows and Unix platforms. Checks for memory leaks and other run-time errors (using uninitialized memory, array bounds violations, etc.) by inserting object code before every load and store instruction. Can check code even if source is not available.
Name: PreVue
Company: Rational
Web Site: http://www.rational.com/products/prevue/
Category: capture & playback, simulation of network conditions
Languages: (I found no mention of specific language support)
Platforms: Windows, Unix
Description: Emulates network traffic. Generates "client emulation scripts" automatically from recorded data from actual runs; scripts can be edited by user. Versions: PreVue-CS for database servers, PreVue-Web for Web servers, PreVue-X for X Windows, and PreVue-ASCII for character-based servers.
Company: Rational
Web Site: http://www.rational.com/products/prevue/
Category: capture & playback, simulation of network conditions
Languages: (I found no mention of specific language support)
Platforms: Windows, Unix
Description: Emulates network traffic. Generates "client emulation scripts" automatically from recorded data from actual runs; scripts can be edited by user. Versions: PreVue-CS for database servers, PreVue-Web for Web servers, PreVue-X for X Windows, and PreVue-ASCII for character-based servers.
Name: Performix
Company: Rational
Web Site: http://www.rational.com/products/performix/
Category: capture & playback, simulation of network conditions
Languages: (I found no mention of specific language support)
Platforms: Unix & Windows
Description: Similar to PreVue -- I'm not sure of the difference from reading the web pages.
Company: Rational
Web Site: http://www.rational.com/products/performix/
Category: capture & playback, simulation of network conditions
Languages: (I found no mention of specific language support)
Platforms: Unix & Windows
Description: Similar to PreVue -- I'm not sure of the difference from reading the web pages.
Name: Testmate
Company: Rational
Web Site: http://www.rational.com/products/testmate/ (Ada),
http://www.rational.com/products/testmate/cpp/ (C, C++)
Category: test suite management, coverage tool, automatic test generation (?)
Languages: C, C++, Ada
Platforms: Sun Solaris, HP-UX, Digital UNIX, SGI IRIX, Sun SunOS, IBM RS 6000 AIX
Evaluation Software: RMC has it.
Independent Reviews:
Manufacturer's Literature:
Description: Tools for organizing and maintaining test suites for both module and system testing. Automatic execution and reporting. Integrated with Rational's Apex development environment. Generates test cases from templates.
Company: Rational
Web Site: http://www.rational.com/products/testmate/ (Ada),
http://www.rational.com/products/testmate/cpp/ (C, C++)
Category: test suite management, coverage tool, automatic test generation (?)
Languages: C, C++, Ada
Platforms: Sun Solaris, HP-UX, Digital UNIX, SGI IRIX, Sun SunOS, IBM RS 6000 AIX
Evaluation Software: RMC has it.
Independent Reviews:
Manufacturer's Literature:
Description: Tools for organizing and maintaining test suites for both module and system testing. Automatic execution and reporting. Integrated with Rational's Apex development environment. Generates test cases from templates.
Name: C-Cover
Company: Bullseye Testing Technology
Web Site: http://www.bullseye.com/webCcover.html Category: coverage tool
Languages: C, C++
Platforms: Windows 95 or NT, Unix, OS/2, some embedded systems
Description: Test coverage analyzer; branch or condition coverage. Marick says it's easy to use.
Company: Bullseye Testing Technology
Web Site: http://www.bullseye.com/webCcover.html Category: coverage tool
Languages: C, C++
Platforms: Windows 95 or NT, Unix, OS/2, some embedded systems
Description: Test coverage analyzer; branch or condition coverage. Marick says it's easy to use.
Name: BoundsChecker
Company: Nu-Mega
Web Site: http://www.numega.com/products/vc/vc.htm Category: property verification (run-time errors)
Languages: C++
Platforms: Windows
Description: Identifies run-time errors such as arguments out of range, memory leaks, dangling or nil pointers used. When an error occurs, report includes call stack and other trace information.
Company: Nu-Mega
Web Site: http://www.numega.com/products/vc/vc.htm Category: property verification (run-time errors)
Languages: C++
Platforms: Windows
Description: Identifies run-time errors such as arguments out of range, memory leaks, dangling or nil pointers used. When an error occurs, report includes call stack and other trace information.
Name: ObjectCoverage
Company: ObjectSoftware Inc.
Category: coverage tool
Languages: C++
Platforms: SPARC - SunOs 4.1.X and Solaris 2.X
Description: Produces branch coverage reports for C++ programs.
Company: ObjectSoftware Inc.
Category: coverage tool
Languages: C++
Platforms: SPARC - SunOs 4.1.X and Solaris 2.X
Description: Produces branch coverage reports for C++ programs.
Name: ObjectTester
Company: ObjectSoftware Inc.
Category: automatic test generation
Languages: C++
Description: Generates unit testing scripts for C++ classes. It's hard to tell from how the tests are generated.
Company: ObjectSoftware Inc.
Category: automatic test generation
Languages: C++
Description: Generates unit testing scripts for C++ classes. It's hard to tell from how the tests are generated.
Name: TestCenter
Company: CenterLine Software
Web Site: http://www.centerline.com/productline/test_center/test_center.html Category: coverage tool & property verification (run-time errors)
Languages: C, C++
Platforms: Sun, HP, AIX
Description: measures line coverage of test programs, helps check for run-time errors and memory leaks, can force errors such as "disk full" or "out of memory". Integrated with other development tools.
Company: CenterLine Software
Web Site: http://www.centerline.com/productline/test_center/test_center.html Category: coverage tool & property verification (run-time errors)
Languages: C, C++
Platforms: Sun, HP, AIX
Description: measures line coverage of test programs, helps check for run-time errors and memory leaks, can force errors such as "disk full" or "out of memory". Integrated with other development tools.
Name: AcquaProva
Company: CenterLine Software
Web Site: http://www.centerline.com/productline/AcquaProva/AcquaProva.html Category: source code analysis, property verification (runtime errors)
Languages: C, C++
Platforms: Sun, NCR
Description: Checks source code for errors as well as providing programming advice based on books by Scott Meyers. User can add rules to enforce company coding practices. Also detects runtime errors.
Company: CenterLine Software
Web Site: http://www.centerline.com/productline/AcquaProva/AcquaProva.html Category: source code analysis, property verification (runtime errors)
Languages: C, C++
Platforms: Sun, NCR
Description: Checks source code for errors as well as providing programming advice based on books by Scott Meyers. User can add rules to enforce company coding practices. Also detects runtime errors.
Name: QC/Replay
Company: CenterLine Software
Web Site: http://www.centerline.com/productline/qcreplay/qcreplay.html Category: capture and playback
Platforms: XWindows on SunOS, Solaris 2.x, HP/UX, AIX
Description: Capture and playback for XWindows programs.
Company: CenterLine Software
Web Site: http://www.centerline.com/productline/qcreplay/qcreplay.html Category: capture and playback
Platforms: XWindows on SunOS, Solaris 2.x, HP/UX, AIX
Description: Capture and playback for XWindows programs.
Name: Insure++
Company: ParaSoft
Web Site: http://www.parasoft.com/insure/home.htm Category: property verification (runtime errors), coverage tool
Languages: C, C++
Platforms: SunOS, HP, IBM RS6000, SGI 5.X, Digital UNIX, Lynx, Linux, SCO
Description: Detects many kinds of compile-time and runtime errors, such as memory leaks. Coverage analysis is available as an optional add-on.
Company: ParaSoft
Web Site: http://www.parasoft.com/insure/home.htm Category: property verification (runtime errors), coverage tool
Languages: C, C++
Platforms: SunOS, HP, IBM RS6000, SGI 5.X, Digital UNIX, Lynx, Linux, SCO
Description: Detects many kinds of compile-time and runtime errors, such as memory leaks. Coverage analysis is available as an optional add-on.
Name: CTC++
Company: Testwell
Web Site: http://www.testwell.sci.fi/ctcdesc.html Category: coverage tool
Languages: C, C++
Platforms: MS-DOS, Windows 3.x/95/NT, DJGPP, HPUX, Sun/Solaris&SunOS, Linux, DEC Alpha OSF1.
Description: coverage analysis for C++, by function, statement, branch or condition. Also provides timing information. May be integrated with Microsoft Visual C++ Developer Studio.
Company: Testwell
Web Site: http://www.testwell.sci.fi/ctcdesc.html Category: coverage tool
Languages: C, C++
Platforms: MS-DOS, Windows 3.x/95/NT, DJGPP, HPUX, Sun/Solaris&SunOS, Linux, DEC Alpha OSF1.
Description: coverage analysis for C++, by function, statement, branch or condition. Also provides timing information. May be integrated with Microsoft Visual C++ Developer Studio.
Name: TCMON
Company: Testwell
Web Site: http://www.testwell.sci.fi/tcmdesc.html Category: coverage tool
Languages: Ada 83
Platforms: MS-DOS, VAX/VMS, Sun/Solaris&SunOS. Ada source code available and may be ported to other platforms.
Description: coverage analysis for Ada, by statement, condition, or sub-condition. Also provides timing information. Works by producing a modified copy of the source code.
Company: Testwell
Web Site: http://www.testwell.sci.fi/tcmdesc.html Category: coverage tool
Languages: Ada 83
Platforms: MS-DOS, VAX/VMS, Sun/Solaris&SunOS. Ada source code available and may be ported to other platforms.
Description: coverage analysis for Ada, by statement, condition, or sub-condition. Also provides timing information. Works by producing a modified copy of the source code.
Name: TBGEN
Company: Testwell
Web Site: http://www.testwell.sci.fi/tbgdesc.html Category: test suite management, unit testing
Languages: Ada
Platforms: MS-DOS, VAX/VMS, Sun/Solaris&SunOS. Ada source code available and may be ported to other platforms.
Description: Ada test bed: automates building of test drivers and stubs for unit/module testing. Can test interactively or with a script, including tests, loops and assertions.
Company: Testwell
Web Site: http://www.testwell.sci.fi/tbgdesc.html Category: test suite management, unit testing
Languages: Ada
Platforms: MS-DOS, VAX/VMS, Sun/Solaris&SunOS. Ada source code available and may be ported to other platforms.
Description: Ada test bed: automates building of test drivers and stubs for unit/module testing. Can test interactively or with a script, including tests, loops and assertions.
Name: CTB
Company: Testwell
Web Site: http://www.testwell.sci.fi/ctbdesc.html Category: test suite management, unit testing
Languages: C
Platforms: MS-DOS, Windows and others. May be ported to other platforms.
Description: C test bed; automates building of test drivers and stubs for unit/module testing.
Company: Testwell
Web Site: http://www.testwell.sci.fi/ctbdesc.html Category: test suite management, unit testing
Languages: C
Platforms: MS-DOS, Windows and others. May be ported to other platforms.
Description: C test bed; automates building of test drivers and stubs for unit/module testing.
Name: CMT++
Company: Testwell
Web Site: http://www.testwell.sci.fi/cmtdesc.html
Category: source code analysis, property verification (complexity)
Languages: C, C++
Platforms: MS-DOS, Windows, several Unix platforms
Description: analyzies C/C++ code using McCabe's cyclomatic number and Halstead's estimated number of bugs.
Company: Testwell
Web Site: http://www.testwell.sci.fi/cmtdesc.html
Category: source code analysis, property verification (complexity)
Languages: C, C++
Platforms: MS-DOS, Windows, several Unix platforms
Description: analyzies C/C++ code using McCabe's cyclomatic number and Halstead's estimated number of bugs.
Name: GCT
Company: Testing Foundations (Brian Marick)
Web Site: ftp://cs.uiuc.edu/pub/testing/GCT.README
Category: coverage tool
Languages: C
Platforms: Unix
Description: analyzes test coverage for C. More different coverage measures than most of the other programs, including weak mutation coverage and "race coverage" for multiprocessor systems. Works by instrumenting C source code.
Company: Testing Foundations (Brian Marick)
Web Site: ftp://cs.uiuc.edu/pub/testing/GCT.README
Category: coverage tool
Languages: C
Platforms: Unix
Description: analyzes test coverage for C. More different coverage measures than most of the other programs, including weak mutation coverage and "race coverage" for multiprocessor systems. Works by instrumenting C source code.
Name: Testworks
Company: Software Research, Inc.
Web Site: http://www.soft.com/Products/index.html
Category: test suite management, coverage tool, capture & playback, automatic test generation, source code analysis
Languages: Java, C, C++ Ada and F77.
Platforms: Windows, Unix
Description: An integrated suite of testing tools, providing management of test suites, coverage analysis, and capture and playback for both text and GUI-based applications. The Unix version also includes a tool to generate test cases from templates provided by the user, and source code analysis to measure complexity and identify bugs or possible trouble spots. The compoments may be purchased separately or bundled together.
Company: Software Research, Inc.
Web Site: http://www.soft.com/Products/index.html
Category: test suite management, coverage tool, capture & playback, automatic test generation, source code analysis
Languages: Java, C, C++ Ada and F77.
Platforms: Windows, Unix
Description: An integrated suite of testing tools, providing management of test suites, coverage analysis, and capture and playback for both text and GUI-based applications. The Unix version also includes a tool to generate test cases from templates provided by the user, and source code analysis to measure complexity and identify bugs or possible trouble spots. The compoments may be purchased separately or bundled together.
Name: LDRA Testbed
Company: LDRA Ltd.
Web Site: http://www.ldra.com/index.htm
Category: source code analysis, coverage tool
Languages: Ada, Algol, C/C++, Cobol, Coral 66, Fortran, Pascal, PL/M, PL/1, Assemblers (Intel + Motorola).
Platforms: Solaris, SunOS, Windows 95/NT/3.1x, Vax/VMS, Open VMS, HP-UX, Digital Unix, WinOS/2, AIX, IRIX, SCO, MVS.
Description: Source code analysis includes metrics on quality and complexity, data flow analysis, and variable cross references. Coverage analysis includes statement, branch and subcondition coverage. Also includes data flow analysis.
Company: LDRA Ltd.
Web Site: http://www.ldra.com/index.htm
Category: source code analysis, coverage tool
Languages: Ada, Algol, C/C++, Cobol, Coral 66, Fortran, Pascal, PL/M, PL/1, Assemblers (Intel + Motorola).
Platforms: Solaris, SunOS, Windows 95/NT/3.1x, Vax/VMS, Open VMS, HP-UX, Digital Unix, WinOS/2, AIX, IRIX, SCO, MVS.
Description: Source code analysis includes metrics on quality and complexity, data flow analysis, and variable cross references. Coverage analysis includes statement, branch and subcondition coverage. Also includes data flow analysis.
Name: Hindsight
Company: IntegriSoft, Inc.
Web Site: http://www.integrisoft.com/hindsight.htm
Category: coverage tool, test suite management, test suite analysis,
Languages: C, C++, Fortran
Platforms: SunOS, Solaris, HP/UX, and IBM AIX
Description: Several functions:
Company: IntegriSoft, Inc.
Web Site: http://www.integrisoft.com/hindsight.htm
Category: coverage tool, test suite management, test suite analysis,
Languages: C, C++, Fortran
Platforms: SunOS, Solaris, HP/UX, and IBM AIX
Description: Several functions:
- segment, branch and condition coverage analysis
- generates test drivers and stubs for unit testing
- cross-references test cases with functions or classes
- recommends minimal set of test cases
- complexity metrics
Name: Visual Testing Toolset
Company: McCabe and Associates
Web Site: http://www.mccabe.com/vtt/ Category: coverage tool
Languages & Platforms: says it supports many languages and platforms, but no details
Description: Reports and graphical displays with several kinds of coverage measures. Computes code complexity and basis paths and shows which paths have been exercised by tests.
Company: McCabe and Associates
Web Site: http://www.mccabe.com/vtt/ Category: coverage tool
Languages & Platforms: says it supports many languages and platforms, but no details
Description: Reports and graphical displays with several kinds of coverage measures. Computes code complexity and basis paths and shows which paths have been exercised by tests.
Name: XRunner
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/xrunguide.html Category: capture & replay, automatic test generation
Platforms: all Unix platforms, may be ported to Windows
Description: Generates test suites for XWindows applications. Test results can be compared as bitmaps, or at a higher level. You can also create your own test suites by capture & replay or with the help of a graphical interface to your program and a test script language
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/xrunguide.html Category: capture & replay, automatic test generation
Platforms: all Unix platforms, may be ported to Windows
Description: Generates test suites for XWindows applications. Test results can be compared as bitmaps, or at a higher level. You can also create your own test suites by capture & replay or with the help of a graphical interface to your program and a test script language
Name: WinRunner
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/winrunguide.html Category: capture & replay, automatic test generation
Platforms: Windows
Description: Sounds just like XRunner, but for Windows GUI applications.
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/winrunguide.html Category: capture & replay, automatic test generation
Platforms: Windows
Description: Sounds just like XRunner, but for Windows GUI applications.
Name: LoadRunner
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/loadrunguide.html Category: load testing
Platforms: Windows, Unix
Description: Emulates a multi-user network load, with each virtual user running tests (scripts may be developed with XRunner or WinRunner).
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/loadrunguide.html Category: load testing
Platforms: Windows, Unix
Description: Emulates a multi-user network load, with each virtual user running tests (scripts may be developed with XRunner or WinRunner).
Name: TestDirector
Company: Mercury Interactive
Category: test suite management
Platforms: Windows
Description: Tool for managing test suites, maintaining records about test plans for multi-user projects, tracking progress in finding and fixing bugs. Integrated with WinRunner. (TestSuite = WinRunner + TestDirector.)
Name: Astra SiteTest
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/astrastguide.html Category: load testing
Platforms: Windows
Description: Stress testing for web sites. Includes LoadRunner, plus other stuff specific to web sites. May be integrated with Astra SiteManger, a tool for managing web sites -- can gather statistics about usage which can be used to generate testing scenarios.
Name: TestBytes
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/testbytesguide.html Description: Data test generation; couldn't access full description due to Network problem.
Company: Mercury Interactive
Web Site: http://www.merc-int.com/products/testbytesguide.html Description: Data test generation; couldn't access full description due to Network problem.
Name: ITEX - Interactive TTCN Editor and Executor
Company: Telelogic
Web Site: http://www.telelogic.com Category: automatic test generation, test suite management
Platforms: Win 95/NT, Sun Solaris/SunOS, HP-UX
Description: If you have an SDL specification of the system being tested, provides "semi-automatic" test case generation. If you write your own test cases, they are checked against the specification.
Company: Telelogic
Web Site: http://www.telelogic.com Category: automatic test generation, test suite management
Platforms: Win 95/NT, Sun Solaris/SunOS, HP-UX
Description: If you have an SDL specification of the system being tested, provides "semi-automatic" test case generation. If you write your own test cases, they are checked against the specification.
