5. Running TestComplete Tests and Viewing Test Results

Applies to TestComplete 12.60, last modified on September 17, 2018

After you have configured a release definition, you can create a release for a build. Your TestComplete tests will run during the release deployment.

Requirements

Computers where your TestComplete tests will run must have the following software installed:

  • If you use Visual Studio Test tasks to run tests, Visual Studio Team Services Build and Release Agent for Windows.

    – or –

    If you use Run Functional Tests tasks to run tests, one of the following versions of Test Agent for Microsoft Visual Studio:

    • Test Agent for Microsoft Visual Studio 2015 RTM and Update 1

    • Test Agent for Microsoft Visual Studio 2017 and Visual Studio 2015 Update 2

    Note: You can use the Visual Studio Test Agent Deployment task to install the test agent. To learn about requirements the remote computers must meet to install the test agent on them, see the step description in the MSDN Library.
  • TestComplete 12 (or TestExecute 12).

  • TestComplete 12 Visual Studio Integration Package.

    The Integration Package installer is shipped along with TestComplete. You can find it in the TestComplete folder after installing the product:

    <TestComplete 12>\VS Integration\VSIntegration.exe

    Run this installer after installing TestComplete on your build computer or test agent computers. In the installation wizard, select a Test Agent Integration feature appropriate to your agent version.

Deploying Releases

  1. Open the web portal of your team project. You can navigate to your web portal directly in your web browser or open it from Visual Studio Team Explorer.

  2. Navigate to the Releases page of the Build & Release hub.

  3. Right-click the needed release definition and then click Release:

    TestComplete integration with Visual Studio: Deploying a release

    Click the image to enlarge it.

  4. In the resulting dialog, select a build that you want to deploy:

    TestComplete integration with Visual Studio: Configuring a release

    Click the image to enlarge it.

    Click Create to create a release.

    Note: If the 64-bit version of TestComplete/TestExecute is available on a machine, it will be used to run tests. Otherwise, the 32-bit version will be used.
  5. On the Releases page, view the release status. You can click the release to view detailed information on the deployment status of each of its environments:

    TestComplete integration with Visual Studio: Viewing release progress

    Click the image to enlarge it.

Viewing Test Results

  1. On the Summary page of the release, view the release status:

    TestComplete integration with Visual Studio: Viewing release status

    Click the image to enlarge it.

  2. Switch to the Tests page to view test results. Select the needed test run and click the link in the Attachment section to open or save the attached TestComplete test log:

    TestComplete integration with Visual Studio: Viewing test results

    Click the image to enlarge it.

If a test run fails, check whether your TestComplete project files that your release uses reside in the folder, where your test agents can access them, and that TestComplete (or TestExecute) is installed on the computers, where your tests run.

Prev

See Also

Running TestComplete Tests as Part of Release Deployment
Defining a Release Process

Highlight search results