4. Run TestComplete Tests as Part of a Build and View Test Results

Applies to TestComplete 14.10, last modified on June 5, 2019

After you have configured a test project and a build definition, you can run your build. Your TestComplete tests will be executed during the build run.

Requirements

The computer where the tests will run must have the following software installed:

  • Azure DevOps Server.

    – or –

    Team Foundation Server with the Team Foundation Build Service component.

    – or –

    Team Foundation Build Service.

    – or –

    Build and Release Agent for Windows.

    – or –

    Test Agent for Microsoft Visual Studio.

    The build agent or the test agent must be running in interactive mode. Otherwise, TestComplete will not be able to interact with the desktop and with the tested application's UI.

  • One of the Microsoft Visual Studio versions supported by TestComplete (optional, if you use Team Foundation Build 2010 or 2012).

  • TestComplete 14 (or TestExecute 14).

  • TestComplete 14 Visual Studio Integration Package.

    The Integration Package installer is shipped along with TestComplete. You can find it in the TestComplete folder after installing the product:

    <TestComplete 14>\VS Integration\VSIntegration.exe

    Run this installer after installing TestComplete on your build or test computer. In the installation wizard, select the Visual Studio Integration feature and the Build and Test Integration or Test Agent Integration feature appropriate for the software you have installed on your build or test computer.

Run Builds

  1. If you use Azure DevOps Services (formerly known as Visual Studio Team Services), Azure DevOps Server 2019 or Team Foundation Server 2015–2018, open the web portal of your team project. You can navigate to your web portal directly in your web browser or open it from Team Explorer in Visual Studio.

    You can learn more about the web portal at docs.microsoft.com/en-us/azure/devops/project/navigation/.

  2. In Team Explorer or in the team project’s web portal, locate your build and queue it:

    TestComplete integration with Visual Studio: Queuing a build

    Click the image to enlarge it.

  3. The build will be added to the build queue and the Build Explorer will inform you about the build progress:

    TestComplete integration with Visual Studio: View the build progress

    Click the image to enlarge it.

View Test Results

After the build is over, view the test results.

  1. Double-click the needed build on the Builds page. This will open the build report.

  2. Switch to the Tests (or Test Results) section:

    TestComplete integration with Visual Studio: View build results

    Click the image to enlarge it.

  3. Click the needed test result. This will open the details of your test.

    If you use Team Foundation Server 2017 or earlier, click Detailed report.

    TestComplete integration with Visual Studio: View test results

    Click the image to enlarge it.

    Note: If you run TestComplete tests by using Visual Studio Test task version 1, you may need to publish TestComplete test results to view them on the Tests page.
  4. In the Attachment section, click the link to open or save the attached TestComplete test log.

    TestComplete integration with Visual Studio: View detailed test results

    Click the image to enlarge it.

If a test run fails, check whether your TestComplete project files that your team build uses reside in a folder, where your team build can access them, and that TestComplete (or TestExecute) is installed on the computer, where your tests run.

Prev

See Also

Run TestComplete Tests as Part of Build Pipeline (Team Builds)
Defining a Build Process

Highlight search results