Create a vNext Build Containing TestComplete Tests (Running TestComplete Tests as Part of Release Pipeline)

Applies to TestComplete 14.50, last modified on April 22, 2021
This approach to running TestComplete tests as part of a release pipeline is obsolete. We do not recommend using it. Starting from version 14.20, to run TestComplete tests as part of a build, you can use the TestComplete test adapter. To learn more, see Integration With Azure DevOps and Team Foundation Server.

To run TestComplete tests during the release deployment, create a build that will include your test project and place your TestComplete test files to the needed output folder.

Requirements

You must have access to your team project:

  • To access the project from Visual Studio Team Explorer, you must have Microsoft Visual Studio 2015–2019 (Community, Enterprise or Professional) with the Team Explorer component.

– or –

  • To access the project directly from your web browser by using Web Portal:

    • For Azure DevOps Services (formerly known as Visual Studio Team Services or VSTS):

      https://dev.azure.com/<Your_Azure_Account_Name>/<Project_Name>

      – or –

      https://<Your_VSO_Account_Name>.visualstudio.com/<Project_Name> (if your organization has not moved to the dev.azure.com domain yet)

    • For On-Premises Azure DevOps Server and Team Foundation Server:

      http://<Your_Server_Name>:8080/tfs/<Collection_Name>/<Project_Name>

    You can find information on Web Portal at docs.microsoft.com/en-us/azure/devops/project/navigation/.

Configure a Build Definition

  1. Open the web portal of your team project. You can navigate to it directly in your web browser, or you can open it from Team Explorer in Visual Studio.

  2. If you use Azure DevOps or Team Foundation Server 2018, navigate to the Pipelines > Builds page.

    If you use Team Foundation Server 2015 Update 2–2017, navigate to the Build & Release > Builds page.

    TestComplete integration with Visual Studio: Builds hub in Web Portal

    Click the image to enlarge it.

  3. Open an existing build definition or click New to create a new build definition.

    TestComplete integration with Visual Studio: Create a new build definition or open an exisitng one

    Click the image to enlarge it.

    If you use Azure DevOps or Team Foundation Server 2018, you can create a YAML script that describes your pipeline, or you can click Use the visual designer to create a pipeline via a wizard.

    In the wizard, configure the build process (the way the wizard looks depends on whether you use Azure DevOps Services, Azure DevOps Server 2019 or one of the supported Team Foundation Server versions):

    TestComplete integration with Visual Studio: Configure a new build pipeline using the visual designer

    Click the image to enlarge it.

  4. Configure your build process to get the needed files from your source control.

    For example, if you use Git, specify the repository and branches that store your team project files:

    TestComplete integration with Visual Studio:  Get project files from the Azure Repos Git

    Click the image to enlarge it.

    Keep in mind that the Visual Studio test project stores the relative path to TestComplete tests. When mapping the TestComplete source control path, make sure to select a local folder to keep the relative path specified in the test project valid.
  5. Specify the details of the build process (what functions the team build will perform):

    • Add a task that will build your Visual Studio test project containing TestComplete tests:

      TestComplete integration with Visual Studio: Add a task that will build a Visual Studio test project

      Click the image to enlarge it.

    • Add a task that will copy test files to an artifact staging folder on your build computer:

      TestComplete integration with Visual Studio: Copying test files to an artifact staging folder

      Click the image to enlarge it.

    • Add a task that will publish your artifacts to a needed location:

      TestComplete integration with Visual Studio: Publish artifacts to a drop location

      Click the image to enlarge it.

    You can find information about tasks at docs.microsoft.com/en-us/azure/devops/pipelines/tasks/index.

  6. If needed, specify other build properties. You can learn more at docs.microsoft.com/en-us/azure/devops/pipelines/index.

  7. Save the changes.

Create a Build Instance

Run the created build definition to create a build that you will release:

  1. On the Builds page, click Queue.

  2. In the Queue Build dialog, configure the build run and click OK.

After the build is complete, create a release for it.

Prev     Next

See Also

Creating a Build Containing TestComplete Tests
Defining a Release Process

Highlight search results