Create and Configure vNext Build Definitions (Run TestComplete Tests as Part of a Test Plan)

Applies to TestComplete 14.61, last modified on April 22, 2021
This approach to running TestComplete tests as part of a test plan is obsolete. We do not recommend using it. Starting from version 14.20, you can assign your TestComplete tests to Azure test cases directly from TestComplete IDE and run them as part of your team project’s test plan. To learn more, see Integration With Azure DevOps and Team Foundation Server.

To run TestComplete tests associated with test cases, create a build that will include your Visual Studio test project containing your TestComplete tests.

Note: This topic explains how to create a build definition that includes TestComplete tests to be run as part of a test plan.

To learn how to create a build pipeline that will run TestComplete tests during the build, see Define a Build Process (Run TestComplete Tests as Part of a Team Build).

Requirements

You must have access to your team project:

  • To access the project from Visual Studio Team Explorer, you must have Microsoft Visual Studio 2015–2019 (Community, Enterprise or Professional) with the Team Explorer component.

– or –

  • To access the project directly from your web browser by using Web Portal:

    • For Azure DevOps Services (formerly known as Visual Studio Team Services or VSTS):

      https://dev.azure.com/<Your_Azure_Account_Name>/<Project_Name>

      – or –

      https://<Your_VSO_Account_Name>.visualstudio.com/<Project_Name> (if your organization has not moved to the dev.azure.com domain yet)

    • For On-Premises Azure DevOps Server and Team Foundation Server:

      http://<Your_Server_Name>:8080/tfs/<Collection_Name>/<Project_Name>

    You can find information on Web Portal at docs.microsoft.com/en-us/azure/devops/project/navigation/.

Create and Configure Build Definitions

  1. Open the web portal of your team project. You can navigate to it directly in your web browser, or you can open it from Team Explorer in Visual Studio.

  2. If you use Azure DevOps or Team Foundation Server 2018, navigate to the Pipelines > Builds page.

    If you use Team Foundation Server 2015 Update 2–2017, navigate to the Build & Release > Builds page.

    TestComplete integration with Visual Studio: Builds hub in Web Portal

    Click the image to enlarge it.

  3. Open an existing build definition or click New to create a new build definition.

    TestComplete integration with Visual Studio: Create a new build definition or open an exisitng one

    Click the image to enlarge it.

    If you use Azure DevOps or Team Foundation Server 2018, you can create a YAML script that describes your pipeline, or you can click Use the visual designer to create a pipeline via a wizard.

    In the wizard, configure the build process (the way the wizard looks depends on whether you use Azure DevOps Services, Azure DevOps Server 2019 or one of the supported Team Foundation Server versions):

    TestComplete integration with Visual Studio: Configure a new build pipeline using the visual designer

    Click the image to enlarge it.

  4. Configure your build process to get the needed files from your source control.

    For example, if you use Git, specify the repository and branches that store your team project files:

    TestComplete integration with Visual Studio:  Get project files from the Azure Repos Git

    Click the image to enlarge it.

    Keep in mind that the Visual Studio test project stores the relative path to TestComplete tests. When mapping the TestComplete source control path, make sure to select a local folder to keep the relative path specified in the test project valid.
  5. Specify the details of the build process (what functions the team build will perform):

    • Add a task that will build your Visual Studio test project containing TestComplete tests:

      TestComplete integration with Visual Studio: Add a task that will build a Visual Studio test project

      Click the image to enlarge it.

    • If you use Azure DevOps Services, Azure DevOps Server 2019 or Team Foundation Server 2018, to make TestComplete test files availabe to test plans, add tasks that will copy the test files to an artifact staging folder and publish them:

      TestComplete integration with Visual Studio: Copying test files to an artifact staging folder

      Click the image to enlarge it.

      TestComplete integration with Visual Studio: Publish artifacts to a drop location

      Click the image to enlarge it.

    You can find information about tasks at docs.microsoft.com/en-us/azure/devops/pipelines/tasks/index.

  6. If needed, specify other build properties. You can learn more at docs.microsoft.com/en-us/azure/devops/pipelines/index.

  7. Save the changes.

After you create a build definition, start it to create a team build instance to be associated with your test plan. See 5. Create a Build Instance.

Prev     Next

See Also

Creating a Build Containing TestComplete Tests
(Obsolete) Integration With Azure DevOps and Team Foundation Server via TCTest Item
Preparing Visual Studio Test Projects for Running TestComplete Tests

Highlight search results