6. Configure a Test Plan

Applies to TestComplete 14.40, last modified on April 22, 2021
This approach to running TestComplete tests as part of a test plan is obsolete. We do not recommend using it. Starting from version 14.20, you can assign your TestComplete tests to Azure test cases directly from TestComplete IDE and run them as part of your team project’s test plan. To learn more, see Integration With Azure DevOps and Team Foundation Server.

After you create a team build containing your TestComplete tests, you can assign that build to a test plan.

Requirements

You must have access to your team project’s test plans:

  • To access and manage test plans from Microsoft Test Manager, you must have one of the following Microsoft Visual Studio versions with Microsoft Test Manager installed:

    • Microsoft Visual Studio 2015–2019 (the Enterprise or Test Professional edition).

    • Microsoft Visual Studio 2010 - 2013 (the Ultimate or Premium edition).

  • To access a test plan by using your team project’s Web Portal:

    • Important: You must have the Microsoft Test Manager extension installed on your Azure DevOps Server or Team Foundation Server, or for your Azure account.

    • Access your project directly from your web browser:

      • For Azure DevOps Services (formerly known as Visual Studio Team Services or VSTS):

        https://dev.azure.com/<Your_Azure_Account_Name>/<Project_Name>

        – or –

        https://<Your_VSO_Account_Name>.visualstudio.com/<Project_Name> (if your organization has not moved to the dev.azure.com domain yet)

      • For On-Premises Azure DevOps Server and Team Foundation Server:

        http://<Your_Server_Name>:8080/tfs/<Collection_Name>/<Project_Name>

      You can find information on Web Portal at docs.microsoft.com/en-us/azure/devops/project/navigation/.

Prerequisites

For Azure DevOps Services, Azure DevOps Server 2019 and Team Foundation Server 2018.

To run TestComplete tests as part of a test plan from the Web Portal of your team project, you must have a release pipeline that is based on the Run automated tests from Test Manager template and that uses a build instance that includes your TestComplete test files as an artifact.

Note: If you are going to run your TestComplete tests as part of a test plan from Microsoft Test Manager in lab environments, skip this step.

To create a release pipeline:

  1. Open the Web Portal of your team project and navigate to the Pipelines > Releases page:

    TestComplete integration with Visual Studio: Pipelines > Releases page

    Click the image to enlarge it.

  2. Click New > New release pipeline. In the resulting Select a template wizard, select the Run automated tests from Test Manager template and click Apply:

    TestComplete integration with Visual Studio: Create a new release pipeline from the Run automated tests from Test Manager template

    Click the image to enlarge it.

  3. Add the artifact that includes the results of your build created on step Create a Build Containing TestComplete Tests to the pipeline:

    TestComplete integration with Visual Studio: Select artifacts

    Click the image to enlarge it.

  4. By default, the created pipeline includes a single stage that has one task: Visual Studio Test.

  5. Make sure the task will run on the proper agent that meets all the needed requirements:

    TestComplete integration with Visual Studio: Select an agent pool

    Click the image to enlarge it.

  6. If you have a Visual Studio Test task, make sure that:

    • The Select tests using setting is set to Test Run.

    • The Search folder setting contains the path to the folder where your TestComplete test items (.tc12test files) reside.

    TestComplete integration with Visual Studio: Configure the Visual Studio Test task

    Click the image to enlarge it.

  7. Save the pipeline.

Create and Configure a Test Plan

From the Web Portal

You must either have the Enterprise account type or the Microsoft Test Manager extension must be installed.

  1. Open the Web Portal of your team project.

  2. Navigate to the Test Plans page of your project:

    TestComplete integration with Visual Studio: The Test Plans page of the team project

    Click the image to enlarge it.

  3. Select the needed test plan or click New Test Plan to create a new one.

  4. Configure your test plan settings:

    TestComplete integration with Visual Studio: Configure your test plan

    Click the image to enlarge it.

  5. Save the changes.

  6. Select your test plan or the test suite to which you want to add a test case with associated TestComplete tests. To learn how to associate TestComplete tests with test cases, see 3. Associate a Test Project With a Test Case (Run TestComplete Tests as Part of a Test Plan).

  7. Click Add existing. In the resulting dialog, find the needed test case and click Add.

From Microsoft Test Manager

  1. Launch Microsoft Test Manager and connect to your team project.

  2. Go to the Testing Center and select the needed test plan. If you do not have a test plan, create it:

    TestComplete integration with Visual Studio: Selecting a test plan

  3. Open the Properties page of your test plan:

    TestComplete integration with Visual Studio: Configuring Test Plan properties

    Click the image to enlarge it.

  4. In the Filter for builds drop-down list, select the needed build definition.

    In Build in use, click Modify and select the build you want to use for testing:

    TestComplete integration with Visual Studio: Assigning a build to the test plan

  5. If you run tests in a lab environment, in the Test settings drop-down list, select the appropriate test settings.

    Note: You can run automated tests in lab environments only if you use XAML builds.

    In the Test environment drop-down list, select the lab environment where you want to run TestComplete tests.

    TestComplete integration with Visual Studio: Configuring automated runs properties of the test plan

  6. Save the changes.

  7. Select your test plan or a test suite to which you want to add a test case with TestComplete tests associated. To learn how to associate TestComplete tests with test cases, see 3. Associate a Test Project With a Test Case (Run TestComplete Tests as Part of a Test Plan).

  8. Click Add. In the resulting dialog, find the needed test case and click Add test case:

    TestComplete integration with Visual Studio: Adding a test case to a test plan

    Click the image to enlarge it.

Prev     Next

See Also

Run TestComplete Tests as Part of a Test Plan
Creating a Build Containing TestComplete Tests
Running Test Cases with Associated TestComplete Tests

Highlight search results