Run Test Cases With Associated TestComplete Tests by Using the Visual Studio Test Task

Requirements

Configure a Release Pipeline to Run Your Test Plan

Run Tests and View Test Results

You must have access to your team project. You can access the project directly from your web browser by using Team Web Access:

• For Azure DevOps Services (formerly known as Visual Studio Team Services or VSTS):

  https://dev.azure.com/<Your_Azure_Account_Name>/<Project_Name>

  – or –

  https://<Your_VSO_Account_Name>.visualstudio.com/<Project_Name> (if your organization has not moved to the dev.azure.com domain yet)

• For On-Premises Team Foundation Server:

  http://<Your_Server_Name>:8080/tfs/<Collection_Name>/<Project_Name>

You can find information on Web Portal at docs.microsoft.com/en-us/azure/devops/project/navigation/.

The remote computers where your TestComplete tests will run (test agents) must have the following software installed:

• Build and Release Agent for Windows.

• TestComplete 14 (or TestExecute 14).

• TestComplete 14 Visual Studio Integration Package.

  The Integration Package installer is shipped along with TestComplete. You can find it in the TestComplete folder after installing the product:

  <TestComplete 14>\VS Integration\VSIntegration.exe

  Run this installer after installing TestComplete on computers where tests will run. In the installation wizard, select a Build and Test Integration feature appropriate to your agent version.

1. Open the web portal of your team project and navigate to the Pipelines > Releases page of your project:

   

   Click the image to enlarge it.

2. Open the release pipeline you want to use to run a test plan with associated TestComplete tests or create a new pipeline:

   

   Click the image to enlarge it.

3. Add an artifact that includes your TestComplete tests (.tc12test files) to the pipeline:

   

   Click the image to enlarge it.

4. Add a stage that will run your TestComplete tests.

5. Add the Visual Studio Test task to the pipeline.

6. Configure the task to run the test plan that includes test cases with assigned TestComplete tests:

   • In the Select tests using drop-down list, select Test plan.

   • In the Test plan drop-down list, select your test plan.

   • In the Test suite drop-down list, select the entire test plan or test suites that include the needed test cases.

   • Select the needed test configuration.

   • In the Search folder text box, specify the directory on your test agent where the task should search for test files.

   

   Click the image to enlarge it.

7. Specify other pipeline settings, if needed. You can learn about pipelines at docs.microsoft.com/en-us/azure/devops/pipelines/index.

8. Save the changes.

Create a release from the created pipeline. It will run TestComplete tests on the specified test agent and assign the test results to the appropriate test cases.

After the release run is over, you can view the test results:

1. Open the release and select the stage that ran your tests.

2. Open the stage logs:

   

   Click the image to enlarge it.

3. Switch to the Tests page of the stage:

   

   Click the image to enlarge it.

4. Select the needed test case to view its detailed results. The Attachments section includes the TestComplete test log:

   

   Click the image to enlarge it.

   Click it to view the attached log or to download it.