Running TestComplete Tests as Part of Team Builds - Requirements

You can run TestComplete tests as part of a team build if you use one of the following Team Foundation Server versions:

• Team Foundation Server 2010–2018.

• Team Services.

  Note:

  Use private agents to run TestComplete tests. Running TestComplete tests on hosted agents is not supported.

• One of the following Microsoft Visual Studio versions with the Team Explorer component:

  • Microsoft Visual Studio 2015–2017 (Community, Enterprise or Professional edition).

  • Microsoft Visual Studio 2013 (Community, Ultimate, Premium, or Professional edition).

  • Microsoft Visual Studio 2010–2012 (Ultimate, Premium, or Professional edition).

• TestComplete 12.

• TestComplete 12 Visual Studio Integration Package.

  The Integration Package installer is shipped along with TestComplete. You can find it in the TestComplete folder after installing the product:

  <TestComplete 12>\VS Integration\VSIntegration.exe

  Run this installer after installing TestComplete . In the installation wizard, select the Visual Studio Integration feature corresponding to your Visual Studio version.

• If you run your tests on your build computer:

  Team Foundation Server with the Team Foundation Build Service component.

  — or —

  Team Foundation Build Service.

  – or –

  Visual Studio Team Services Build and Release Agent for Windows.

  If you run your tests on remote test agents:

  One of the following versions of Test Agent for Microsoft Visual Studio:

  • Test Agent for Microsoft Visual Studio 2015 RTM and Update 1

  • Test Agent for Microsoft Visual Studio 2017 and Visual Studio 2015 Update 2

  The build agent or test agent must be running as an interactive process so that TestComplete can interact with the desktop and with the tested application’s UI.

• One of the Microsoft Visual Studio versions supported by TestComplete (optional, if you use Team Foundation Build 2010 or 2012).

• TestComplete 12 (or Test Execute 12).

• TestComplete 12 Visual Studio Integration Package.

  The Integration Package installer is shipped along with TestComplete. You can find it in the TestComplete folder after installing the product:

  <TestComplete 12>\VS Integration\VSIntegration.exe

  Run this installer after installing TestComplete on the computer, where you will run tests. In the installation wizard, select the Visual Studio Integration feature and Build and Test Integration or Test Agent Integration feature corresponding to the software installed on your build computer or test agent.

• (Optional) Publish TestComplete Test Results extension.

  If you use Visual Studio Test task version 1 to run TestComplete tests and want TestComplete test results to be included into the test run statistics, use the extension to publish test results.

  The extension is available only for Team Foundation Server 2015–2018 On-Premises.

  The extension is shipped with TestComplete. You can find it in the TestComplete folder after installing the product:

  <TestComplete 12>\VS Integration\SmartBear.testcomplete-build-task-12-60.NNN.vsix

  Open the Manage Extensions page of your Team Foundation Server Web Portal and upload the extension, then install it. For detailed instructions on how to do it, see Installing Publish TestComplete Test Results Extension (For Team Foundation Server 2015 - 2018 On-Premises Only).