Integration With Azure DevOps and Team Foundation Server - Requirements

You can run TestComplete tests if you use one of the following:

• Azure DevOps Services (formerly known as Visual Studio Team Services or VSTS).

• Azure DevOps Server 2019

• Team Foundation Server 2015–2018

Test agents — remote computers where automated tests will run — must meet the following requirements:

• The following test agent types are supported:

  • Microsoft-hosted agents

    We recommend that you use Microsoft-hosted agents only if you use the SmartBear ID-based license. If you do not have this license yet and wish to try it, please contact the SmartBear Sales team or the Customer Care team.

    Limitation: The SmartBear Test Extension cannot be installed in Edge on Microsoft-hosted agents. Running web tests in Edge on such agents is not supported. As a workaround, you can use another web browser, for instance, Chrome, or you can run web tests on self-hosted agents.

  • Self-hosted (private) agents.

• Your test agents must have the following software installed:

  • TestComplete 14 (or TestExecute 14)

    Note: You can configure your pipeline to install TestComplete (or TestExecute) automatically during the run.

  • Visual Studio

    – or –

    Visual Studio Test Platform

    Note: You can configure your pipeline to install Visual Studio Test Platform automatically during the run.

• Important: For TestComplete (TestExecute) to be able to interact with the desktop and with the tested application’s UI:

  • The test agent must be running as an interactive process. You cannot use agents running as a service to run tests.

  • A computer where the agent is running must have an interactive user session opened:

    • You can open the needed user session manually, for example, by logging in to the machine where the agent is running.

    • If you use Team Foundation Server 2018 or later, you can run the agent with the auto-logon enabled. In this case, when the machine where the agent is installed starts, the agent launches and opens an interactive user session on the machine automatically. You enable the auto-logon and specify the user account that will be used to open user sessions when you configure your agent. For detailed information on how to configure agents, see docs.microsoft.com/en-us/azure/devops/pipelines/agents/.

      Limitation: Your agent and therefore TestComplete (or TestExecute) will start with non-elevated rights. In this case, if your tested application is running with elevated rights, TestComplete (or TestExecute) will not be able to access it and your test will fail.