If you use Zephyr to plan and monitor your testing efforts and use Jenkins to run your automated TestComplete tests, you may want to include your TestComplete test results in your test reports and metrics in Zephyr.
There are several ways to do this:
Applicable only if you use TestComplete version 14.10 and Zephyr for Jira.
Jira Server 7.2.x–7.13.x
– or –
Jira Data Center 7.2.x–7.13.x
– or –
TestComplete version 14.10 (or later)
Zephyr for Jira Integration Plugin must be enabled in TestComplete. By default, the plugin is installed and enabled automatically when you install TestComplete. If you experience issues with Zephyr integration, make sure the plugin is enabled in the File > Install Extensions dialog (you can find the plugin in the Common group).
Your TestComplete workstation must have access to your Jira project.
If your TestComplete test project does not have test items, create them.
Make sure that the items are marked as test cases. TestComplete can only send test case results to Zephyr.
To learn how to create test items, mark them as test cases, and assign tests to them, see the description of the Test Items page.
Click Connect to Zephyr for Jira on the TestComplete toolbar to open the Properties > Zephyr for Jira page of your project and bind the project to your Jira project. To learn how to do this, see Integration With Zephyr for Jira:
You can do this directly in the TestComplete project:
As an alternative, you can do this later when configuring your Jenkins job or pipeline (see below).
Open the Test Items page of you project and in the Link to external test case column, bind your project’s test items to Zephyr tests in your Jira project:
For detailed instructions on how to do this, see Integration With Zephyr for Jira.
In Jenkins, configure your job or pipeline to run your TestComplete project’s test items. To learn how to do this, see the following topics:
If you did not specify your Jira project’s release version and test cycle to which you want to send test results earlier when configuring your TestComplete project, you can do this now. Use the
ZephyrCycle command-line arguments of TestComplete.
If you use a freestyle job, to do this, use the Advanced > Additional command line arguments property of the TestComplete Test build step:
If you use a pipeline, use the
commandLineArguments property of the TestComplete Test step:
Note: If you specified the test cycle neither in your TestComplete project, nor in your Jenkins job or pipeline, TestComplete will send the test results to the default Ad hoc test cycle of the specified release. If you specified the release version neither in your TestComplete project, nor in Jenkins, TestComplete will send the test results to the default Unscheduled release.
In Jenkins, run your job or pipeline.
TestComplete will execute the tests, send their results to Jira and assign them to the specified Zephyr tests as test executions:
Applicable if you use Zephyr for Jira or Zephyr Enterprise.
Not applicable for Jenkins Pipeline.
Zephyr Cloud or Zephyr Enterprise versions 4.7.x–6.2.x.
Your Jenkins server must have the following plugins installed:
Your Jenkins server must be configured to access your Zephyr server. To learn how to do this, see the documentation for your version of the Zephyr Test Management plugin.
In Jenkins, configure your job to run your TestComplete tests. To learn how to do this, see Configuring Jenkins Freestyle Jobs to Run TestComplete Tests:
Important: Configure your job to export TestComplete test results to JUnit-style reports. To do this, enable the Advanced > Generate JUnit-style report property of your TestComplete Test build step:
Otherwise, Jenkins will not be able to publish TestComplete test results to Zephyr.
Configure your Jenkins build to post test results to Zephyr after the build is over:
For detailed instructions on how to do this, see the Configuring plugin as a post-build action section of the documentation for your plugin version on the Jenkins web site:
plugins.jenkins.io/zephyr-enterprise-test-management (for Zephyr Enterprise plugin)
plugins.jenkins.io/zephyr-for-jira-test-management (for Zephyr for JIRA plugin)
Run your build.
TestComplete will run tests and export the test results.
The Zephyr Test Management plugin will capture the exported test results and send them to Zephyr.
For each executed TestComplete test, the plugin will create a test case and assign the test results to it:
The name of the created test cases include the name of the TestComplete project suite, project and executed test.
If the name of the executed TestComplete test matches an existing test case, the plugin will not create a new test case. It will add a new test execution to the existing test case.