Sending TestComplete Test Results from Jenkins to Zephyr

Open your project in TestComplete. If your project does not have test items, create them. TestExecute can send the results of only test items to Zephyr. To learn how to create test items and assign tests to them, see the TestComplete documentation.

Click the image to enlarge it.

In TestComplete, open the Properties > Zephyr page of your project and bind the project to your Jira project:

Click the image to enlarge it.

To send test results to your Jira project, you need to specify the release versions and the test cycle to which you want to add them.

You can do this directly in the TestComplete project:

Click the image to enlarge it.

As an alternative, you can do this later when configuring your Jenkins job or pipeline (see below).

In the Execution Plan editor of your project, in the Report To column, bind your project’s test items to Zephyr tests in your Jira project:

Click the image to enlarge it.

In Jenkins, configure your job or pipeline to run your TestComplete project’s test items. To learn how to do this, see the following topics:

If you didn't specify your Jira project’s release version and test cycle when configuring your TestComplete project, you can do this now. Use the ZephyrVersion and ZephyrCycle command-line arguments of TestExecute.

If you use a freestyle job, to specify the release and test cycle, use the Advanced > Additional command line arguments property of the TestComplete Test build step:

Click the image to enlarge it.

If you use a pipeline, use the commandLineArguments property of the TestComplete Test step:

Click the image to enlarge it.

Note: If you specified a test cycle neither in your TestComplete project, nor in your Jenkins job or pipeline, TestComplete will send the test results to the default Ad hoc test cycle of the specified release. If you specified a release version neither in your TestComplete project, nor in Jenkins, TestComplete will send the test results to the default Unscheduled release.

In Jenkins, run your job or pipeline.

TestExecute will run the tests, send their results to Jira and assign them to the specified Zephyr tests:

Click the image to enlarge it.

If the test run fails, information on the first error posted to the test log will be added to the test execution’s comment section:

Click the image to enlarge it.

In Jenkins, configure your job to run your TestComplete tests. To learn how to do this, see Configuring Jenkins Freestyle Jobs to Run TestComplete Tests:

Click the image to enlarge it.

Important: Configure your job to export test results to JUnit-style reports. To do this, enable the Advanced > Generate JUnit-style report property of your TestComplete Test build step:

Click the image to enlarge it.

Otherwise, Jenkins will not be able to publish test results to Zephyr.

Configure your Jenkins build to post test results to Zephyr after the build is over:

Click the image to enlarge it.

For detailed instructions on how to do this, see the Configuring plugin as a post-build action section in the documentation for your plugin version on the Jenkins web site:

Run your build.

TestExecute will run the tests and export the test results.

The Zephyr Test Management plugin will capture the exported test results and send them to Zephyr.

For each executed test, the plugin will create a test case and assign test results to it:

Click the image to enlarge it.

The name of the created test case includes the name of the TestComplete project suite, project and executed test.

If the name of the executed test matches the name of an existing test case, the plugin will not create a new test case. It will add a new test execution to the existing test case.