Sending TestComplete Test Results From Jenkins to Zephyr

If your TestComplete test project does not have test items, create them.

Make sure that the items are marked as test cases. TestComplete can only send test case results to Zephyr.

To learn how to create test items, mark them as test cases, and assign tests to them, see the description of the Test Items page.

Click the image to enlarge it.

Click Connect to Zephyr for Jira on the TestComplete toolbar to open the Properties > Zephyr for Jira page of your project and bind the project to your Jira project. To learn how to do this, see Integration With Zephyr for Jira:

Click the image to enlarge it.

To send TestComplete test results to your Jira project, you need to specify the release versions and the test cycle to which you want to add them.

You can do this directly in the TestComplete project:

Click the image to enlarge it.

As an alternative, you can do this later when configuring your Jenkins job or pipeline (see below).

Open the Test Items page of you project and in the Link to external test case column, bind your project’s test items to Zephyr tests in your Jira project:

Click the image to enlarge it.

For detailed instructions on how to do this, see Integration With Zephyr for Jira.

In Jenkins, configure your job or pipeline to run your TestComplete project’s test items. To learn how to do this, see the following topics:

If you did not specify your Jira project’s release version and test cycle to which you want to send test results earlier when configuring your TestComplete project, you can do this now. Use the ZephyrVersion and ZephyrCycle command-line arguments of TestComplete.

If you use a freestyle job, to do this, use the Advanced > Additional command line arguments property of the TestComplete Test build step:

Click the image to enlarge it.

If you use a pipeline, use the commandLineArguments property of the TestComplete Test step:

Click the image to enlarge it.

Note: If you specified the test cycle neither in your TestComplete project, nor in your Jenkins job or pipeline, TestComplete will send the test results to the default Ad hoc test cycle of the specified release. If you specified the release version neither in your TestComplete project, nor in Jenkins, TestComplete will send the test results to the default Unscheduled release.

In Jenkins, run your job or pipeline.

TestComplete will execute the tests, send their results to Jira and assign them to the specified Zephyr tests as test executions:

Click the image to enlarge it.

In Jenkins, configure your job to run your TestComplete tests. To learn how to do this, see Configuring Jenkins Freestyle Jobs to Run TestComplete Tests:

Click the image to enlarge it.

Important: Configure your job to export TestComplete test results to JUnit-style reports. To do this, enable the Advanced > Generate JUnit-style report property of your TestComplete Test build step:

Click the image to enlarge it.

Otherwise, Jenkins will not be able to publish TestComplete test results to Zephyr.

Configure your Jenkins build to post test results to Zephyr after the build is over:

Click the image to enlarge it.

For detailed instructions on how to do this, see the Configuring plugin as a post-build action section of the documentation for your plugin version on the Jenkins web site:

Run your build.

TestComplete will run tests and export the test results.

The Zephyr Test Management plugin will capture the exported test results and send them to Zephyr.

For each executed TestComplete test, the plugin will create a test case and assign the test results to it:

Click the image to enlarge it.

The name of the created test cases include the name of the TestComplete project suite, project and executed test.

If the name of the executed TestComplete test matches an existing test case, the plugin will not create a new test case. It will add a new test execution to the existing test case.