How is My Automation Usage Calculated?
An automation test execution is a test case that executes within the cloud. Each automation test execution includes a full video showing the execution of the test case, along with console and network logs from the run.
What counts as an automation test execution?
A single automation test execution is generated in the following circumstances:
When you create a new test case in Reflect, the system automatically executes it to verify repeatability.
When you run a test case via Reflect, either in the background or when watching live.
When you re-run an existing test execution via Reflect.
When you run a test case from the Test Script tab in Zephyr.
When you run a single test case from the Test player in Zephyr.
Multiple automation test execution will be generated in the following circumstances:
When running a Test Cycle(Suite) via Reflect
When a Test Cycle(Suite) is automatically executed either via Reflect's built-in scheduler, or automatically via Reflect's CI integrations.
When you run a set of test cases from the test player in Zephyr.
How automated test executions are billed for Jira instance?
Automation test executions are now available for you in Zephyr, along with other automation features. There is no additional charge for utilizing these capabilities. See the number of automation test executions for your Jira tier in the What are my usage limits? section. See the full list of automation features available for you without installing Zephyr Advanced. Check Compare Zephyr and Zephyr Automate no-Code Automation.
How is usage tracked?
With the Advanced upgrade, you can view the number of automation test executions available each month.This number depends on your organization's Jira tier here.
Every test case execution with the automation feature counts as 1 automation test execution. For more info on what is counted as an automation run, visit this section.
What happens if I reach my monthly limit?
If our system sees that your team passes your monthly automation test execution, you’ll see a warning banner whenever you go to Zephyr Advanced. For example, this might happen if you reach 75% of your monthly amount.
If your team reaches the limit of allotted executions, your test execution will fail to run until usage resets on the following month.
When will my monthly limit reset?
The reset date is unique for each account. To see your monthly reset date Settings → Account Information in Reflect.
What if I run out of automation runs?
If you do not upgrade to Zephyr Advanced:
Wait until your monthly reset date for automated test executions to refresh. See how to check the reset date in the “When will my monthly limit reset?” section above.
If you do have Zephyr upgraded to Advanced:
- Wait until your monthly reset date for automated test executions to refresh. See how to check the reset date in the “When will my monthly limit reset?” section above.
When you cross the test run limit for Zephyr Advanced, you will be prompted in the app for the next steps.