How is my automation usage calculated?
An automation test execution is a test case that executes within the cloud. Each automation test execution includes a full video showing the execution of the test case, along with console and network logs from the run.
What counts as an automation test execution?
A single automation test execution is generated in the following circumstances:
When a new test case is created in Reflect, a test case will automatically be executed to verify that the test is repeatable.
When you run a test case via Reflect, either in the background or when watching live.
When you re-run an existing test execution via Reflect.
When you run a test case from the Test Script tab in Zephyr Scale.
When you run a single test case from the Test player in Zephyr Scale.
Multiple automation test execution will be generated in the following circumstances:
When running a Test Cycle(Suite) via Reflect
When a Test Cycle(Suite) is automatically executed either via Reflect's built-in scheduler, or automatically via Reflect's CI integrations.
When you run a set of test cases from the test player in Zephyr Scale.
How automated test executions are billed for Jira instance?
Automation test executions are now available for you in Zephyr Scale, along with other automation features. There is no additional charge for utilizing these capabilities. See the number of automation test executions for your Jira tier in the What are my usage limits? section. See the full list of automation features available for you without installing Zephyr Scale Automate. Check Compare Zephyr Scale and Zephyr Scale with Automate Capabilities.
Zephyr Scale Automate is an add-on to Zephyr Scale so after the installation of the add-on, you will see an additional entry in Apps > Managed Apps. And you will be billed according to your Jira Tier. See the pricing here.
How is usage tracked?
In the Automate embed you can see the number of automation test executions available per month. This number depends on the Jira Tier your organization has. See the number of automation test executions available per Jira tier here .
Every test case execution with automate feature counts as 1 automation test execution. For more info on what is counted as an automation run visit this section.
What happens if I reach my monthly limit?
If our system sees that your team passes your monthly automation test execution, you’ll see a warning banner whenever you go to Automate embed. For example, this might happen if you reach 75% of your monthly amount.
If your team reaches the limit of allotted executions, your test execution will fail to run until usage resets on the following month.
When will my monthly limit reset?
The reset date is unique for each account. To see your monthly reset date Settings → Account Information in Reflect.
What if I run out of automation runs?
If you do not have Zephyr Scale Automate installed you need to:
Wait till your monthly reset date for automated test executions to refresh. See here how to check the reset date.
If you do have Zephyr Scale Automate installed:
Wait till your monthly reset date for automation runs to refresh. See here how to check the reset date.
When you cross the test run limit for Zephyr Scale Automate, you will be prompted in the app on the next steps.