Are you preparing to migrate your Jira instance and apps from Server/Data Center to Cloud? Before you proceed, please visit our Cloud Migration Guide.
If you’re choosing between Jira Server/Data Center and Cloud, we’ve created a comparison matrix to show you the differences between our Zephyr Squad apps by hosting. As is the case with most apps in the Atlassian marketplace, our Cloud app provides a different set of features to our Server/Data Center apps.
Our product and development team always seek for user input to continue to improve. We believe that their feedback leads to improvements that make the application work better. We will launch a brand-new idea portal in Q1 2023. Refer to our Roadmap for more details.
Comparison
| Feature | Server/DC | Cloud |
|---|---|---|
|
Global settings in Jira |
||
|
Enable/disable Zephyr on project level |
Yes |
Yes |
|
Create custom fields |
Yes |
Yes |
|
Create custom test execution status |
Yes |
Yes |
|
Create step results execution status |
Yes |
Yes |
|
Enable/disable execution workflow |
Yes |
Yes |
|
ADG UI (new and old user experience option) |
No |
Yes |
|
Remote link configuration |
Yes |
Yes |
|
Version configuration |
Yes |
Yes |
|
“Show Create Zephyr Test on Issue Type(s)” configuration option |
Yes |
Yes |
|
Append cycle/folder clone with prefix setting |
Yes |
Yes |
|
Sort cycle folders |
Yes |
Yes |
|
Reindex all projects and individual projects |
Yes |
Yes |
|
Hard reindex |
Yes |
N/a |
|
Automatic and manual backup |
No (done as part of Jira backup) |
Yes |
|
Index recovery |
Yes |
N/a |
|
Configuring API keys |
N/a |
Yes |
|
Clear server cache |
No |
Yes |
|
Clear permission cache |
No |
Yes |
|
Clear cycle cache |
Yes |
N/a |
|
Cleanup cycles |
Yes |
N/a |
|
Clear gadget cache |
Yes |
N/a |
|
Workflow validator |
Yes |
No |
|
View different levels of logs |
Yes |
N/a |
|
Cleanup orphan executions |
Yes |
N/a |
|
Zephyr maintenance mode custom message option |
Yes |
N/a |
|
Issue security |
Yes |
Yes |
|
Enable/disable Importer |
Yes |
No |
|
Cleanup Orphan Audit history |
Yes |
N/a |
|
Sort issues configuration |
Yes |
No |
|
Project settings |
||
|
NextGen support |
N/a |
Yes |
|
Enable/disable Zephyr custom field configuration |
Yes |
Yes |
|
Enable/disable BDD |
No |
Yes |
|
Test Design |
||
|
Create/edit/delete test steps |
Yes |
Yes |
|
Include custom fields and attachments |
Yes |
Yes |
|
Clone/copy test steps |
Yes |
Yes |
|
Test details history |
Yes |
Yes |
|
Create/download BDD scenarios |
No |
Yes |
|
Test details (lite, detail view, full grid view) |
Yes |
Yes |
|
Reorder test steps |
Yes |
Yes |
|
Test Planning |
||
|
Support for test plans - cycle folder creation |
Yes |
Yes |
|
Hierarchical folder structure for test cycle |
Yes |
Yes |
|
Add test to cycle using individual, saved filters, other cycles |
Yes |
Yes |
|
Add assignee to test cases |
Yes |
Yes |
|
Cycle summary - list and details |
Yes |
Yes |
|
Sort cycle folders |
Yes |
Yes |
|
Clone/delete/move cycle or folders |
Yes |
Yes |
|
Search cycle/folders |
Yes |
Yes |
|
Help - app walkthrough / tour |
Yes |
Yes |
|
Export test cycle and folders to HTML/XML/CSV |
CSV only |
Yes |
|
Move execution from cycle to folder |
Yes |
Yes |
|
Reorder executions |
Yes |
No |
|
Bulk add tests to cycle - via "Search Issues" page in Jira |
Yes |
No |
|
Project archiving |
Yes |
No |
|
Test Execution |
||
|
Create test executions |
Yes |
Yes |
|
Update execution and test step results (custom fields/status/comments/attachments/defects) |
Yes |
Yes |
|
Execution workflow / time tracking |
Yes |
Yes |
|
Execution history |
Yes |
Yes |
|
Search executions by using basic and advanced filter options |
Yes |
Yes |
|
Bulk operations (change execution status/move/copy/assign/link defects/custom fields/delete) |
Yes |
Yes |
|
Archive test executions |
Yes |
No |
|
Export test executions to HTML/XML/CSV |
Yes |
Yes |
|
Predefined filters |
Yes |
Yes |
|
Create search execution filters |
Yes |
Yes |
|
Test Summary |
||
|
Summary report (test by version/label/component) |
Yes |
Yes |
|
Test creation: 30-day summary chart |
Yes |
Yes |
|
Test execution: 30-day summary chart |
Yes |
Yes |
|
This is a high-level overview of your test cases. Note: The metrics it shows are calculated differently for Server/Data Center and Cloud. Click here to see the differences in the Test Summary page. |
||
|
Traceability |
||
|
Forward traceability (requirements -> test -> execution -> defects) |
Yes |
Yes |
|
Backward traceability (defects -> execution -> test -> requirements) |
Yes |
Yes |
|
Export traceability to HTML/Excel |
Yes |
Yes |
|
Tabular report view |
Yes |
Yes |
|
Tree report view |
Yes |
Yes |
|
Traceability matrix with the ability to use Jira and Zephyr filters |
No |
Yes |
|
Agile integration |
||
|
Sprint view - Adding cycles to sprint |
Yes |
Yes |
|
Issue view - Managing test issues in sprint |
Yes |
Yes |
|
Automation |
||
|
Native support for BDD (Gherkin/Cucumber) |
No |
Yes |
|
REST API |
Yes |
Yes |
|
Supported automation frameworks |
Eggplant, JUnit, Selenium, SoapUI, TestNG, Tricentis Tosca, UFT |
Eggplant, JUnit, Selenium, SoapUI, TestNG, Tricentis Tosca, UFT, Cucumber |
|
CI/CD scripts |
Yes |
Yes |
|
Automated defect creation for failed executions |
Yes |
No |
|
Utilities |
||
|
Importer |
Internal and external |
Internal and external |
|
Permissions |
||
|
Jira permissions |
Yes |
Yes |
|
Zephyr permissions |
Yes |
No |
|
Integration |
||
|
Jenkins add-on |
Yes |
Yes |
|
Bamboo add-on |
Yes |
Yes |
|
Reporting |
||
|
Number of built-in test metrics reports |
N/a |
5 |
|
Number of gadgets in Jira dashboard |
9 |
9 |
|
Number of charts in Jira reports |
3 |
3 |
Additional Information
In this section, you will find additional information related to the differences between the Jira Server/Data Center and Cloud.
Test Summary View
The Test Summary view lists the total number of Zephyr Test objects by execution status. Find the differences between the Server/DC and Cloud Test Summary metrics in the table below-
| Test Summary Objects | Server/DC | Cloud |
|---|---|---|
| Total Tests |
Total number of Test Cases |
Total number of Test Cases |
| Total Unexecuted |
Test executions whose execution status is Unexecuted |
Test cases with Unexecuted status plus the test cases not scheduled in a Cycle |
| Total Executed |
Test executions whose execution status is not Unexecuted |
Test cases whose execution status is not Unexecuted |
| Total Unscheduled |
Test cases not scheduled in a Cycle |
N/a |