Even though Zephyr Scale Server/Data Center is designed to make your life easier, challenges may still arise as you figure things out and the app grows. Here are some frequently asked questions and answers.
What’s the purpose of test plans?
Test plans provide a high-level view of your entire test initiative. You can customize test plan fields to track scope, risks, strategy, pass/fail criteria, test bed, and other things. Associate test cycles with a test plan to better track test executions. There are also several reports you can filter by test plan, which aggregate all stats/results from the child test cycles linked to the test plan. You aren’t required to use test plans with Zephyr Scale, but they are incredibly useful if you choose to do so.
Does Zephyr Scale support traceability links with issues in Jira?
Does Zephyr Scale support versioning for test cases?
Yes, basic versioning functionality is available for test cases. Version control is enabled by default and allows teams to collaborate and manage multiple versions of test cases in parallel while maintaining data integrity and providing an audit history of changes. Versions can easily be viewed and compared for audit purposes.
Is it possible to change the order of test cases in a test cycle?
Definitely. The order of test cases within a test cycle can be set from the Cycles view. Just drag and drop test cases into whatever order you prefer, and this order is reflected in the Test Player. Zephyr Scale does not currently support the "test suite/set" functionality, which allows you to organize groups of test cases outside of a test cycle, though you can use folders to organize your test cases.
Does Zephyr Scale support call-to-test functionality to reuse test cases?
Yes, Zephyr Scale supports call-to-test. Instead of duplicating or copying/pasting test cases or steps, break them down into smaller, reusable pieces to construct new tests and achieve larger end-to-end testing scenarios. That way, test cases can be referenced (or called) into other test cases to enhance reuse.
Does Zephyr Scale support test cases with parameters?
Yes, Zephyr Scale supports parameters within test cases.
Does Zephyr Scale support agile methodologies?
Yes, with Zephyr Scale, small and agile teams can manage testing in a lightweight and straightforward fashion. You can create and link test cases or acceptance tests to user stories/bugs and create test cycles directly from the Jira issue or the Kanban board.
Does Zephyr Scale support data-driven test cases?
Yes, Zephyr Scale supports test data to be used within test cases.
Does Zephyr Scale support BDD (Behavior Driven Development)?
Yes, Zephyr Scale supports BDD type test cases.
Does Zephyr Scale offer a REST API to automate tasks or integrate with automated testing tools?
With our REST API, which is free when you install Zephyr Scale, you can access testing data from Jira and carry out a variety of useful tasks, such as migrating from another tool by importing your data, integrating with automated testing tools, and more. By using the API, you can publish automated test-execution results to Zephyr Scale and use our powerful reporting to view metrics on your entire testing process. The API is HTTP-based and can be used from any framework, programming language, or tool.
Does Zephyr Scale support custom fields?
Absolutely! Zephyr Scale supports custom fields for test cases, test cycles, test plans, test steps and test executions.
Does Zephyr Scale offer reporting options?
Yes, Zephyr Scale Server/Data Center offers a range of cross-project reporting (72 out of the box!). There are also a few legacy reports that will eventually be redeveloped for the new reporting suite. Custom reports are not supported at this time.
Does Zephyr Scale support Jenkins?
Yes! Check out the documentation for more information.
Does Zephyr Scale support importing/migrating test cases?
Does Zephyr Scale supports JQL functions?
Yes, Zephyr Scale Server/Data Center supports various JQL functions.
Are you planning to move to Atlassian Forge? If yes, by when?
We currently do not have any plans to move to Atlassian Forge.
How does Zephyr Scale pricing work?
Atlassian requires that you purchase the same license level for apps as you have for your base product. Here’s the explanation. There is, unfortunately, no way to purchase a lower license tier for apps at this time.
Are you planning on providing your apps at no cost for non-production/sandbox environments if your customer has a paid version in production?
You can get a free 30-day trial from Atlassian Marketplace. This period can only be extended by Atlassian, for another 7 days.
Security and reliability
Are you SOC 2 compliant? What security accreditations do you hold?
Zephyr Scale is not SOC 2 compliant, however, we are participating in and compliant with the following programs owned by Atlassian:
Do you conduct external (third-party) audits of the service? If so, please describe the scope and frequency of those audits.
We currently don’t conduct external audits of the app.
Has the add-on been security assessed – can we see the result?
As we are compliant with the Atlassian Security Program, a self-assessment is updated and sent to Atlassian every year. This is a company-wide assessment, not a per-product assessment.
Do you have a Security Incident Response Program?
Yes, more information is available on request.
Do you undertake penetration testing (or similar technical security testing, code review, or vulnerability assessment)?
We are enrolled in the Bug Bounty program run by Bugcrowd as part of the Atlassian “Vendor Security Assessment” program. As part of the program security, researchers pentest our application and report back all security vulnerabilities, and we fix all the identified vulnerabilities as per the SLA’s setup by Atlassian for the program. If we continue to meet the requirements of the vendor security assessment program, Atlassian confers a security badge on the app in the marketplace.
Do you have an Information Security Policy with supporting Standards and Procedures? Please provide details (or provide a copy of the policy).
Are you accredited to any relevant security standards (for example, SSAE16 SOC1/2/3, ISO27001, PCI DSS)?
We don’t have any security relevant certificates yet.
Where else is SmartBear data being processed?
Anonymous data is collected and processed by third-party applications:
Sentry – error-tracking and performance-monitoring
Segment – product usage data aggregation platform
Amplitude – product usage data analytics platform
No personal data is collected and processed by these tools.
Example of the data processed includes:
|License tier||2000 users|
|Support Entitlement Number||SEN-1234566|
|Jira instance ID||JHYU-AS8U-ASDF-BHJ7|
|Tracking event name||Viewed test player|
Do you do spike testing, soak testing, stress testing, load testing?
No, although we closely monitor the performance of our production systems and act to maintain and improve it accordingly.