Feature Comparison

Test Issue Type

Test Case in Jira as Issue type called Test

Zephyr Squad	Squad screenshot	Zephyr Scale	Zephyr Scale screenshot	Can be migrated	Additional information
Yes		No		No	Test cases exist in New Zephyr Scale, but use a different data architecture. In Squad, test cases are Jira issues. In Scale, test cases are internal objects. They are not Jira Issues, they belong to New Zephyr Squad database, managed by SmartBear. For both Zephyr Squad and Zephyr Scale, Test cases can have test steps with custom fields and attachments. Test cases can be added to a cycle and folder and executions can be created.

Test Cases

A test case is a test artifact developed for a particular testing need.

Zephyr Squad	Zephyr Squad screenshot	Zephyr Scale	Zephyr Scale	Can be migrated	Additional information
Yes		Yes		Yes	Test cases exist in Zephyr Scale, but use a different data architecture. In Squad, test cases are Jira issues. In Scale, test cases are Zephyr Scale objects. They are not Jira Issues, but belong to New Zephyr Squad database, managed by Smartbear. For both Zephyr Squad and Zephyr Scale, test cases can have test steps with custom fields and attachments. Test cases can be added to a cycle and folder and executions can be created.

Test Cases custom fields

Use custom fields to customize Test Cases according to your needs.

Zephyr Squad	Zephyr Scale	Can be migrated	Additional information
Yes	Yes	Yes	The advanced type of custom fields are not migrated.

Test Cases attachments

Use attachments for Test Cases to share insight with your team.

Zephyr Squad	Zephyr Squad screenshot	Zephyr Scale	Zephyr Scale screenshot	Can be migrated	Additional information
Yes		Yes		Yes	N/A

Test Cases multiple components

Every Test Case accepts multiple components.

Legacy Zephyr Squad	Legacy Zephyr Squad screenshot	New Zephyr Squad	New Zephyr Squad screenshot	Can be migrated	Additional information
Yes		No		Yes	If the component field in Legacy Squad contains multiple component values, one of the components needs to be assigned to the component field for the New Squad test case and all others need to be mapped to the New Squad test case custom field called “Squad components“ with the type Select List (Multi Choice).

Test Steps

Test Steps describe the execution steps and expected results that are documented against each one of those steps.

Zephyr Squad	Zephyr Squad screenshot	Zephyr Scale	Zephyr Scale screenshot	Can be migrated	Additional information
Yes		Yes		Yes	N/A

Test Steps Wiki formatting

Zephyr Squad	Zephyr Squad screenshot	Zephyr Scale	Zephyr Scale screenshot	Can be migrated	Additional information
Yes		Yes		Yes	N/A

Test Step custom fields

Use custom fields to customize your Test Steps accordingly to your needs.

Zephyr Squad	Zephyr Squad Screenshot	Zephyr Scale	Zephyr Scale Screenshot	Can be migrated	Additional information
Yes (maximum 5)		Yes		Yes	N/A

Test Step attachments

Use Test Step attachments to improve collaboration with your team.

Export Test Case with Test Steps

Export your test cases to XML, EXCEL or BDD-Gherkin.

Import Test Cases

Using our import wizard, users can import test cases—including all test case data—into New Zephyr Squad Cloud in the following formats CSV, Excel(via CSV), XML).

Test Case repository

Use Test Repository to view and manage all Test cases within this Jira project.

Test Case archiving

The archive button puts your Test Cases into the Archived Test Cases folder and makes them inactive throughout New Zephyr Scale but saves all the Test Case data in case you want to restore them later.

Test case history

The History tab allows tracking all the changes made on this test case.

Test Step history

Test step history allows you to view all changes of a particular test step within a test case.

Test case search

The search bar filters title information, both Key and Name values. Results filter as you type.

Test case saved filter

Save filter option allows users to save custom queries that they often use.

Test Cycles

A test cycle is a focused set of test cases that are grouped to achieve specific testing goals.

Test Cycle custom fields

Use custom fields to customize your Test Cycles accordingly to your needs.

Test cycle attachments

Use attachments for Test Cycles to share insight with your team.

Ad-hoc Test Cycles

Scale Cloud gives your team the flexibility to execute test cases individually, without having to add them to a test cycle. Just create and link test cases or acceptance tests to user stories/bugs, then initiate the test execution directly from the Jira issue.

Multi-level folder structure

Group testing artifacts into folders and sub-folders to organize the work in the way that works for you.

Test Cycle Organization Structure

Export Test Cycles

Test cycle search

The search bar filters title information, both Key and Name values. Results filter as you type.

Test Plan

Test plans (groups of test cycles) are used to track testing progress throughout an entire release or version.

Test plan search

The search bar filters title information, both Key and Name values. Results filter as you type.

Test plan custom fields

Use custom fields to customize Test Plan accordingly to your needs.

Test plan attachments

Use attachments for Test Plans to share insight with your team.

Test Execution

The Test Player is where actual testing occurs and is tracked within Zephyr Scale. Regardless of how many test cases you want to execute, the Test Player is where the fun happens.

Test Execution custom fields

Use custom fields to customize Test Execution accordingly to your needs.

Test Execution attachments

Add attachments to the Test Execution to share test results with the team.

Test Execution custom status

Use custom statuses to configure test execution according to the needs of your organization.

Defect link on Test Execution

You can create a new defect or link an existing one to a test execution or to a test execution step.

Multiple test executions in test cycle

When the time comes to reuse a test cycle and rerun the test cases, click Start a New Test Execution. This archives the previous test execution result and allows you to start testing from scratch.

Export Test Execution

Test Step Results

You can mark each step of your test case with different status accordingly to its execution results.

Test Step Results attachments

Use attachments to Test Step to illustrate test step results to your team.

Test Step results custom status

Use custom statuses to configure test execution according to the needs of your organization.

Defect link on Test Step Results

Create or link a defect right from the test step to indicate the bug that contribute to the failed execution.

Time tracking (during the execution)

Use the time tracking feature to measure the time it takes to perform a particular test case.

Reporting on Test Execution

Make reports on test execution to increase the traceability of your testing.

Reporting on Top Defects

Make reports on top defects to increase the traceability of your testing.

Traceability

Use the traceability section on the issue view to see the execution statuses of test cases/cycles/plans associated with this issue or manage your test process linked to a particular issue.

Search Test Executions

Test Execution filters

Test Execution bulk operations

Test Execution change history

Roles and groups

Jira has three default roles namely: Administrators, Developers, and Users. Groups are multiple users within your instance that need the same application permissions.

Permission Control

Use permissions to manage user interaction with Scale/Squad.

Control of Issue types supporting app

When you enable an issue type for Zephyr Scale, you'll be able to see the Traceability Panel on the issue. If you disable an issue type, you won't be able to see this panel.

Jira dashboard gadgets

Use gadgets to display summaries of Scale projects and test data on the dashboard.

Zephyr Squad	Zephyr Squad screenshot	Zephyr Scale	Zephyr Scale screenshot	Can be migrated	Additional information
9 gadgets	Legacy Zephyr Squad has following gadgets in the Jira dashboard: Test Distribution Test Execution Test Execution Assignment Test Execution Burndown Test Execution Details Test Execution Distribution Test Execution Time Tracking Test Progression Top Defects Impacting Testing	21 gadgets	New Zephyr Squad has the following 9 gadgets in the Jira dashboard on Cloud: Test execution burn down Test execution burn up Test execution completion over time Test execution completion over time by status Test execution completion over time by status (accumulated) Test execution effort (overall) Test execution effort by tester Test execution results (overall) Test execution results (progress) Test execution results by component Test execution results by coverage Test execution results by environment Test execution results by label Test execution results by priority Test execution results by project Test execution results by test cycle Test execution results by test plan Test execution results by tester Test execution results by type Test execution scorecard by test cycle Test execution scorecard by tester	N/A	Main differences: The Test execution details and Top Defects Impacting Testing gadgets have no equivalent in Scale. Scale provides more filtering options when generating the reports and additional reports to group data by specific fields that are not available for Squad (environment, priority, test plan, type, project.

Jira Reports

Reports in Jira help teams analyze progress on a project, track issues, manage their time, and predict future performance.

Zephyr Squad	Zephyr Squad screenshot	Zephyr Scale	Zephyr Scale screenshot	Can be migrated	Additional information
3	Legacy Zephyr Squad has three different charts in the Jira reports section: Test Execution Burndown Chart Test Execution Chart Top Defects Report	0	N/A	N/A	Scale doesn’t use Jira Reports. It has its own section of reports as described below. The Top Defects Report does not have an exact equivalent in Scale. With a bit of set up using filters, it could be reproduced using the Test execution results by coverage report

Zephyr Test metrics page

Use the Zephyr test metrics page to perform reporting on your Test process.

Zephyr Squad	Zephyr Squad Screenshot	Zephyr Scale	Zephyr Scale Screenshot	Can be migrated	Additional information
5 reports	In the Test Metrics page, Legacy Zephyr Squad provides following charts: Daily Test Execution Progress Test Executions By Test Cycle Test Executions By Tester Executions By Date Executions By Date Test Metrics is a dedicated page added in the Legacy Zephyr Squad menu to have the reporting. The filter criteria available are fixVersions and time interval. The selected filters apply to all the charts and any selection on the charts like drill-drown affects other charts as well.	Yes	Zephyr Scale has 29 reports available in the report tab.	Yes	Main differences Test Metric page: The Executions By Date page has no equivalent in Scale. The information are available in several reports in Scale and in a single page in Squad. From the Test Summary screen, these are the reports that are missing in Scale: Test library (Test by Component) Test library (Test by Label) Test library (Test Creation)

Link Test Cycles/Folders to a sprint

Test Execution view in Issue Backlog

Integration with Cucumber/Gherkin

Support of Gherkin keywords to write down test script.

Advanced features (Gherkin validations, tag management)

Supported automation frameworks

Support of Gherkin keywords to write down test script.

Test automation integration UI

ZBot

Support on CI/CD tools

Zephyr Scale's Bamboo integration enables you to automate tests outside Jira, run them in Bamboo during the CI/CD pipeline, and have results sent back to Zephyr Scale for reporting and tracking.

REST API support

Expose data via a REST API which allows you to access the data programmatically and build your own integrations.

SmartBear tools integration

Reindexing

Custom Status

Add custom status to customize the app according to the needs of your test process.

Custom environment

Add custom environments to customize the app according to the needs of your test process.

Custom labels

Add custom labels to customize the app according to the needs of your test process.

Custom priorities

Add custom priorities to customize the app according to the needs of your test process.

Custom datasets

Add custom data sets to optimize the app according to the needs of your test process.

Team-managed (Next-Gen) project support

Internationalisation support (i18n)

GDPR complaint

Personal information transferred outside of the European Economic Area will be subject to the appropriate safeguards pursuant to GDPR and other applicable law, including without limitation, standard contractual clauses approved by the European Commission.

Cloud Security participant

The Cloud Security Participant badge identifies cloud apps enrolled in the Marketplace Bug Bounty Program, and will evolve to include more rigorous testing and security assessments.

Cloud Fortified support

Cloud Fortified apps meet all of Atlassian’s cloud security requirements and show their own investment in cloud security by participating in the Marketplace Bug Bounty program and completing a security self assessment that is reviewed annually by Atlassian.

Data storage