Apps documentation
TestFLO - Test Management for Jira
TestFLO - Test Management for Jira
9.0.x
FAQ
Release notes
Last updated May 23, 2023

Test Plan Execution Report

This report shows the overall progress of Test Plans. Depending on the needs of granularity you can check the progress based on:

  • Test Cases status
  • Test Case steps progress
Note

The Test Plan Execution Report shows only the latest Test Case execution.

Steps

To use the Test Plan Execution Report

  1. Click on Projects in the main bar in Jira and select project from the list.
  2. Click on Test Reports on the left side menu.
    Report with TestFLO Jira Test Management
  3. Choose the Test Plan Execution Report

Result

View of the Test Plan Execution Report.

Report with TestFLO Jira Test Management

Filters

To obtain an appropriate range of data you can filter:

  • Test Plans
  • Requirements for Test Plans
  • Test Cases
  • Requirements for Test Cases

In the Basic mode, you can use built-in filters that refer to the Fix Version/s field or saved filters. Each filter list has its own searching categories. You can also Switch to JQL mode and filter these issues using the JQL query. The selected filter is automatically saved for each user and stored between login sessions.

Note

Each category is displayed in the filter list in the Basic mode when at least one value matches that category.

Note

All options selected in one particular filter are logically summed using the OR operator. The contents of the report are filtered based on the logical conjunction, meaning the AND operator of all filters like so: (all selected options with OR operator from filter 1) AND (all selected options with OR operator from filter 2) AND (all selected options with OR operator from filter 3)…

Test Plan filtering

The Test Plans filter limits the list of Test Cases to those present in the Test Plans that meet the criteria from the Test Plans filter. You can filter the Test Plans by selecting the appropriate filter value from the list in the Basic mode or use a JQL query in the JQL mode.

To search specific value in the Basic mode select it from the list or enter a phrase in the search bar. To remove a value from filtering, click the cross next to the unwanted value or deselect it from the list. To use a JQL query switch to the JQL mode and enter the phrase you want to search.

Note

You can switch to the Basic mode when the JQL query only contains fixVersion or filter. It also cannot contain AND and OR logical operators.

Basic mode contains:

Category: filter Description
Fix version is assigned Filters all Test Plans that have a value set in the Fix Version/s field.
No fix version is assigned Filters all Test Plans that don’t have a value set in the Fix Version/s field.
Unreleased versions In this category, you can filter the Test Plans with a given version set in the Fix Version/s field. The category lists only unreleased versions.
Released versions In this category, you can filter the Test Plans with a given version set in the Fix Version/s field. The category lists only the released versions.
Own & favourite Jira filters In this category, you can filter Test Plans using defined filters in the Issue Navigator. In the list of filters, you will see only the filters you created and your favorites. You can search for shared filters by other users by typing the name in the search bar.

Requirements for Test Plans filtering

The Requirements for Test Plans filter causes the report to show only those Test Plans, for which the requirements match the criteria in from the filter. Effectively, only the Test Cases present in the matching Test Plans are shown as well. You can filter the Requirements by selecting the appropriate filter value from the list in the Basic mode or use a JQL query in the JQL mode.

To search specific value in the Basic mode select it from the list or enter a phrase in the search bar. To remove a value from filtering, click the cross next to the unwanted value or deselect it from the list. To use a JQL query switch to the JQL mode and enter the phrase you want to search.

Note

You can switch to the Basic mode when the JQL query only contains fixVersion or filter. It also cannot contain AND and OR logical operators.

Basic mode contains:

Category: filter Description
Fix version is assigned Filters all Requirements from Test Plans that have a value set in the Fix Version/s field.
No fix version is assigned Filters all Requirements from Test Plans that don’t have a value set in the Fix Version/s field.
Unreleased versions In this category, you can filter the Requirements from Test Plans with a given version set in the Fix Version/s field. The category lists only unreleased versions.
Released versions In this category, you can filter the Requirements from Test Plans with a given version set in the Fix Version/s field. The category lists only the released versions.
Own & favourite Jira filters In this category, you can filter Requirements from Test Plans using defined filters in the Issue Navigator. In the list of filters, you will see only the filters you created and your favorites. You can search for shared filters by other users by typing the name in the search bar.
Warning

When a requirement is not defined in the Requirements tab in the Project Settings then the Requirements for Test Plans filter will not include filtering by versions. This is due to a lack of information from which project the requirement versions are to be taken.

Test Cases filtering

The Test Cases filter limits the list of Test Cases to the ones that meet the criteria from this filter. You can filter the Test Cases by selecting the appropriate filter value from the list in the Basic mode or use a JQL query in the JQL mode.

To search specific value in the Basic mode select it from the list or enter a phrase in the search bar. To remove a value from filtering, click the cross next to the unwanted value or deselect it from the list. To use a JQL query switch to the JQL mode and enter the phrase you want to search.

Note

You can switch to the Basic mode when the JQL query only contains fixVersion or filter. It also cannot contain AND and OR logical operators.

Basic mode contains:

Category: filter Description
Fix version is assigned Filters all Test Cases that have a value set in the Fix Version/s field.
No fix version is assigned Filters all Test Cases that don’t have a value set in the Fix Version/s field.
Unreleased versions In this category, you can filter Test Cases with a given version set in the Fix Version/s field. The category lists only unreleased versions.
Released versions In this category, you can filter Test Cases with a given version set in the Fix Version/s field. The category lists only the released versions.
Own & favourite Jira filters In this category, you can filter Test Cases using defined filters in the Issue Navigator. In the list of filters, you will see only the filters you created and your favorites. You can search for shared filters by other users by typing the name in the search bar.

Requirements for Test Cases

The Requirements for Test Cases filter limits the Test Cases to those where any of the requirements in the Requirement field on a Test Case is in the list of requirements from the filter. You can filter the Requirements by selecting the appropriate filter value from the list in the Basic mode or use a JQL query in the JQL mode.

To search specific value in the Basic mode select it from the list or enter a phrase in the search bar. To remove a value from filtering, click the cross next to the unwanted value or deselect it from the list. To use a JQL query switch to the JQL mode and enter the phrase you want to search.

Note

You can switch to the Basic mode when the JQL query only contains fixVersion or filter. It also cannot contain AND and OR logical operators.

Basic mode contains:

Category: filter Description
Fix version is assigned Filters all Requirements from Test Cases that have a value set in the Fix Version/s field.
No fix version is assigned Filters all Requirements from Test Cases that don’t have a value set in the Fix Version/s field.
Unreleased versions In this category, you can filter the Requirements from Test Cases with a given version set in the Fix Version/s field. The category lists only unreleased versions.
Released versions In this category, you can filter the Requirements from Test Cases with a given version set in the Fix Version/s field. The category lists only the released versions.
Own & favourite Jira filters In this category, you can filter Requirements from Test Cases using defined filters in the Issue Navigator.In the list of filters, you will see only the filters you created and your favorites. You can search for shared filters by other users by typing the name in the search bar.
Warning

When a requirement is not defined in the Requirements tab in the Project Settings then the Requirements for Test Cases filter will not include filtering by versions. This is due to a lack of information from which project the requirement versions are to be taken.

Report based on Test Case status

To check the progress of Test Plan execution based on Test Case status select the Test Case status in the Report based on option.

Report with TestFLO Jira Test Management
Test Plan Execution Report based on Test Case status

Summary and Test Case execution progress

Report with TestFLO Jira Test Management
  1. Summary section displays information about the number of Test Plans, Test Cases, and their execution statuses. You can check the results of each category in the Issue Navigator by click on a certain category tile.
  2. Test Case execution progress section shows the percentage progress of Test Cases execution.

Test Cases list

Reports TestFLO Jira Test Management
Report based on Test Case status

The Test Cases list has the following columns:

  1. Test Plan. You can sort (ASC, DESC) listed Test Plans using arrows next to the column header. The listed Test Plan keys are clickable and take you to the given Test Plan.
  2. Test Case key. You can sort (ASC, DESC) listed Test Cases using arrows next to the column header. The listed Test Cases keys are clickable and take you to the given Test Case.
  3. Summary. Summary of given Test Case.
  4. Status. Status of given Test Case.
  5. Requirements (TC). Requirement from the Test Case. The listed Requirements keys are clickable and take you to the given Requirement.
  6. Defects. Created Defects from Test Case. Under each number displayed in the Defects column, you can check the list of Defects. Click on the number to see the Defects list preview. The listed Defects keys are clickable and take you to the given Defect.

Report based on steps progress

To check the progress of Test Plan execution based on Test Case steps progress select the Test Case steps progress in the Report based on option.

Report with TestFLO Jira Test Management
Test Plan Execution Report based on Test Case steps progress

Summary and Steps execution progress

Report with TestFLO Jira Test Management
  1. Summary section displays information about the number of Test Plans, Test Cases, Steps in total, and Steps in each status. You can check the results of the Test Plan and Test Cases category in the Issue Navigator by click on a certain category tile.
  2. Steps execution progress section shows the percentage progress based on Steps statuses.

Test Cases list

Reports TestFLO Jira Test Management
Report based on Test Case steps progress

The Test Cases list has the following columns:

  1. Test Plan. You can sort (ASC, DESC) listed Test Plans using arrows next to the column header. The listed Test Plan keys are clickable and take you to the given Test Plan.
  2. Test Case key. You can sort (ASC, DESC) listed Test Cases using arrows next to the column header. The listed Test Cases keys are clickable and take you to the given Test Case.
  3. Summary. Summary of given Test Case.
  4. Status. Status of given Test Case.
  5. Steps progress. Progress of Steps for given Test Case.
  6. Executed steps. The number of executed Steps to all Steps in the Test Case.
  7. Requirements (TC). Requirement from the Test Case. The listed Requirements keys are clickable and take you to the given Requirement.
  8. Defects. Created Defects from Test Case. Under each number displayed in the Defects column you can check the list of Defects. Click on the number to see the Defects list preview. The listed Defects keys are clickable and take you to the given Defect.

Copy filters to clipboard

If you want to share a detailed view of the report with all set filters to another user, use the Copy filters to clipboard button. This button will copy the URL of the report to the clipboard, which you can then pass on.

Export to PDF

The Test Plan Execution Report can be exported to a PDF file. To export the report, use the Export to PDF option in the upper right corner of the report view.

Example

Example of exported Test Plan Execution Report based on Test Case status to pdf file - test-plan-execution-report-based-on-test-case-status.pdf

Need help?

If you can’t find the answer you need in our documentation, raise a support request*.

*Include as much information as possible to help our support team resolve your issue faster.