If you perform regression test activities, you would probably need to quickly get an idea of the overall quality for your recent test plan runs. Last Test Plan Run Results by User Story Report can help you to visualize your current quality and plan QA and Development activities timely. The report is intended to be used with Testing Module in Targetprocess.
Test Plans in Targetprocess contain individual Test Cases. During execution of Test Plan Run, each Test Case is set into one of the following statuses: Failed, Passed, Blocked, On hold, Not run. This Visual Report displays the summary of test cases' statuses in the most recent run for every test plan linked to a user story. As a result you get a bar chart. Its horizontal axis shows the count of passed, failed and skipped test cases. Vertical axis list user stories one by one or grouped by projects / releases / iterations (sprints) / features.
The report uses Test Plan Run as a base entity. It calculates summary for all test cases within test plan run. It is not possible to show what exact test cases were passed or failed in this report.
The summary bars show user stories in the selected projects, unless you narrow your data source with special filters.
How to create the Report
Here is how we recommend to configure the report.
Click +Create > Report to start building new Visual report.
Create report from Blank template.
We recommend to use the following Sources settings as initial ones:
- Source type: Entity Reports
- Projects and teams: make required selection
- Entities: Test Plan Runs
Apply Filter for data source. Its purpose is to select just one most recent Test Plan Run per each Test Plan. Syntax of Advanced Filters is used.
?IsLastStarted is True and TestPlan.LinkedUserStory is not None
Press Create report button. Then use the following setup for the chart:
- Vertical axis: Name
- Horizontal axis: all or some of the fields together
- Passed Count
- Failed Count
- Blocked Count
- On Hold Count
- Not Run Count
- Chart Type: Stacked-Bar
Press Finish setup button. Your chart is ready!
Show names of User Stories
The chart is configured to show names of Test Plans on vertical axis. In the meantime sometimes name of a User Story differs from a name of its linked Test Plan and its Test Plan Runs. There are no predefined fields that could show names of user stories or other linked work items for test plan runs. Add the required fields manually. Press Add field or formula button in Data fields list for this purpose:
Add field named User Story Name with the following formula:
And put this field into vertical axis of the chart:
More complex formulas related to different properties of User Stories are also supported.
TestPlan.LinkedUserStory.Feature.Name TestPlan.LinkedUserStory.Feature.Epic.Name TestPlan.LinkedUserStory.Release.Name TestPlan.LinkedUserStory.Iteration.Name TestPlan.LinkedUserStory.TeamIteration.Name TestPlan.LinkedUserStory.Project.Name
In the figure below User Stories and their last test run results are grouped per Feature:
Using Filters for Sources settings, you can narrow the data scope in order to take into account only selected User Stories. Syntax of Advanced Filters is used. The following filters and combinations of them can be useful for this chart:
|Test Plan Run||?IsLastStarted is true and TestPlan.LinkedUserStory is "My Story"||Last run of "My Story" test plan|
|Test Plan Run||?IsLastStarted is true and "Mobile" in TestPlan.LinkedUserStory.Name||Last runs of test plans for user stories that have "Mobile" word in the name|
You can also browse data source and apply filters to data using special interactive wizard in chart settings. Navigate Actions > Set up report menu item, and then press Data Source > Browse and filter button.
Visual Reports and Custom Graphical reports are very flexible in terms of filtering, grouping and customization. If you need to build some other Visual Report, you're welcome to contact our support team and request our assistance.