The Prevent Defect Leakage dashboard enables you to identify and prevent defects leaking onto your production systems. The cost of addressing defects increases with time and addressing and eliminating them early in the early stages increases efficiency of the product delivered. This dashboard is meant for analyzing primary defects only.
Using this dashboard, Engineering Managers can look into their projects and analyze their pre-production defect backlog and have the high-priority and medium-priority defects addressed at the earliest. The dashboard also helps Business Unit Heads review defect backlog across all their projects. This dashboard also helps to ensure that critical defects do not leak into production.
As a business stakeholder, you can find answers to some of the key business scenarios such as:
The Prevent Defect Leakage dashboard displays data in five separate tabs. Each tab provides detailed information about defects identified by the system. The five tabs are:
You can use the filter in the dashboard to analyze information related to specific Engineering Managers (up to three levels by default).
The Overview chapter gives you insights into the overall defect projection. The KPI displayed on the tab is the average of Defect Removal Efficiency %, Reopen Defect %, Defect Prevention %, and Defect Backlog %. The Overview chapter has the following distinct panels:
Recommendations: This panel on top of the dashboard gives recommendations on Projects where there is an opportunity to reduce defect leakage.
Defect Projection: This panel displays a list of projects with defect related metrics to help understand the overall status, such as Defect Removal Efficiency %, all currently open defects, Average Defect Growth%, number of defects reopened, and Opportunity Rank.
Defect Removal Efficiency% helps you understand the number of primary defects fixed versus number of defects reported, in the current month and completed 6 months. The Avg Defect Growth% metric helps you understand the % growth of defects in the last 3 months in comparison with 3 months before that. Opportunity Rank is a metric that helps you understand which project needs to be addressed on priority to improve the overall defect removal efficiency and is calculated by ranking each metric across a project or Engg manager; the ranks are then summed to derive the opportunity rank. A lower rank signifies scope for improvement.
You can choose to view data in this grid based on Projects or Engineering Manager by clicking the required tab within this panel.
The Defect Removal Efficiency %, Open Defects, and Avg Defect Growth % metrics are color coded for easy understanding:
For Defect Removal Efficiency %:
For Avg Defect Growth%:
For Open Defects:
Impact of Defect Removal Efficiency on Flow: This panel displays a bubble graph to help you analyze the impact defect removal efficiency on the project. Lead time is plotted against Defect Removal Efficiency % to display this data. The size of the bubble indicates the number of defects reported. The bigger the bubble is, defects reported are more and hence, the project needs more attention.
Time Spent: The Time Spent dashboard is primarily meant for analyzing time spent on primary defects. This panel displays a bar graph for time spent on new feature (based on primary requirement) development versus defect fixing, month wise. Data is displayed for the current month and completed 6 months. Refer to the legend on the user interface to know more on what the bar color indicates. Hover over the bar to view tool tip detailing the project metrics such as Total Time Spent on the Project (by Engineering Manager), Number of Primary Defects, and Number of Primary Requirements (new features) in the project (by Engineering Manager).
This tab gives you specific details about the defect removal efficiency metrics. The KPI on the tab is an average of Defect Removal Efficiency % across all projects. The Defect Removal Efficiency % chapter has the following distinct panels:
Recommendations: This panel on top of the dashboard gives recommendations on the top three projects that can be looked at for reducing Defect Removal Efficiency %.
Defect Projection by Project: This panel lists out all projects with their Defect Removal Efficiency %, Number of Defects Reported, Number of Defects Escaped, and Opportunity Rank.
You can tab across to the Engineering Manager tab within this table to view these metrics for Engineering Managers.
The Defect Removal Efficiency % is color coded for easy understanding:
Defect Leakage Trend: This panel displays the leakage of defects from one month to the next. The metrics used are Defects Escaped, Defects Closed Pre-Prod, and Defects Reported Pre-Prod. Data is displayed for the current month and completed 6 months.
Impact of Defect Removal Efficiency on Flow: This panel displays a combo graph to help you analyze the impact of defect removal on the project. Work Item Spillover % for Requirement Work Items is plotted against defect removal efficiency to display this data. The size here indicates Avg Defect Priority. Hover over the graph for tool tip to view the number of defects reported.
Defect Details: This panel displays a list of defects with specific details such as defect ID, defect type, short description about the defect, and flag to indicate if the defect is a production defect.
The Reopen Defect % tab provides information about primary defects (Primary Defect Work Item type) that are reopened in the current month and in the last six months and enables you to analyze the reopened defects from a project or manager level. You can view the trend of reopened defects and understand their impact on the Project and Iterations.
The Reopen Defect % chapter provides the following sections:
You can click a particular project, manager, or value in the grid to drill down and view only relevant data in the subsequent panels.
This tab gives you specific details about defect prevention in projects. The KPI on the tab is an average of Defect Growth % across all projects. The Defect Prevention chapter has the following distinct panels:
Recommendations: This panel on top of the dashboard displays the top three projects where the average defect growth percentage is high.
Defect Projection by Project: This panel lists out projects with their defect related metrics. The metrics displayed are defects reported in the current month, total number of defects in the past 3 months, prior 3 months, and defect projection for next 3 months. It also displays Average Defect Growth %, and opportunity rank for projects.
You can tab across to the Engineering Manager tab within this table to view these metrics for Engineering Managers.
The Avg Defect Growth % metric is color coded for easy understanding:
Defect Analysis: This panel is to help you analyze the defects based on keywords used. Words that have higher occurrence in the 'Description' fields are displayed with larger text size. You can gain insights into components that have repeatedly featured in the defect description.
Impact of Defect Growth on Flow (Completed 6 Months): This panel displays a bubble chart to help you analyze the impact of defect growth on the project. Lead time is plotted against average number of defects reported in a month to display this data. The size of the bubble indicates the Defects Removal Efficiency %.
Defect Details: This panel displays a list of defects with specific details about defects such as defect ID, defect type, root cause of the defect, reason for closing the defect, and a short description about the defect.
This tab gives you specific details about the defect backlog. The KPI displayed on the tab is an average of open defects till date against defects reported in current month and last 6 months. This chapter has the following distinct panels:
Recommendations: This panel on top of the dashboard displays the top three projects with higher number of open defects.
Defect Projection by Project: This panel lists projects along with specific defect related metrics. The metrics displayed are number of open defects, average age of corresponding open defects, percentage to total number (of number of open defects), and opportunity rank for projects.
You can tab across to the Engineering Manager tab within this table to view these metrics for Engineering Managers.
The Percent to Total (Open Defects) metric is color coded for easy understanding:
Opportunity Rank is a metric that helps you understand which project needs to be addressed on priority to improve the overall defect removal efficiency. Higher the opportunity rank, greater are the chances of increasing quality by working towards defect reduction.
Defect by Labels: This panel displays a heat map to help you analyze the defects based on the label. Hover over the heat map to display tool tip with details about the defect label, number of defects with that particular label, and average open defect priority. Color intensity of the block defines the average priority of defects tagged to the label.
Defect Resolution Trend: This panel displays a bar graph to help you analyze the trend in defect resolution, month wise. Refer to the legend on the user interface to know more on defects added, defects closed, and the defect backlog. Data is displayed for the current month and completed 6 months.
Defect Details: This panel displays a list with specific details about defects such as defect ID, defect type, defect priority, defect age, and a short description about the defect.
Here is a list of all the metrics used in this dashboard:
| Metric | Description |
|---|---|
| Overview | Indicator to denote the overall defect prevention percentage |
| Prevent Defect Leakage - Overview - Opportunity Rank | Rank that indicates the project or value stream that needs the most attention in terms of Defect Leakage prevention |
| Defect Removal Efficiency % | The number of fixed primary defects over the last 7 months relative to the total number of primary defects reported over the last 7 months |
| Defect Growth % | Growth percentage of defects in the last 3 completed months as compared to the last to last 3 months |
| Defects Reopened | Total number of primary defects that are reopened |
| Open Defects | Total number of primary defects that are open |
| Lead Time | Time difference between defect start date and defect created date |
| Defects Reported | Total number of primary defects reported over the last 7 months |
| Time Spent on Primary Work Items | Total time spent (in days) on creating new capabilities |
| Time Spent on Defects | Total time spent on defects |
| Total Time Spent (Days) | Total time spent on all work items (in days) |
| Count of Requirement Work Items | Number of new capabilities related work items, based on the last logged on time |
| Count of Primary Defects | Number of primary defects reported based on the last logged on time |
| Defects Escaped | Total number of defects that were identified in production after deployment |
| Defects Pre-Prod Closed | Total number of primary defects that are resolved before deployment to production |
| Spill Over % | Percentage of work items that have spilled over to the next version of the project |
| Avg Defect Priority | Average priority of all defects |
| Reopen Defect % | Percentage of defects that are reopened as compared to fixed defects |
| Reopened Primary Defects Growth % | Growth percentage of reopened primary defects in the last 90 days as compared to prior to last 90 days |
| Committed Count | Count of story points committed at the beginning of the project |
| Committed vs Delivered % | Percentage of work items that were committed for completion as compared to work items that were completed |
| Reopened Primary Defects Time Spent (Hours) | Time (in hours) spent in working on reopened primary defects |
| Defects Reported - Current Month | The number of defects reported in the current month |
| Defects Reported - Past 3 Months | The number of primary defects with lagging count of months between 1 and 3 |
| Defects Reported - Prior 3 Months | The number of primary defects with lagging count of months between 4 and 6 |
| Projected Defects - Next 3 Months | The projected number of primary defects for the next three months, which is product of average primary defects in the last 3 month and the defect growth % |
| Defect Keyword Occurrence | Count of keyword occurrence in the Defect Description |
| Avg Monthly Defects Reported | The number of defects created over the duration (6 months) |
| Avg Defect Age | Average of age of all defects |
| Percent to Total (Open Defects) | Count of open Primary defects as compared to the rest of company |
| Defect Backlog - Opportunity Rank | Rank that indicates the project or value stream that needs the most attention in terms of Open Primary Defect in the backlog |
| Avg Open Defect Priority | Weighted average of the priority of all Unresolved primary defects |
| Added Defects | Work Items newly reported in the current period |
| Defect Backlog | Number of defects in the backlog |
| Closed Defects | Count of all closed defects |
| Defect Age | Age of the defect (from the time created to current date) |
© 2022 Digital.ai Inc. All rights reserved.