The Increase Flow with Automation dashboard enables you to identify automation opportunities in your project. This could be about looking into current automation percentage in each of your build, test, and deploy projects; and identifying areas where investing in automation can accelerate flow.
Using this dashboard, IT Managers can look into their projects and analyze what percentage of routine tasks have been automated. The dashboard displays opportunity rank which helps you in zeroing on the projects where automation is lagging. The higher the opportunity rank, greater is the opportunity to accelerate flow by increasing automation.
As a business stakeholder, you can find answers to some of the key business scenarios such as:
The Increase Flow with Automation dashboard displays data in four separate tabs. Each tab provides detailed information about one particular category of automation possibilities. The four tabs are:
You can use the filter in the dashboard to analyze information related to specific Projects or Engineering Managers. The dashboard supports hierarchy in case of filtering results based on Engineering Managers (up to three levels by default).
This tab gives you insights into the overall automation opportunities by project.
Recommendations: This panel on top of the dashboard gives recommendations on Projects that have to be prioritized for automation.
Automation Opportunities By Project:This panel table lists Projects along with its specific metrics such as Test Automation%, Build Automation %, Deploy Automation%, Overall Automation%, and Opportunity Rank.
By Engineering Manager: You can tab across to the Engineering Manager section to view the above metrics based on the Engineering Manager selected.
The data in this table feeds data into the rest of the dashboard. Selecting a particular project in this table refreshes data in the other panels of the dashboard.
Automation Trend: This panel displays the monthly automation trend for build, test, and deploy areas. Data is displayed for the completed 4 months. Hover over the color legends in the graph to view more details about the automation metrics.
Automation Impact on Flow: This panel displays bubble graphs to help you analyze the impact of automation on the overall project flow with respect to average number of deployments completed and lead times between commit to deploy.
Each bubble in the graph corresponds to a Project and the position of the bubbles (closer to the origin) indicate opportunities to improve frequent deployments, shorter lead times between commit and deploy, and increase overall automation. You can hover over each bubble to get specific details.
This tab gives you insights into the build automation opportunities by project.
Recommendations: This panel on top of the dashboard gives recommendations on Projects that have to be prioritized for build automation.
Build Automation Opportunities By Project: This panel displays a list of projects along with the build automation %, build success %, automated build count trend, along with the opportunity rank.
By Engineering Manager: You can tab across to the Engineering Manager section to view the above metrics based on the Engineering Manager selected.
The data in this table feeds data into the rest of the dashboard. Selecting a particular project in this table refreshes data in the other panels of the dashboard.
Build Automation Impact on Flow: This panel displays bubble graphs to help you analyze the impact of automation on the build flow with respect to average number of deployments completed, lead times between commit to deploy, and success of builds.
Each bubble in the graph corresponds to a Project and the position of the bubbles (closer to the origin) indicate opportunities to improve frequent deployments, shorter lead times between commit and deploy, build success rate, and increase build automation. You can hover over each bubble to get specific details.
Build Count vs Automated Trend: In this panel, you can look into the monthly trend of build count plotted with automation percentage. This panel displays the trend for the completed four months.
Build Automation Details: In this panel, you can also drill down into specific jobs with their build automation %, build success %, and automated build count trend.
This tab gives you insights into the test automation opportunities. The panel displays information in the following distinct panels:
Recommendations: This panel on top of the dashboard gives recommendations on Projects that have to be prioritized for test automation.
Test Automation Opportunities By Project: This panel table lists Projects along with its specific metrics such as Test Automation%, Test Pass%, Automated Test% Change, and Opportunity Rank.
By Engineering Manager: You can tab across to the Engineering Manager section to view the above metrics based on the Engineering Manager selected.
The data in this table feeds data into the rest of the dashboard. Selecting a particular project in this table refreshes data in the Test Automation Impact On Flow, Test Execution Count vs Automation Trend and Test Execution Details panels.
Test Automation Impact on Flow: This panel displays bubble graphs to help you analyze the impact of automation on the test flow with respect to average number of deployments completed, lead times between commit to deploy, and pass percentage of test executions.
Each bubble in the graph corresponds to a Project and the position of the bubbles (closer to the origin) indicate opportunities to improve frequent deployments, shorter lead times between commit and deploy, test execution success rate, and to increase test automation. You can hover over each bubble to get specific details.
Test Execution Count vs Automation Trend: This panel displays a combo graph to help you analyze the automation trend in the last 3 months. A bar graph displays the count of test cases and line graph shows the test automation% achieved in the month.
Test Execution Details: This panel displays a list of test cases associated with the project selected in the Test Automation Opportunities panel. The grid displays the Test Case name, End Date of the test case, Type of test case, Current Status of test case and Automated Test Flag to indicate if the test execution is automated or not
This tab gives you insights into the deploy automation opportunities categorized by project.
Recommendations: This panel on top of the dashboard gives recommendations on Projects that have to be prioritized for deployment automation.
Deploy Automation Opportunities By Project: This panel lists projects along with their deploy automation %, deploy success %, and automated deployment change %, and opportunity rank.
By Engineering Manager: You can tab across to the Engineering Manager section to view the above metrics based on the Engineering Manager selected.
The data in this table feeds data into the rest of the dashboard. Selecting a particular project in this table refreshes data in the other panels of the dashboard.
Deploy Automation Impact on Flow: This panel displays bubble graphs to help you analyze the impact of automation on the deployment flow with respect to average number of deployments completed, lead times between commit to deploy, and success of deployments.
Each bubble in the graph corresponds to a Project and the position of the bubbles (closer to the origin) indicate opportunities to improve frequent deployments, shorter lead times between commit and deploy, deployment success rate, and to increase deploy automation. You can hover over each bubble to get specific details.
Deploy Count vs Automation Trend: This panel displays a trend graph gives you insights into the monthly deploy count trend. Data is displayed for the current month along with last completed six months.
Deploy Automation Details: In this panel, you can drill down into specific jobs within the project, along with Automated Deployment Count, Deploy Automation%, Deploy Success %, and Automated Deployment %Change.
| Metrics Used | Description |
|---|---|
| Overall Automation % | Percentage of automation resulted as an average of % Automated Test, % Automated Builds and % Automated Deployments |
| Opportunity Rank - Overall Automation | Rank of overall automation %. Lower rank values indicate greater opportunity to accelerate flow by increasing automation |
| Test Automation % | Percentage of test executions that are automated |
| Build Automation% | Percentage of builds that are automated |
| Deploy Automation % | Total number of deployments that are automated compared to all the deployments |
| Deployment Frequency | Average Monthly Deployments Completed Count |
| Total Deploy | Total number of Deployments |
| Commit-Deploy Lead Time (Days) | Average of Duration between First Commit Date to First Deployment Date of Completed Work Item in Days |
| Opportunity Rank - Build Automation | Combined rank of Build Automation %, Build Success % and Automated Build Count Trend. Lower rank values indicate greater opportunity for accelerating flow by increasing Build Automation. |
| Build Success% | Percentage of builds that are successful |
| Automated Build % Change | Automated Build Growth Trend - Last 90 Days vs prior 90 to 180 Days |
| Total Build | Total number of all builds |
| Automated Build Count | Total number of automated builds |
| Opportunity Rank - Test Automation | Combined Rank of Test Automation %, Test Pass %, and Automated Test % Change. Lower rank values indicate greater opportunity for accelerating flow by increasing Test Automation |
| Test Pass % | Percentage of test executions that are passed, out of total test executions created |
| Automated Test % Change | Percentage of automated test Growth trend in last 90 days vs prior 90 to 180 days |
| Test Count | Total number of Test executions |
| Opportunity Rank | Combined Rank of Deploy Automation %, Deploy Success % and Automated Deploy Count Trend. Lower rank values indicate greater opportunity for accelerating flow by increasing Deploy Automation |
| Deploy Success % | Percentage of deployments that are successful |
| Automated Deployment % Change | Automated Deploy Growth Trend - Last 90 Days vs prior 90 to 180 Days |
| Automated Deployment Count | Total number of deployments that were run automatically |
© 2022 Digital.ai Inc. All rights reserved.