Engineering Efficiency

For the first time, DORA offers a well-recognized way to objectify engineering stability & throughput

The book Accelerate by Nicole Forsgren, Jez Humble & Gene Kim provides a de-facto standard on how to measure development efficiency, supported by clear scientific findings. It identifies four key metrics that support software delivery performance, namely:

  • Lead Time - how long does it take to go from code committed to code successfully running in production
  • Deployment Frequency - how often your software team deploy changes to production
  • Mean Time to Restore (MTTR) - how long it takes to resolve or rollback an error in production
  • Change Fail Percentage - what percentage of changes to production (software releases and configuration changes) fail

By balancing tempo (Lead Time, Deployment Frequency) with stability metrics, it is ensured that increased speed does not result in suffering quality.


Don't let top-down KPIs ruin your engineering culture

KPIs are often related to control. Yet, you can only optimize what you can measure.


How VSM can help

VSM supports both out-of-the-box DORA calculation as well as flexible Metrics capabilities to store all different kind of KPIs

What's in there for me?

As a member of a product team: Get best-practice engineering KPIs to drive your quest towards maturity.

As a product leader: Objectify your engineering throughput & stability.

As an engineering leader: Identify, prioritize, track and communicate efficiency issues based on real-time metrics sourced from diverse software development tools.



As an Enterprise Architect, you are for sure eventually interested in DORA as well. This functionality is planned but not yet present. Get in touch to discuss details.

How do I get there?



The out-of-the box DORA calculation is under active development - Get in touch to learn more. Below, please find ideas to gather the data manually

Metrics provides a powerful way to store time-related information and evaluate them from different contexts, e.g. dashboards. They can be filled very intuitively using the Integration API with the inboundMetrics processor.

Lead Time

Lead Time can be typically obtained from a tool like JIRA. On ticket or story level, it captures information on the starting time (typically a transition from READY into IN WORK) and when it has been finished. After mapping your JIRA project to the Team or Software Artifact Fact Sheet (see Data Model), the difference can be easily calculated and store in Metrics.

Deployment Frequency

Deployment Frequency can be measured with help of the out-of-the-box CI/CD integration. Every deployment just increases the counter for the specific microservices, making a Deployment Frequency dashboard a quick win when implementing VSM.

Mean Time to Restore (MTTR)

The ideal end-to-end way to obtain MTTR KPIs is from a support system like Zendesk. With its help, major bugs observed by the customers can be tracked from initial reporting to complete resolution. Obviously, this requires a consistent mapping of microservices or product areas into the support system. Alternatively, recovery data can be fetched from systems like JIRA as well.

Change Fail Percentage

The simplest way to measure Change Fail Percentage is to look into your CI/CD builds, reporting on how often a build succeeds or fails. More sophisticated, if you capture information on regression in your support or ticketing system, it can be measured how often you are introducing a bug into production (even if the build succeeds).

Did this page help you?