Straightforward Metrics for Software Engineering Ops

Don’t get lost among a myriad of charts and numbers.

Engineering Ops starts with the right metrics. SourceLevel provides essential and actionable metrics for engineering leaders.


Examples of Metrics for Engineering Ops

Opened Pull Requests

Opened PRs is the number of Pull Requests opened in the selected period.

Time to First Engagement

Time to First Engagement is the time elapsed between opening a Pull Request and its first engagement (comment or review). It considers only Pull Requests closed or merged in the selected period.

Time to Discuss

Time to Discuss is the time elapsed from the first engagement (comment or review) to the last one. It considers only Pull Requests closed or merged in the selected period and ignores comments and reviews performed by the Pull Request’s author.

Engaged Pull Requests

Engaged PRs is the number of Pull Requests that received at least one comment or review by someone other than the author in the selected period.

Time to First Review

Time to First Review is the time elapsed between opening a Pull Request and its first review (approve or request change). It considers only Pull Requests closed or merged in the selected period.

Time from Last Engagement to Close

Time from Last Engagement to Close is the time elapsed from the last engagement (comment or review) to its closing. It considers only Pull Requests closed in the selected period and ignores merged ones.

Time to Close

Time to Close is the time elapsed between opening a Pull Request and closing it. It considers only Pull Requests closed in the selected period.

Reviewed Pull Requests

Reviewed PRs is the number of Pull Requests that received at least one review (approve or request change) from someone other than the author in the selected period.

Closed Pull Requests

Closed PRs is the number of Pull Requests closed in the selected period. It doesn’t include Merged PRs.

Time to Merge

Time to Merge is the time elapsed between opening a Pull Request and merging it. It considers only Pull Requests merged in the period and ignores closed ones.

Merged Pull Requests

Merged PRs is the number of Pull Requests merged in the selected period. It doesn’t include merely closed Pull Requests.

Time from Last Review to Merge

Time from Last Review to Merge is the time elapsed from the last review (approve or request change) to its merge. It considers only Pull Requests closed in the selected period and ignores closed ones.

Approvals

Approves is the sum of approves given in the selected period.

Request Changes

Request Changes is the sum of request changes given in the selected period.

Added Lines of Code per Pull Request

Added Lines of Code per Pull Request is the 75th percentile of LOCs added in the Pull Requests of the selected period.

Comments

Comments is the number of comments (including inline comments) published in the selected period.

Commits per Pull Request

Commits per PR is the 75th percentile of commits in the Pull Requests of the selected period.

Removed Lines of Code per Pull Request

Removed Lines of Code per Pull Request is the 75th percentile of LOCs removed in the Pull Requests of the selected period.

Total Changed Lines of Code per Pull Request

Total Changed Lines of Code per Pull Request is the 75th percentile of LOCs changed in the Pull Requests of the selected period.

Reviews per Pull Request

Reviews per PR is the 75th percentile of reviews (approve or request change) in the Pull Requests of the selected period.

Comments per Pull Request

Comments per Pull Request is the 75th percentile of comments (including inline comments) in the Pull Requests of the selected period.

Frequently Asked Questions

Why doesn’t SourceLevel measure averages?

SourceLevel prefers using percentiles instead of averages because averages hide too much information when working with metrics that vary too much, such as velocity.

What do 75th and 95th percentile mean?

Let’s see an example to understand better what they mean. If your organization’s Time to Merge is 14 hours, it means that 75% of all Pull Requests merged in the period was merged up to 14 hours.

The same applies to the 95th percentile. So whatever the metric is, the 95th percentile means that 95% of all analyzed data are below that number.

Why does SourceLevel use 75th and 95th percentiles?

The 75th percentile gives more visibility to the engineering team. It’s a great compromise between optimistic and realistic views. It’s become almost an standard for anyone using metrics for process flow.

The 95th percentile shows an even bigger picture of the teamwork, excluding the 5% that can be considered outliers.