HOW TO

MEASURE DEVOPS
PERFORMANCE
TO INCREASE ENTERPRISE AGILITY
HOW TO MEASURE DEVOPS PERFORMANCE
WHY SHOULD YOU
MEASURE DEVOPS
PERFORMANCE?
Measuring DevOps performance is essential
to improving overall enterprise agility. Your
velocity is constrained to your most constricted
bottleneck. In many enterprise organizations,
the planning and development phases have
been significantly optimized, leaving the
delivery phase as the greatest opportunity for
further optimization.
Measuring DevOps performance provides
highly precise feedback describing the flow
of business value in the form of new software
features. Understanding precisely how your
DevOps value streams perform helps identify
the bottlenecks and wait-states that slow the
flow of new software between developers and
end users.
WWW.VERSIONONE.COM
Deploying new software quickly can be
technically achieved with relative ease. However,
delivering faster is not the only goal of DevOps.
As you increase delivery speed, youll need to
continuously evaluate and monitor delivery risk,
software quality, and process compliance.
Measuring DevOps performance helps you
better prioritize opportunities and quantify
performance results with each incremental
investment in automation or process redesign.
This is how you get Continuous Delivery with
confidence and continuous confidence requires
continuous measurement.
1
HOW TO MEASURE DEVOPS PERFORMANCE

1
ACCELERATE
DELIVERY 95% of time business value
spends in delivery is in a
Identify and remove bottlenecks,

4
wait state.
reducing the time software spends
waiting in delivery phases.

2
REDUCE
0.1% of source code
generates over 50% of the
RISK
business risk. Detect potential deployment risks
before they cause your initiative
to fail or be delayed.

Benefits of
3
INCREASE
MEASURING QUALITY Defects are twice as
expensive to fix when
detected during downstream

DEVOPS
Discover defects earlier and determine delivery and ten times as
the root cause of the defect faster, expensive to fix
reducing the cost of repair and post-production.

PERFORMANCE
increasing the quality of the software
you are delivering.

///////////////////////////////////////////////////////////////////////////////////////////////////

Practicing real-time
compliance cuts days,
weeks, and sometimes
months from each
deployment cycle.
4
IMPROVE
COMPLIANCE
Document adherence to process
controls as the software is going
through the actual step, greatly
reducing the cost, time, and rework
associated with traditional, late-
stage compliance audits.

WWW.VERSIONONE.COM 2
HOW TO MEASURE DEVOPS PERFORMANCE

What is
MEASURING
DEVOPS
PERFORMANCE
Measuring DevOps performance
is the practice of evaluating the
execution of DevOps in context of
your software organizations entire
value stream.
STRATEGY &
DEVELOPMENT DELIVERY
The foundational element of
measuring DevOps performance is
WORK ITEMS OUTPUTS
tracing delivery outputs to the agile
strategy and development work Initiatives Builds
items they are associated with to
enable you to measure the delivery Epics Artifacts
velocity, deployment risk, release
quality, and process compliance Features Packages
of the business value you are
delivering to customers. Stories Releases
Defects Deployments

WWW.VERSIONONE.COM 3
HOW TO MEASURE DEVOPS PERFORMANCE

WHAT IS A
VALUE STREAM?
A value stream is all of the steps required to create and deliver something of value, such as a feature
or product. Your value stream starts at ideation, continues through development as value is created,
and ends when the feature, product, or service has been delivered to your customers.

WHAT IS A FRAGMENTED WHAT IS A UNIFIED

VALUE STREAM?
Most enterprise organizations value streams are fragmented
into three main phases: strategy, development, and delivery. In a
fragmented value stream, each phase evolves into its own teams,
processes, tools, and information that are not fully integrated with the
rest of the value stream, resulting in lower enterprise agility.
VALUE STREAM?
To improve DevOps and enterprise agility to their full potential, you
must integrate all the people, process, tools, and information across
the organization into a unified value stream, providing stakeholders
across all phases with the information and management insight
needed to make better decisions.

WWW.VERSIONONE.COM 4
HOW TO MEASURE DEVOPS PERFORMANCE

4 MEASURES OF
DEVOPS VELOCITY
Measuring your delivery
How value flows thru
a value stream map

velocity helps you

identify your biggest Wait-time at
each step
bottlenecks, alleviate
those bottlenecks,
Cumulative value
and ensure that value in each deployment event
is moving at peak
efficiency. Time elapsed
between deployments

WWW.VERSIONONE.COM 5
HOW TO MEASURE DEVOPS PERFORMANCE

3 MEASURES OF
DEVOPS RISK
Measuring delivery
risk helps you avoid Fragility of new code

unanticipated delays,
highlight riskier
Backlog item dependencies
deployments, and keep
from releasing anything
into production before Change set complexity

it is complete.

WWW.VERSIONONE.COM 6
HOW TO MEASURE DEVOPS PERFORMANCE

3 MEASURES OF
DEVOPS QUALITY
Measuring delivery
Time elapsed between
quality helps you detect commit and issue discovery
defects before they
are released, reduce
Frequency of broken builds
the cost of repair, and
increase the quality
Ratio of manual and
of software being automated tests
delivered.

WWW.VERSIONONE.COM 7
HOW TO MEASURE DEVOPS PERFORMANCE

4 MEASURES OF
DEVOPS COMPLIANCE
Process compliance for each
step of a value stream map

Measuring delivery
compliance helps you Control pass/fail events at
each stage of delivery
increase the efficiency
of compliance, decrease Step by step audit trail
rework, and reduce for each backlog item

costs.
Inventory of business value
in each release event

WWW.VERSIONONE.COM 8
 HOW TO MEASURE DEVOPS PERFORMANCE

VERSIONONE CONTINUUM MEASURES

START
////////////////////////////////////////////////////////////////////////////////////////

MEASURING
DEVOPS
PERFORMANCE
WITH VERSIONONE DELIVERY VELOCITY DEPLOYMENT RISK
CONTINUUM
VersionOne Continuum is an enterprise
continuous delivery solution for
accelerating the velocity, reducing the
risk, improving the compliance, and
ensuring the quality of each software
deployment.

RELEASE QUALITY PROCESS COMPLIANCE

WWW.VERSIONONE.COM 9
HOW TO MEASURE DEVOPS PERFORMANCE

See how
VersionOne
Continuum helps you
measure DevOps
performance and track
business value from
the first commit
through production
deployment.

SEE IT IN ACTION

Copyright 2017. All rights reserved.

VersionOne is a registered trademark of VersionOne Inc.
01-2017