Dora MetricsDevopsScrum

DORA Metrics: How Scrum Teams Can Use Them to Ship Faster

ScrumPoi · · 11 min read

DORA Metrics: How Scrum Teams Can Use Them to Ship Faster

“Our Velocity Went Up… But Releases Still Suck.”

If your team’s sprint velocity looks great but production is a minefield, your metrics are lying to you.

Scrum boards are clean, burn-downs look pretty, and yet:

  • Releases are stressful
  • Bugs escape into production
  • Stakeholders keep asking, “Why is everything so slow?”

The problem isn’t that your team is bad. The problem is that you’re optimizing for the wrong things.

That’s where DORA metrics come in—not as another vanity dashboard, but as a brutal mirror that shows how fast you actually ship value.


What Are DORA Metrics (And Why Scrum Teams Should Care)?

DORA metrics come from the DevOps Research and Assessment group (now part of Google Cloud). They studied thousands of teams and found four key metrics that predict software delivery performance and organizational outcomes.

The 4 DORA Metrics (No Fluff Version)

  1. Deployment Frequency
    How often you deploy to production (or release to users).

    • High performers: deploy on-demand, often multiple times per day
    • Low performers: monthly or less
  2. Lead Time for Changes
    Time from code committed to code running in production.

    • Elite teams: < 1 day
    • Low performers: > 1 month
  3. Change Failure Rate
    Percentage of deployments that cause a failure (bug, incident, rollback, hotfix).

    • High performers: 0–15%
    • Low performers: 46–60%
  4. Mean Time to Restore (MTTR)
    How long it takes to recover from a failure.

    • High performers: < 1 hour
    • Low performers: > 1 week

Notice what’s missing?

  • Story points
  • Velocity
  • Commit counts
  • “Number of tickets closed”

Those are internal activity metrics. DORA metrics focus on outcomes in production—where your users live.


Why Scrum Teams Need DORA Metrics (Even If You “Just Do Sprints”)

Scrum gives you a cadence (sprints) but says almost nothing about how you deliver software technically.

That gap is where teams get stuck:

  • Work “done” at the end of the sprint but not deployed
  • “Hardening sprints” to stabilize code (aka “we keep breaking prod”)
  • Releases that require all-hands war rooms

DORA metrics expose this disconnect.

Scrum Without DORA: Optimizing the Wrong System

Common pattern:

  • Team proudly reports: “We increased our velocity by 30%!”
  • But:
    • Releases still happen once a month
    • QA is overwhelmed
    • Bugs spike after every release
    • Product can’t safely experiment

You’ve optimized the planning system (Scrum ceremonies) but ignored the delivery system (build, test, deploy, operate).

DORA metrics force you to ask:

  • Are we actually shipping faster?
  • Are we breaking things more often?
  • Are we recovering quickly when we do?

DORA + Scrum: The Real Power Combo

Use Scrum to:

  • Slice work into small increments
  • Inspect and adapt every 1–2 weeks
  • Align on goals and priorities

Use DORA to:

  • Measure how fast those increments reach users
  • Reveal bottlenecks between “Done” and “Deployed”
  • Drive technical and process improvements

Scrum tells you how you think you’re doing.
DORA tells you how you’re actually doing.


How to Apply Each DORA Metric in a Scrum Team

Let’s get tactical. Here’s how to use each metric in your day-to-day Scrum practice.

1. Deployment Frequency: From “Release Day” to “Release Anytime”

What to measure:
How many times per day/week you deploy to production (or release to users).

Scrum smells to watch for:

  • “We deploy at the end of the sprint.”
  • “We batch all completed stories into a single big release.”
  • “We need a release manager on call for every deployment.”

How to improve using Scrum:

  • Change your Definition of Done (DoD)
    Include: “Deployed to production (or at least to a production-like environment).”
  • Slice stories smaller
    If a story can’t be deployed independently, it’s probably too big or too coupled.
  • Decouple deployment from release
    • Use feature flags
    • Deploy code dark, enable features gradually

Concrete sprint experiment:

  • Goal for next sprint: “Increase deployment frequency from 1 per sprint to 2 per week.”
  • Actions:
    • Identify one small feature that can be behind a feature flag
    • Automate its deployment pipeline
    • Do a mid-sprint deployment, not just end-of-sprint

2. Lead Time for Changes: Kill the Waiting, Not the Coding

What to measure:
Time from code committed (or PR opened) to running in production.

Where teams lose time (real-world):

  • PRs waiting days for review
  • Manual regression testing taking a week
  • “Release train” schedules where code waits for the next deployment window
  • Environment contention: “QA environment is busy, we’ll test next week”

How to improve using Scrum:

  • Make lead time a sprint-level metric
    Track average lead time on your board. Discuss it in retro.
  • Limit WIP (Work in Progress)
    Too many stories in progress = context switching, slow reviews.
  • Add explicit policies for PRs
    • Reviews within 24 hours
    • Small PRs (< 300 lines) as a team norm
  • Automate tests that block deployments
    Start by automating the most frequently executed manual tests.

Concrete sprint experiment:

  • For one sprint, enforce:
    • Max 2 items per dev in “In Progress”
    • PRs must be < 300 lines of code
    • At least one pair-programming session per story
  • Measure lead time before and after.

3. Change Failure Rate: Fewer “Oops” Per Deployment

What to measure:
Percentage of deployments that cause:

  • A production incident
  • A rollback
  • A hotfix

Common causes in Scrum teams:

  • “Done” = merged, not actually tested in prod-like conditions
  • QA squeezed into the last 2 days of the sprint
  • No monitoring or weak logging
  • No clear ownership of production issues

How to improve using Scrum:

  • Redefine “Done” to include quality gates
    • Automated tests passed
    • Monitoring/alerts in place for new features
    • Rollback strategy defined
  • Make failures visible in Scrum events
    • Review last sprint’s incidents in Sprint Review
    • In Retro, ask: “Which failures could we have caught earlier?”
  • Shift testing left
    • Developers write or update tests as part of the story
    • QA pairs with devs early, not just at the end

Concrete sprint experiment:

  • For every incident this sprint:
    • Create a small follow-up story to add a test that would have caught it
    • Make it top priority for the next sprint
  • Track: change failure rate over 2–3 sprints.

4. Mean Time to Restore (MTTR): Practice Failing Gracefully

What to measure:
Average time from detecting an incident to restoring service.

Why this matters more than “no incidents”:

  • Zero incidents is a fantasy for any real system.
  • High-performing teams focus on recovering quickly, not pretending they’ll never fail.

Typical MTTR killers:

  • No clear on-call rotation
  • Manual deployment and rollback
  • Logs scattered across systems (or missing)
  • “Who owns this?” confusion during incidents

How to improve using Scrum:

  • Include operational work in the backlog
    • Monitoring improvements
    • Better logging
    • Automated rollbacks
  • Do mini post-mortems in retros
    • What happened?
    • What slowed us down?
    • What’s the smallest change to recover faster next time?
  • Create “operational readiness” checklist for stories
    • Do we know how we’ll know it’s broken?
    • Do we know how to disable/rollback it?

Concrete sprint experiment:

  • Add a sprint goal: “Reduce MTTR by 20%.”
  • Actions:
    • Define on-call rotation and escalation path
    • Create or improve runbooks for top 3 failure scenarios
    • Add one alert per critical service that points to a runbook

Common Mistakes Scrum Teams Make With DORA Metrics

DORA metrics are powerful—and easy to screw up. Avoid these traps.

Mistake 1: Turning DORA Into Individual Performance Metrics

If you start saying:

  • “Alice’s PRs have higher failure rates”
  • “Bob doesn’t deploy often enough”

You’ve missed the point.

DORA metrics are system-level metrics. They reflect:

  • Architecture
  • Tooling
  • Team practices
  • Organizational policies

Use them to improve the system, not to rank people.

Mistake 2: Chasing Numbers Instead of Outcomes

If your goal is “deploy 10 times a day” without asking “why,” you’ll:

  • Ship tiny, meaningless changes
  • Burn out your team
  • Game the metrics

Better framing:

  • “We want to safely validate product ideas faster.”
  • “We want to reduce the cost of each deployment.”

DORA metrics are signals, not goals in isolation.

Mistake 3: Ignoring Context (Not Every Team Needs Elite Numbers)

Not every team needs:

  • 10 deployments per day
  • Sub-hour MTTR

If you’re:

  • In a regulated environment
  • Running a legacy monolith
  • On a small product with low change frequency

You still benefit from DORA—but your targets will differ.
Focus on getting better than you are now, not matching some Silicon Valley benchmark.

Mistake 4: Treating DORA as a DevOps-Only Thing

When DORA is “the DevOps team’s dashboard,” Scrum teams:

  • Keep planning big batches
  • Keep accepting huge, risky stories
  • Don’t change how they work

DORA should be:

  • Reviewed in Sprint Reviews and Retros
  • Visible on the team’s information radiator
  • Part of the Product Owner’s decision-making

If it doesn’t change conversation in Scrum events, it’s just noise.


How to Start Using DORA Metrics in Your Scrum Team (This Month)

You don’t need a fancy analytics platform to get started. You need clarity and consistency.

Step 1: Decide “What Counts” for Each Metric

As a team, define:

  • What is a “deployment”? (Prod only? Also staging?)
  • How do we measure lead time? (First commit? PR opened? Ticket moved to “In Progress”?)
  • What is a “failure”? (Any incident? Only Sev1–2?)
  • When do we start/stop the MTTR clock?

Write it down. Keep it simple. You can refine later.

Step 2: Collect Data for 2–3 Sprints

Start with manual tracking if needed:

  • Add tags or labels in Jira/GitHub
  • Export basic data weekly
  • Track in a simple spreadsheet or dashboard

Don’t obsess over perfect accuracy. You want trends, not court-proof evidence.

Step 3: Bring DORA Into Scrum Events

  • Sprint Planning
    • Use DORA trends to set realistic goals.
    • If MTTR is high, prioritize operational work.
  • Daily Scrum
    • Call out blocked PRs and long-running “In Review” items.
  • Sprint Review
    • Share DORA trends with stakeholders.
    • Discuss how they’re affecting feature delivery.
  • Retrospective
    • Pick one metric to focus on per sprint.
    • Brainstorm one or two small experiments to improve it.

Step 4: Treat Improvements as First-Class Product Work

Don’t treat pipeline, testing, and monitoring as “nice-to-haves when we have time.”

Create explicit backlog items:

  • “Add automated tests for checkout flow”
  • “Reduce average PR size by adding template and guidelines”
  • “Add alerting for payment failures with clear runbook”

Give them clear acceptance criteria, estimate them, and prioritize them like features.

Step 5: Use Lightweight Tools That Don’t Get in Your Way

You don’t need a giant platform to start:

  • CI/CD: GitHub Actions, GitLab CI, CircleCI, etc.
  • Monitoring: Datadog, Prometheus + Grafana, New Relic
  • Planning & retros: lightweight tools that don’t require a 3-week rollout

For example, when you’re running quick planning poker or retro sessions focused on improving lead time or failure rate, a tool like ScrumPoi helps: it supports planning poker and retros, anonymous voting (great for honest discussions about failures), and even integrates with Jira—without per-user costs or forced signups slowing you down.


DORA Metrics Won’t Save You—But They Will Expose the Truth

If your Scrum team is:

  • “Done” on paper but blocked in deployment
  • Shipping features that are too risky to release often
  • Spending more time fixing production than building new value

You don’t need more ceremonies. You need better feedback.

DORA metrics won’t magically fix your process, but they will:

  • Reveal where your system is slow and fragile
  • Give you a shared language across dev, QA, ops, and product
  • Turn vague complaints (“Releases are painful”) into specific problems you can solve

Start small:

  • Define the four metrics for your context
  • Track them for a couple of sprints
  • Pick one metric and run one experiment

Scrum helps you inspect and adapt.
DORA tells you what’s actually worth inspecting.

Keep reading

More on the topics this article touches.