Continuous Improvement is a Lie: Here's What Actually Drives Change

ScrumPoi · · 10 min read

Continuous Improvement is a Lie: Here's What Actually Drives Change

Continuous Improvement Is a Lie: Here’s What Actually Drives Change

We like to talk a lot about continuous improvement in software teams—but the reality often looks very different.

You’ve got:

  • Retrospectives every sprint
  • Action items no one remembers
  • A Jira board full of “improvement” tickets that never get prioritized
  • The same problems resurfacing quarter after quarter

Yet everyone keeps saying, “We believe in continuous improvement.”

Here’s the truth: continuous improvement, as most teams practice it, is a comforting story you tell yourselves so you don’t have to confront real change.

Real change is not continuous, gentle, or easy. It’s lumpy, political, and uncomfortable. And it’s driven by a few very specific forces that most agile books barely talk about.

Let’s unpack what actually moves the needle.


The Myth of Continuous Improvement

The comforting lie teams tell themselves

The phrase “continuous improvement” sounds harmless and positive. Who could be against it? But that’s exactly the problem.

It becomes:

  • Too vague to challenge
  • Too soft to prioritize
  • Too gentle to force trade-offs

You get:

  • Retrospectives that generate lists, not decisions
  • “Improvements” that are really just wish lists
  • A culture where everyone agrees things should get better… later

Meanwhile:

  • Cycle times stay flat
  • Production incidents keep repeating
  • Estimation is still a mess
  • Stakeholders still don’t trust your dates

Why the “continuous” part is misleading

Improvement in real teams doesn’t look like a smooth curve. It looks like this:

  1. Pain builds up quietly
  2. Something breaks (a release, a relationship, a key metric)
  3. A small group gets angry enough to push for change
  4. You get a step-change (new policy, new tool, new agreement)
  5. Things plateau again until the next breaking point

That’s not continuous. That’s punctuated.

The problem is: if you keep pretending improvement is a gentle, ongoing activity, you avoid the hard moments where you actually have to say:

  • “We’re stopping X.”
  • “We’re changing how we do Y.”
  • “We’re not shipping until Z is fixed.”

What Actually Drives Change in Software Teams

Here’s the truth: real change is driven by pressure + clarity + power. If you’re missing any of those, you get talking, not changing.

1. Pain and pressure (you don’t change when things are “fine”)

Teams don’t improve because a retro template told them to. They improve because the pain of staying the same becomes unbearable.

Real drivers:

  • Escalating production incidents that burn out the team
  • Key customers threatening to leave
  • Leadership asking “why is everything late?”
  • Engineers quietly quitting or actively leaving

Stats to ground this:

  • A 2023 Accelerate State of DevOps report found that elite teams deploy 973x more frequently and have 6570x faster lead time than low performers. The gap isn’t because one group does “more retros.” It’s because they respond to pain with structural changes, not band-aids.
  • In a survey by Atlassian, over 60% of teams said their biggest blocker to improvement was “no time to fix underlying issues.” Translation: the pain is there, but not yet prioritized.

If your team doesn’t feel real pressure:

  • Your “improvement” items will always lose to feature work
  • Your retros will keep circling the same topics
  • Your process will calcify around current habits

2. Clarity about what “better” actually means

“The problem is:” most teams can’t answer a basic question:

“How would we know if we actually improved?”

They’re missing clear, agreed signals that define “better.”

Instead of vague goals like:

  • “Improve quality”
  • “Communicate more”
  • “Be more predictable”

You need sharp, measurable targets like:

  • “Reduce average lead time from 14 days to 5 days”
  • “Cut escaped defects by 50% over the next two releases”
  • “Hit 80% of our committed sprint goals for three sprints in a row”

Without clarity:

  • Every suggestion sounds reasonable
  • Nothing is prioritized
  • You never know if your experiments are working

3. Power and ownership (who can actually change things?)

Let’s be honest: many teams treat improvement as a side quest owned by no one.

Common situation:

  • Scrum Master facilitates the retro
  • Team lists issues
  • Everyone nods
  • Action items are assigned to “the team”
  • Nothing structural changes (because no one with actual authority was in the room)

Real change requires:

  • Someone who can say no to new work
  • Someone who can change policies (e.g., “no more starting work without acceptance criteria”)
  • Someone who can allocate time and budget

If your improvement ideas require:

  • Cross-team coordination
  • Tooling changes
  • Policy changes
  • Stakeholder behavior changes

…and you never involve those people?

You’re not doing continuous improvement. You’re doing continuous venting.


Common Mistakes That Kill Real Improvement

Mistake #1: Treating retrospectives as therapy sessions

Retrospectives are not group therapy. They’re a decision meeting.

What not to do:

  • Endless “what went well / what didn’t” lists
  • Letting everyone share feelings without converging on action
  • Ending with 8–10 “action items” that are really just ideas

What happens:

  • People feel heard but not helped
  • Cynicism grows: “We talk about this every sprint and nothing changes”
  • Retros become a ritual everyone attends and no one respects

Mistake #2: Too many “improvements,” no real bets

The problem is: teams try to improve everything a little instead of one thing a lot.

You see:

  • 5–10 small tasks per sprint labeled as “process improvements”
  • None of them get completed
  • None of them move a metric in a meaningful way

Result:

  • Busyness instead of impact
  • “We’re always working on improvement” but nothing noticeable changes

Mistake #3: No protection for improvement work

If improvement work competes directly with feature work, feature work wins. Every time.

What not to do:

  • “We’ll fit in improvement tasks if we have time.”
  • “We’ll do it at the end of the sprint.”
  • “We’ll fix tech debt in a future quarter.”

This is like saying:

  • “We’ll pay off our credit card when we have spare cash.”

You never do.

Mistake #4: Ignoring the human and political side

Real change threatens:

  • Existing habits
  • Informal power structures
  • Comfort zones

Typical anti-patterns:

  • Forcing new process without explaining the “why”
  • Expecting engineers to fix systemic issues they don’t control
  • Pretending everything is “collaborative” when some decisions are clearly top-down

Result:

  • Passive resistance
  • Fake compliance
  • Shadow processes (“what we really do” vs. “what we say we do”)

So What Actually Works? A Practical Playbook

Here’s the truth: if you want meaningful change, you need to stop doing “continuous improvement” as a vague ideal and start doing deliberate change cycles.

Step 1: Pick one painful outcome to attack

Start by answering:

“If we only improved one thing in the next 6 weeks, what would make the biggest difference?”

Examples:

  • “Our lead time is 20 days. Let’s get it under 7.”
  • “We have production incidents every week. Let’s get to fewer than 2 per month.”
  • “We miss sprint commitments constantly. Let’s hit 80% of committed work for two sprints.”

Make it:

  • Specific
  • Measurable
  • Time-bound
  • Tied to real pain the team actually feels

Step 2: Turn retros into decision meetings

Redesign your retro around one target outcome.

Structure:

  1. Review the metric (lead time, incidents, carryover, etc.)
  2. Ask: “What made this better/worse this sprint?”
  3. Generate ideas, but then force a decision:
    • Pick one or two experiments max
    • Each experiment must have:
      • An owner
      • A clear change in behavior
      • A date when you’ll review it

Example:

  • Outcome: Reduce carryover
  • Decision: “For the next sprint, we will:
    • Stop starting new work in the last 2 days of the sprint
    • Split any ticket > 2 days into smaller pieces before it enters ‘In Progress’”

That’s concrete. You can observe it. You can measure impact.

Step 3: Protect improvement capacity explicitly

Stop pretending improvement will happen “when there’s time.”

Instead:

  • Reserve a fixed percentage of capacity (e.g., 10–20%) for improvement work
  • Or reserve one improvement slot per sprint that is non-negotiable
  • Or run a focused 2–3 day kaizen on a specific issue (e.g., flaky tests, deployment pipeline)

Make it visible:

  • Improvement tasks on the same board as delivery work
  • Clear labels (e.g., “IMPROVEMENT – Do not de-scope without PO + Tech Lead agreement”)

Step 4: Change policies, not just tasks

Tasks are one-off. Policies are durable.

Instead of:

  • “Fix flaky test X”
  • “Refactor Y module”
  • “Improve handover from design to dev”

Think:

  • “No ticket enters ‘In Progress’ without test strategy defined”
  • “All new code in this module must meet X coverage and Y performance”
  • “Design handoff must include acceptance criteria and edge cases”

Policy examples that actually move the needle:

  • WIP limits: “No more than 2 items per dev in progress”
  • Definition of Ready: “No work starts without acceptance criteria”
  • Bug handling: “Any P1 bug pauses feature work until resolved and root-caused”

Step 5: Involve people with real authority

If your change requires:

  • Adjusting deadlines
  • Saying no to extra scope
  • Changing release policies
  • Cross-team coordination

Then:

  • Invite the Product Owner, manager, or relevant stakeholder to the retro (or a follow-up decision meeting)
  • Present the problem with data, not feelings:
    • “Our average lead time is 18 days; we want to get to 7.”
    • “We shipped 12 P1 bugs last quarter; this is burning the team out.”
  • Propose one or two concrete policy changes and the trade-offs:
    • “We want to cap WIP; this may slightly reduce parallelism but should improve predictability.”
    • “We want to reserve 15% capacity for tech debt; this will reduce feature throughput slightly in the next 2 sprints.”

Don’t ask, “Can we improve?”
Ask, “Which trade-off do you prefer?”

Step 6: Measure for 4–6 weeks, then decide

Improvement is experimentation, not faith.

For each change:

  • Track the relevant metric weekly (lead time, incidents, carryover, etc.)
  • After 4–6 weeks, ask:
    • “Did this move the metric meaningfully?”
    • “Did it make life better or worse for the team?”
    • “Do we keep, tweak, or kill this change?”

If it didn’t help:

  • Kill it without guilt
  • Try a different lever

The goal is not to be right. The goal is to learn what actually works in your context.


Making Tools Work For You (Not the Other Way Around)

Tools won’t magically create improvement, but they can remove friction from the change process.

Look for tools that:

  • Make experiments and decisions visible
  • Reduce social pressure (e.g., anonymous voting in retros)
  • Integrate with your existing workflow (Jira, boards, etc.)
  • Don’t require a big setup tax for quick sessions

For example, if you’re running planning poker or retros and want to avoid anchoring bias and overcomplication, a lightweight tool like ScrumPoi (free, anonymous voting, Jira integration, no signup required) can help you focus on the conversation and decisions instead of wrestling with process overhead.


The Bottom Line

Continuous improvement, as a slogan, is mostly a lie teams tell themselves.

Real change is:

  • Driven by pain, not by ceremony
  • Lumpy, not smooth
  • Political, not purely technical
  • Deliberate, not accidental

If you want your team to actually improve:

  • Stop worshipping “continuous improvement”
  • Start running focused, high-pressure, time-bound change cycles
  • Anchor everything to one painful outcome at a time
  • Protect capacity, change policies, and involve people with real authority

You don’t need more retros.
You need fewer, braver decisions.

Keep reading

More on the topics this article touches.