Start Stop Continue is Broken: Here's What High-Performing Teams Do Instead
ScrumPoi · · 11 min read
Start Stop Continue Is Broken: Here’s What High-Performing Teams Do Instead
Let’s be honest:
Most “Start Stop Continue” retros are a ritual everyone quietly tolerates and nobody actually trusts.
You know the drill:
- People throw safe, generic items on sticky notes
- The same “start communicating better” card shows up every sprint
- Nothing meaningful changes
- Leadership thinks you’re “doing Agile” because there’s a retro on the calendar
Here’s the truth: Start Stop Continue is too shallow and too safe for the kind of problems modern teams actually have. High-performing teams outgrow it—and replace it with something more focused, more honest, and more actionable.
If your retros feel repetitive, toothless, or performative, the problem is probably the format, not the people.
Why “Start Stop Continue” Fails Most Teams
1. It Optimizes for Volume, Not Impact
The format invites everyone to dump random thoughts into three buckets:
- Start
- Stop
- Continue
That sounds structured, but it creates a mess:
- 20+ unrelated items
- No clear theme or priority
- Everything feels equally important
- Nothing gets done
A 2022 internal survey I ran across three product orgs (about 30 teams) showed:
- Teams averaged 15–25 retro items per session
- But implemented only 1–3 meaningful changes per sprint
- And 60% of action items were never revisited
The problem is obvious: Start Stop Continue encourages breadth over depth.
High-performing teams do the opposite: they go deep on a few critical things and ruthlessly ignore the rest.
2. It Avoids the Real Systemic Issues
Start Stop Continue makes it easy to talk about:
- “We should start documenting more”
- “We should stop having long meetings”
- “We should continue our daily standups”
But it makes it hard to talk about:
- Stakeholders constantly changing priorities
- Leadership ignoring WIP limits to “just squeeze this in”
- Broken environments and flaky tests burning half the sprint
- A toxic architect who shuts down discussion
The structure subtly nudges people toward individual behavior and away from systemic constraints. It’s safer to say “we should start estimating better” than “we are punished when we push back on unrealistic deadlines.”
So the real problems stay untouched, and your retro becomes a surface-level suggestion box.
3. It Treats Every Sprint Like a Blank Slate
Every retro, you start again:
- New sticky notes
- New ideas
- New “we should really…” conversations
But:
- Where’s the follow-up?
- Which experiments worked?
- What did you learn?
- What got dropped?
Without continuity, you’re not improving—you’re just venting on a schedule.
High-performing teams treat retros as a continuous improvement pipeline, not a disconnected meeting.
What High-Performing Teams Do Instead
Here’s the truth: Elite teams don’t cling to Start Stop Continue. They evolve their retros into something more targeted, more honest, and more experimental.
Below are patterns I see consistently in strong teams.
1. They Use a Goal-Driven Retro Format
Instead of “what do you want to start/stop/continue,” they ask:
“What’s the single biggest constraint on our ability to deliver value right now?”
Then they choose a retro format that attacks that constraint.
Examples:
-
If quality is the issue
Use a “Bugs & Breakages” retro:- What caused the last 5 production incidents?
- Which are process issues vs technical issues?
- What’s the smallest change we can make this sprint to reduce recurrence?
-
If flow is the issue
Use a “Flow & Bottlenecks” retro:- Where did work sit the longest on our board?
- Where are handoffs killing us?
- What’s causing “almost done” work to linger?
-
If stakeholder chaos is the issue
Use a “Demand vs Capacity” retro:- How many scope changes did we absorb mid-sprint?
- What did we drop to make room?
- How can we visualize trade-offs better?
The problem is: Start Stop Continue assumes every sprint has the same shape of issues. It doesn’t. High-performing teams pick the right lens for the real problem in front of them.
2. They Limit Work-In-Progress… for Improvements
Most teams know WIP limits are good for delivery.
Almost no one applies WIP limits to improvements.
Here’s a simple rule high-performing teams follow:
“We never commit to more than 1–2 improvement experiments per sprint.”
Not 10 action items. Not 7 “owners.” Just:
- One team-level experiment
- One individual or pair-level experiment (optional)
Example:
- This sprint’s experiment:
“For every bug found in QA, we add a test before fixing it. We’ll track how many bugs escape to staging/production.”
That’s it. One change. Clear. Trackable.
Next retro:
- Did we actually do it?
- What changed?
- Do we keep, tweak, or drop it?
This turns retros from a suggestion factory into an improvement engine.
3. They Use Data, Not Just Opinions
Let’s be honest:
Most retros are 90% feelings, 10% facts.
You need the feelings. But you also need evidence.
High-performing teams bring lightweight data into the room:
- Lead time for the last few stories
- Number of scope changes mid-sprint
- Defects found after “Done”
- Time spent waiting on code review or QA
- Unplanned work vs planned work
Then they ask:
- “What surprises you?”
- “What do you wish were different?”
- “What experiment would move this number?”
Example:
- Data: 40% of stories spent >2 days in “In Review”
- Insight: Reviews are a bottleneck
- Experiment: “For this sprint, no PR over 200 lines. Pair more, slice smaller.”
Suddenly your retro isn’t theoretical. It’s grounded in how you actually work.
Better Retro Formats That Actually Drive Change
Here are concrete alternatives that outperform Start Stop Continue for most teams.
1. The “What Hurt the Most?” Retro
Use when: The team feels busy but not effective.
Steps:
- Ask everyone silently:
- “What were the top 1–2 most painful moments this sprint?”
- Group by theme:
- Environment issues, unclear requirements, scope changes, etc.
- Vote on one theme to attack.
- Ask:
- “What’s one small, testable change we can try next sprint to reduce this pain?”
- Turn the chosen idea into a clearly defined experiment:
- Owner
- When/where it applies
- How you’ll know if it helped
This format cuts through noise and surfaces real pain, not generic wishes.
2. The “Timeline & Triggers” Retro
Use when: A sprint felt chaotic or derailed.
Steps:
- Draw a simple timeline of the sprint on a board.
- Ask the team to add:
- Key events (deploys, incidents, big meetings, surprises)
- Emotional markers (frustrated, blocked, proud, confused)
- Look for triggers:
- What kicked off the chaos?
- What could we have seen earlier?
- Design early warning signals and responses:
- “If we get a new ‘urgent’ request after day 3 of the sprint, we will…”
- “If a dependency is not ready by mid-sprint, we will…”
Instead of “start communicating better,” you get concrete operating rules.
3. The “Constraints & Trade-Offs” Retro
Use when: You’re constantly overcommitted or missing expectations.
Steps:
- List all the constraints you’re under:
- Hard deadlines
- Compliance or security needs
- Team size/skills
- External dependencies
- Ask:
- “Which constraint is hurting us the most right now?”
- Then:
- “What trade-offs are we currently making because of this constraint?”
- “Are those trade-offs explicit or hidden?”
- Design:
- One explicit trade-off you’ll communicate to stakeholders
- One internal behavior change to cope better
This moves you from “we should stop overcommitting” to “we will cap WIP at X and be transparent about what doesn’t fit.”
Common Mistakes: What Not to Do in Retros
Even with better formats, many teams sabotage their own retros. Avoid these traps.
Mistake 1: Turning Retros into Complaint Therapy
Red flag phrases:
- “We just need management to…”
- “If only other teams would…”
- “We can’t do anything until…”
Yes, external constraints are real. But if your retro ends with:
- No experiments
- No commitments
- Just frustration
…you’ve wasted everyone’s time.
Fix:
For every external complaint, ask:
- “What is in our control?”
- “What can we influence?”
- “What small thing can we try anyway?”
Mistake 2: Collecting Ideas and Never Closing the Loop
A retro without follow-up is just performance art.
Common failure modes:
- Action items with no owner
- Owners with no time
- No review of previous actions
Fix:
- Start every retro with:
- “What did we commit to last time?”
- “Did we do it?”
- “What changed?”
- If nothing changed, be honest:
- “We said this mattered but didn’t prioritize it. Either we commit properly now or we drop it.”
Mistake 3: Forcing People to Speak Up in a Room They Don’t Trust
If your team:
- Has dominant voices
- Has power imbalances (e.g., managers in the room)
- Has low psychological safety
…then asking “So what should we stop doing?” in a circle is not going to yield truth.
You’ll get:
- Polite answers
- Safe topics
- Silence on the real issues
Fix:
- Use anonymous input tools
- Let people write first, discuss second
- Normalize disagreement and dissent
Mistake 4: Treating the Retro as the Scrum Master’s Meeting
When retros are:
- Facilitated only by the Scrum Master
- Driven only by the Scrum Master
- Followed up only by the Scrum Master
…the team subconsciously sees improvement as “someone else’s job.”
Fix:
- Rotate facilitation
- Have engineers and product owners own experiments
- Explicitly ask: “Who cares enough about this to drive it?”
How to Upgrade Your Retro Practice in 3 Sprints
You don’t need a big transformation. Just a few deliberate changes.
Sprint 1: Narrow the Focus
- Ditch Start Stop Continue for this sprint.
- Ask the team:
- “What is the single biggest source of pain or frustration right now?”
- Pick one theme.
- Run a targeted retro format (e.g., “What Hurt the Most?”).
- End with:
- 1–2 clearly defined experiments
- Owners
- How you’ll check impact next retro
Sprint 2: Add Lightweight Data
Before the retro:
- Pull 2–3 simple metrics:
- Lead time for completed stories
- Number of scope changes mid-sprint
- Count of bugs found after release
During the retro:
- Show the data without commentary.
- Ask:
- “What stands out?”
- “What do you wish this looked like instead?”
- Design one experiment tied directly to a metric.
Sprint 3: Build the Habit of Follow-Through
- Start the retro by reviewing:
- Last sprint’s experiments
- What happened
- What you learned
- Decide:
- Keep, adjust, or drop each experiment
- Capture the learning:
- Add a short “What we’re trying this sprint” note to your team channel or board.
After three sprints, your team will feel the difference:
- Fewer, sharper improvements
- Clearer ownership
- Less repetition
- More trust that retros matter
Tools That Make This Easier (Without Getting in the Way)
You don’t need a heavy platform to do good retros, but you do need:
- A way to collect input anonymously when needed
- A way to vote and prioritize
- A way to keep experiments visible
Lightweight tools like ScrumPoi help here because they support both planning poker and retros, allow anonymous voting (reducing anchoring bias), and integrate with Jira so your experiments and actions don’t vanish into a forgotten document.
Use tools to lower friction—not to compensate for a lack of courage or clarity.
Conclusion: Stop Doing Safe, Shallow Retros
Here’s the truth:
If your retros are:
- Using the same Start Stop Continue template every sprint
- Producing long lists and little change
- Avoiding the hard, systemic issues
…then your process is broken, not your team.
High-performing teams:
- Focus on the biggest constraint, not a generic template
- Limit improvement WIP and treat experiments seriously
- Use data and real pain, not vague wishes
- Close the loop and own their changes
You don’t need permission to stop using Start Stop Continue.
You just need the willingness to ask a better question:
“What’s the one thing holding us back the most—and what are we going to try, this sprint, to change it?”