SLIDE 1
Make Cheaper Mistakes
SLIDE 2 Anna Marie Clifton
- Product Manager, Yammer
- Clearly Product podcast
- @TweetAnnaMarie
SLIDE 3
We make mistakes
SLIDE 4
Make better, faster, cheaper mistakes
SLIDE 5
An incredibly expensive Yammer mistake
SLIDE 6
A whole new Android App
SLIDE 7
A whole new Android App
SLIDE 8 A whole new Android App
SLIDE 9 A whole new Android App
- 1 year of engineering
- The whole Android team
SLIDE 10 A whole new Android App
- 1 year of engineering
- The whole Android team
- Multiple designers
SLIDE 11
- 1 year of engineering
- The whole Android team
- Multiple designers
- Multiple PMs
A whole new Android App
SLIDE 12
- 1 year of engineering
- The whole Android team
- Multiple designers
- Multiple PMs
- Stalled our other work
A whole new Android App
SLIDE 13
Negative impact on metrics
SLIDE 14
How can we make this cheaper?
SLIDE 15
Tricks to help you:
SLIDE 16 Tricks to help you:
- 1. Find the right problem
SLIDE 17 Tricks to help you:
- 1. Find the right problem
- 2. Plan the cheapest experience
SLIDE 18 Tricks to help you:
- 1. Find the right problem
- 2. Plan the cheapest experience
- 3. Abandon ship when needed
SLIDE 19
- 1. Find the right problem
Write a clear problem statement
SLIDE 20
Cool Feature: Subject Lines for Threads
SLIDE 21
Cool Feature: Subject Lines for Threads
“Subject lines will help users see if threads are important enough to read.”
SLIDE 22
Problem Statement:
“In the feed, users have trouble determining if long threads are important enough to read.”
SLIDE 23 Clear Problem Statement
- 1. Keeps you “user-first”
SLIDE 24
“In the feed, users have trouble determining if long threads are important enough to read.”
Is this a real user problem?
SLIDE 25 Clear Problem Statement
- 1. Keeps you “user-first”
- 2. Helps you evaluate impact
SLIDE 26
“In the feed, users have trouble determining if long threads are important enough to read.”
Is this a big opportunity?
SLIDE 27
Example Mistake from Yammer
#Topic boards
SLIDE 28
SLIDE 29
SLIDE 30
Zero impact on metrics
SLIDE 31
“Cool Feature”
SLIDE 32 “Cool Feature”
With no users.
SLIDE 33
Clear Problem Statement
SLIDE 34
- 2. Plan the cheapest experience
Like MVP, but better!
SLIDE 35
MVP: Minimum Viable Product
SLIDE 36 MVP: Minimum Viable Product
- The least features
- The lowest fidelity
- The fastest to build
SLIDE 37
MVE: Minimum Viable Experience
SLIDE 38 MVE: Minimum Viable Experience
- The closest approximation
- Based on your assumptions
- To get the fastest learning
SLIDE 39
Example mistake from Yammer
Self-sufficient groups
SLIDE 40
SLIDE 41
Fundamentally change behavior
SLIDE 42
Fundamentally change behavior
SLIDE 43
Fundamentally change behavior
SLIDE 44
Fundamentally change behavior
SLIDE 45
- Priority workflow
- Triage
- Re-ordering
Fundamentally change behavior
SLIDE 46
- Priority workflow
- Triage
- Re-ordering
- Bookmark
Fundamentally change behavior
SLIDE 47
- Priority workflow
- Triage
- Re-ordering
- Bookmark
- Remind me later
Fundamentally change behavior
SLIDE 48
What if we’re wrong?
SLIDE 49
What’s the cheapest experience to invalidate these assumptions?
SLIDE 50
Let’s just highlight priority
SLIDE 51
SLIDE 52
SLIDE 53
Zero impact on metrics
SLIDE 54
Cheap experience test
SLIDE 55 Cheap experience test
Saved us a costly mistake
SLIDE 56
Build your MVE
SLIDE 57
- 3. Abandon ship when needed
It’s ok, I promise
SLIDE 58 “The best thing we can do for velocity is not build a bad feature.”
— Gadi Ben Zvi
SLIDE 59
We’re bad at letting go...
SLIDE 60
We’re bad at letting go... “Loss aversion”
SLIDE 61
We always convinced we’re right...
SLIDE 62
We always convinced we’re right... “Confirmation Bias”
SLIDE 63
Two easy ways to Abandon Ship!
SLIDE 64 Two easy ways to Abandon Ship!
- 1. Make it “ok” from the start
SLIDE 65 Two easy ways to Abandon Ship!
- 1. Make it “ok” from the start
- 2. Develop your “woah” muscle
SLIDE 66
Lose 1.5 weeks or gain 1.5 months?
SLIDE 67
Mistakes are not problems.
SLIDE 68
Mistakes are not problems. … big ones are.
SLIDE 69 Make cheaper mistakes:
- 1. Clear Problem Statements
- 2. Minimum Viable Experience
- 3. Make it ok to walk away
SLIDE 70
Make better, faster, cheaper mistakes
SLIDE 71
So we have runway to make better, faster, stronger products
SLIDE 72 Thank you
Anna Marie Clifton
@TweetAnnaMarie