Learn OKRs with Phoebe

How to measure people and teams fairly

Goals, metrics, and performance - done in a way that builds trust instead of gaming. This course teaches OKRs and fair performance measurement end to end, using an online retailer, Cartwheel, as the worked example. A leader track for C-level and upper management on designing the system, and a manager track for middle management and team leads on running it fairly. You will meet the biases that corrupt ratings, the law that guarantees any single metric gets gamed, where AI genuinely helps (and where it becomes surveillance), and a cadence that steers without smothering. You even drive a live Fair-Metric Lab. For everyone else, it is a plain-English guide to how good measurement actually works.

2tracks
16sessions
45min per session
1live Fair-Metric Lab

The leader / design track 🀝 · for C-level & upper management · 6 x 45 min · no code, ever

Thinking mode: how to design a measurement system that is fair and hard to game - what OKRs are and are not, the metric tree, the biases to guard against, how to govern AI in measurement, and the culture that makes it work. Each session ends with the questions to ask your team.

The manager / run track πŸ› οΈ Β· for middle management & team leads Β· 10 x 45 min Β· templates + worked examples

One running company, Cartwheel, threaded through the demos: you write real OKRs, choose metrics that are fair to grade on, set a monitoring cadence, run fair performance conversations, and use AI responsibly - following one team from goal-setting to a full measurement system.

🧱 Manager 1 · easy

Foundations

The three purposes of measurement, activity vs outcome, and the six-point fair-metric checklist you will use all track.

β–Ά Managers start here
✍️ Manager 2 · easy

Writing good OKRs

Objectives that inspire and key results that prove it, committed vs stretch, the 0-1 scoring scale, and the ~0.7 sweet spot.

Cartwheel OKRs
βš—οΈ Manager 3 Β· medium

Choosing fair metrics

Score a metric's fairness, then watch Goodhart's Law break it - a live Fair-Metric Lab where a gamed number climbs while the real outcome collapses.

β˜… interactive: Fair-Metric Lab
🌳 Manager 4 · medium

The metric tree per function

Fair OKRs for every Cartwheel team - Growth, Product, Engineering (DORA), Ops, Support, Merchandising, Data - each on a lever it controls.

Per-function OKRs
πŸ“Š Manager 5 Β· medium

Monitoring cadence + dashboards

1:1s tuned to task-relevant maturity, weekly-monthly-quarterly rhythm, and dashboards that show target, trend, and context - not naked numbers.

Cadence + RAG
πŸ’¬ Manager 6 Β· hands-on

Fair performance conversations

Continuous check-ins over the annual review, and keeping steering, development, and reward in separate conversations so honesty survives.

CFRs + check-ins
🎭 Manager 7 · hands-on

Beating the bias

The idiosyncratic rater effect, recency and halo, biased feedback language, and calibration done fairly - plus auditing your own ratings.

Bias self-audit
πŸ€– Manager 8 Β· hands-on

AI-assisted, responsibly

Using AI to summarize feedback, flag biased language, and draft - with the guardrails: transparency, contestability, and what to never automate.

AI as helper
⚠️ Manager 9 · medium

When metrics go wrong

Gaming, surrogation, vanity metrics, and single-number verdicts - how to diagnose a broken metric and repair it before it does damage.

Diagnose + fix
πŸ›οΈ Manager 10 Β· hardest

Build your measurement system

The capstone: assemble a full fair OKR and monitoring system for a Cartwheel team, with health guardrails, a cadence, and a review of the measures themselves.

Capstone
easy - everyone medium hands-on / deciding hardest
An honest note on measuring people: an OKR score is for steering and learning, never a direct input to pay - the moment it drives compensation, people game it and stop being honest. This course teaches from the canon (Grove, Doerr, Google re:Work, the Balanced Scorecard, DORA) and the fairness research (the idiosyncratic rater effect, organizational justice, bias in feedback language). AI is taught as a bias-checking assistant, never a judge: worker-management AI is high-risk under the EU AI Act and "solely automated" evaluation is a legal red line (GDPR Article 22). Cartwheel is a fictional teaching company and its benchmarks are illustrative. Regulations are summarized for awareness, not legal advice.

Choose your path πŸ—ΊοΈ

Two doors, one course. Leaders design the system; managers run it fairly - and both meet at the Fair-Metric Lab. Employees are welcome to read either as knowledge-sharing.

🀝 Leader / design (no code) a1β†’ a2β†’ a3β†’ a4β†’ a5β†’ a6
πŸ› οΈ Manager / run (templates) b1β†’ b2β†’ b3β†’ b4β†’ b5β†’ b6β†’ b7β†’ b8β†’ b9β†’ b10
🌱 Curious employee (a taste) a1β†’ a4β†’ b3
πŸš€ Full journey (design AND run) a1-a6β†’ b1-b10

The knowledge map 🧠

Both tracks at a glance - hover a session to spotlight its concepts, click any node to jump in.

The plate: the rating measures the rater πŸ“

Five identical instruments, one shared input, five different readings. The uncomfortable finding under fair measurement, with the variance decomposition and the structural fix. Every word on the plate is real text.

Download for print (2172px) Every word here is real selectable text, so it stays sharp however far you zoom.
LEARN OKRs WITH PHOEBE

The rating measures the rater

16 sessions on measuring people and teams fairly, worked on one online retailer, Cartwheel.
SAME PERSONone ratee
SAME EVIDENCEone body of work
SAME CRITERIAone rubric
SAME QUARTERone period
SAME FORMone scale, 0 to 1
WHAT A RATING ACTUALLY MEASURES
Rater idiosyncrasy~55%
Actual performance~21%
Situation and error~24%
THE SOURCE
Scullen, Mount & Goff (2000) found 50 to 60 percent of rating variance is the rater. One score from one manager is a weak signal about a person.
SO THE FIX IS STRUCTURAL
01More than one perspective
02Criteria fixed in advance
03Evidence attached to claims
04Calibration across raters
THE ANATOMY, FROM SESSION A2
An Objective is qualitative: one memorable sentence about where you want to be. Its two to three Key Results are the measurable outcomes that prove you got there. If you cannot put a number on a Key Result, it is not a Key Result.
0-1Key Results score on one scale
~0.7The sweet spot, a Google norm to adapt, not a law
C/ACommitted goals differ from aspirational ones
WHAT IT IS NOT
Not that raters lie, and not that performance cannot be measured. Real differences exist. They are simply a smaller share of the variance than we assume.
Five instruments. One input. Five readings. The gap is mostly them, not the person.
learn-okr-with-phoebe 2 tracks · 16 sessions · 6 leader · 10 manager by Phoebe Fu