Why a flat list of KPIs stops working
Most KPI dictionaries start as a flat list. Every metric anyone's ever cared about, all in one undifferentiated pile. Works fine for the first ten metrics. By the fortieth, nobody can tell which numbers actually matter this week and which ones are just there for historical context. Every dashboard becomes a wall of tiles. Every review meeting turns into a scavenger hunt for the two or three numbers that should've driven the conversation in the first place.
A hierarchy fixes this. Not by cutting metrics — by ranking them. Everything still gets tracked and defined. It just doesn't all get equal weight on the same screen.
The four tiers
A useful hierarchy has four levels. Each one answers a different question.
- North Star — the single outcome metric your team is ultimately accountable to. There's exactly one, and everyone in the room can name it without checking a doc.
- Primary — the two to four metrics that most directly drive the North Star. Move these, and the North Star moves with them, usually within a quarter.
- Diagnostic — the metrics that explain why a Primary metric moved. These live one click below the main dashboard, not on it, because they're for investigation, not a weekly glance.
- Guardrail — the metrics you're not trying to improve, just protect. They catch the case where you hit a Primary target by quietly breaking something else.
An example hierarchy
Say you're a subscription business optimizing for retention. North Star is Net Revenue Retention. Primary is activation rate, expansion rate, and logo churn — the three levers that roll up into NRR. Diagnostic is time-to-first-value and support ticket volume, which explain why activation or churn moved in a given month. Guardrail is customer satisfaction score and support response time, making sure your retention gains come from a better product, not from making the product harder to leave.
Same shape works for a marketing function, a sales team, a whole company. Only the specific metrics change, not the structure.
Putting it into a dashboard
The hierarchy needs to be visible in the layout, not just buried in the taxonomy. North Star goes at the top, always in view. Primary metrics sit directly below, front and center. Diagnostic metrics live behind a drill-down or a separate tab — available in thirty seconds, but not competing for attention on the main screen. Guardrails get checked on a set cadence, weekly rather than continuously, since day-to-day noise there usually isn't meaningful on its own.
Once the tiers are explicit, "which metrics matter" stops being a judgment call made fresh in every meeting — it's a decision made once, in the dictionary, that the dashboard just reflects.
Where the hierarchy shows up beyond the dashboard
The same four tiers are worth applying to meeting agendas and client reporting too, not just screen layout. A weekly check-in should spend most of its time on Primary metrics, only dipping into Diagnostic detail when a Primary number needs explaining. A client report can lead with North Star and Primary and leave Diagnostic and Guardrail available as backup — instead of presenting all four with equal weight and making the client guess what actually matters this month.
Worth revisiting the hierarchy itself every couple quarters, too. A metric that was Diagnostic last year sometimes graduates to Primary once your team understands it well enough to act on it directly. The tiers describe your current level of understanding as much as they describe the metrics themselves.
About the author
Zach Edelstein
Founder, KPI Compass
Zach has spent the last decade in data analytics, working both inside large media agencies and in-house at enterprise companies. He built KPI Compass because he kept hitting the same walls every BI team eventually hits — messy definitions, benchmarks nobody can verify, dashboards that quietly drift from reality. He's especially into where AI actually helps with this work, and he's still actively evolving KPI Compass to keep up with how fast the data landscape moves.
KPI Compass on LinkedIn