Written by

Team Next Unicorn

5 min read

Startup Metrics: Build a Stage-Appropriate Evaluation Scorecard

A useful startup scorecard helps the team make a decision. It does not need every metric the analytics tool can display. Select a small set that describes the current business problem, define each measure precisely and connect changes to an investigation or action. As the company develops, the scorecard should develop with it.

Key takeaways
  • Match metrics to the company’s stage and business model.

  • Define the event, period, population and calculation for every measure.

  • Show customer retention and revenue retention separately.

  • Use a scorecard to investigate results, not to hide critical gaps in an average.

Choose measures for the question your stage creates

Before launch, focus on the assumptions that determine whether the product should exist: a clear customer problem, feasibility and evidence from realistic tests. After launch, investigate whether customers reach useful outcomes and return. With repeatable paid use, examine the cost and reliability of acquiring and serving more customers. These are planning choices, not mandatory stages with universal performance thresholds.

Write the decision beside each metric. For example, “time to first completed task” can guide an onboarding change, while “cash available under the current spending plan” informs hiring timing. If nobody can name a decision that a number affects, it may belong in a diagnostic report rather than the main scorecard. Keep a few critical risks visible even when they cannot be reduced to a percentage.

Create a metric dictionary before comparing results

For every measure, record its name, calculation, data source, reporting period, exclusions and owner. Define the customer unit: account, paying organization, site or individual user. Changing that unit between reports can create apparent growth without any underlying improvement. Show missing data explicitly and do not treat an unmeasured result as zero.

Stripe’s Billing Analytics documentation illustrates why definitions matter: settings such as discount treatment and active-subscriber timing can affect reported metrics. Align internal reports before comparing a finance spreadsheet with a dashboard. Keep recurring revenue separate from one-off fees and cash collection, and preserve the definition used for each reporting period.

For product behavior, identify the meaningful starting and return events. Amplitude’s retention guide makes those choices explicit. An account returning to finish a workflow is different evidence from an automated background event firing.

Use a compact scorecard with owners and follow-up

An original starter template is below. Select the rows that fit the business and replace generic measures with precise definitions. A transactional marketplace may care about successful repeat transactions, while a subscription product may need renewal cohorts. Avoid forcing both into an identical target. Targets should reflect the business plan and available evidence, with a date for reassessment.

  • Give every row a named owner and reporting period.

  • Show the denominator beside a percentage.

  • Keep target, actual result and explanation in separate fields.

  • End the review with a specific action or an explicit decision to keep observing.

Dimension

Example measure

Review question

Product value

Accounts completing the core workflow

Where do qualified users fail to reach the benefit?

Customer durability

Retention of a mature customer cohort

Which segments stay, leave or need unusual assistance?

Commercial progress

Paid conversions from completed evaluations

What prevents a buying decision?

Economics

Revenue, direct delivery cost and cash timing

Does growth improve or strain the operating model?

Operations

Onboarding time and unresolved incidents

Can the team deliver reliably at the planned volume?

Worked example: growth can conceal customer losses

Imagine a hypothetical subscription cohort with twenty paying accounts and $2,000 of monthly recurring revenue at the start. Three months later, four original accounts have left, removing $400 of that recurring revenue. The remaining accounts have added $600 through expansion. Assume no other changes, reactivations or currency effects, and exclude all newly acquired accounts from this cohort calculation.

Customer retention is sixteen divided by twenty, or 80%. Net revenue retention for the same original cohort is ($2,000 − $400 + $600) divided by $2,000, or 110%. Both numbers are correct under these definitions. Revenue expansion has more than offset losses financially, but it has not made the departed customers disappear.

The next action is to investigate who left and who expanded. If expansion comes from one large account, the company may have both customer-loss and concentration questions. If onboarding problems explain departures, the operational row should guide a test. Do not use the higher revenue percentage to declare every part of the business healthy.

Review trends, assumptions and evidence together

Hold a regular review using comparable periods and mature cohorts. Check whether a change reflects customer behavior, a measurement change or an unusual event. A new definition can be useful, but document it and avoid silently rewriting historical results. When samples are small, show counts and customer context rather than presenting noisy changes as a reliable trend.

NextUnicorn’s published Rating framework describes using factor-level assessments to discuss strengths and areas needing attention. Keep an operating scorecard grounded in its underlying records even when using a broader assessment framework. A provider’s grade does not replace the company’s metric definitions or establish independent validation.

At the end of the meeting, select the issue with the highest decision value. Assign one investigation, product change or operational experiment, then record what evidence would make the team reconsider. This turns startup KPIs into a working management tool. For the deeper question of durable customer value, use the separate product-market-fit guide.

Frequently asked questions

FAQs

Keep the main scorecard small enough to review and act on. Retain detailed diagnostic reports separately. The right count depends on the decisions the team currently needs to make.

No. MRR is suited to recurring subscription arrangements under a clear definition. Other business models need measures that represent their own revenue, repeat behavior and delivery economics.

Yes, when expansion from the original cohort outweighs contraction and churn under the chosen definition. Show customer retention alongside it so revenue growth does not conceal account losses.

Explore NextUnicorn’s published Rating framework

Sources
  1. Billing Analytics - Stripe
  2. Build a retention analysis - Amplitude
  3. NextUnicorn Rating - NextUnicorn Fund