Expertise · Long-term management and operations

The health metric of the design system needs to be reviewed quarterly.

The health of the system does not lie in the number of components produced but in the level of practical application, who is using what, and how correctly they are using it.

Quick summary

The minimum metrics to review quarterly include four groups: output produced, product coverage, application levels by team, and execution quality. It is not necessary to measure everything but to measure what helps you decide the next steps. Metrics are not for beautiful reports but to detect when the system is thinning before it becomes a problem.

Quick comparison
You should choose this direction when
  • system has been launched, needs to measure usage and who is using what
  • industry bound by standards, needing additional accessibility and performance metrics
  • using metrics to decide on next steps, not just for reporting
Not needed when.
  • only count the number of components produced, not measure if anyone uses them
  • set too many metrics, making it hard to review quarterly

Most teams look at the design system and ask: "How many components have we created?" That is the wrong question. The right question is: "Is what we have created being used, by which teams, and is it being used correctly?" Quarterly audits are only valuable when they answer that right question, leading to specific decisions, not just creating a pretty report.

Four core indicator groups

Sinh Vũ recommends organizing quarterly metrics into four groups in order of the system's maturity.

  • Output: the number of completed components, patterns, tokens; the number of releases in the quarter; the number of support cases resolved. This metric is the easiest to measure and often serves as a starting point when the system is still immature.
  • Coverage: How much of the actual product is using system assets, measured by features or interface areas. High but uneven coverage is a sign that some teams are neglecting the system.
  • Team adoption level: Not just total usage but which team uses which components the most and which team hardly interacts with the system. This is a metric emphasized by Nathan Curtis: it is essential to understand who is using what and how.
  • Quality of execution (usage quality): How well components are installed according to standards, whether they are misused, overwritten carelessly, or customized outside the system. This group is the hardest to measure but is the earliest signal that the system is becoming diluted.

Support signals should be monitored further.

In addition to the core four groups, some secondary signals help you gain a fuller picture.

  • Number of recurring questions: If the same question appears multiple times in a quarter, the existing documentation or guidelines have gaps.
  • Onboarding speed: How long it takes for new users to perform tasks independently without asking for help. A prolonged duration indicates that the system is more complex than necessary.
  • Technical quality metrics: Accessibility, loading performance, and code cleanliness if the industry has standard constraints or multiple teams using it.

Sparkbox notes that only about 16% of design systems have measurable metrics systematically. However, those systems that invest in actual quality metrics have a clearly higher application rate compared to systems that only count components.

When to prioritize which group

The system is still young, newly launched: Focus on output to see the rhythm of production. The team needs to see the system progressing to maintain momentum. There is no need to measure application when no one is truly using it yet.

Launched system, expanding: Shift focus to coverage and who is using what. This is the stage most likely to be overlooked because the team is still busy creating new items without paying attention to how the old items are being used.

Stable system, multiple teams operating: Add quality execution metrics and technical indicators. At this point, the biggest risk is that each team uses the system differently to the extent that it loses consistency.

Common errors when reviewing

  • Only boast about the number of components produced without measuring if anyone uses them. Output is not value; application is what matters.
  • Measuring total usage while overlooking which teams. A good total can hide the fact that two teams have completely stopped using the system.
  • Set too many metrics to the point where no one can review them each quarter. A small set that can be reviewed regularly is better than a large set that is reviewed once and then ignored.
  • Viewing the review session as a performance report, not a decision-making meeting. Each review must conclude with at least one specific action that will be done differently in the next quarter.

Start by measuring output, then move to measuring application, as the value creation system relies on the product's shipping experience. Don't just measure usage; understand who is using which component and how.

Nathan Curtis, Measuring Design System Success (EightShapes)

Sinh Vũ's viewpoint

In the deliverable package with management, Sinh Vũ provides a set of metrics to track application levels by team, linked to quarterly review minutes. The goal is for each team to reflect each quarter: whether the system is still strong or becoming diluted, and what to prioritize in the next quarter.

Sinh Vũ does not provide a percentage figure as a firm commitment, as that number depends on the team and product that you will operate after delivery. What Sinh Vũ commits to is designing a set of metrics that are concise enough to reflect reality, not just pretty enough for reporting.

If you are reviewing the system for the first time and don't know where to start, choose one metric from each core group, review it over a quarter, and then adjust. Don't try to design a perfect set of metrics right from the beginning.

The tool brings back.

Decision checklist

Topic: Key health metrics to review quarterly. Sinh Vũ guide, sinhvu.com

0 more than 6 items

Select each item you find appropriate, then print or save as PDF to take with you.

Sign indicating that you should take action
Questions to answer before deciding

If you have marked most of the signs above, this is the time to discuss in more detail. Sinh Vũ can help you review and propose a direction.

References

Nathan Curtis, Measuring Design System Success (EightShapes). Sparkbox, Design Systems Survey 2022. Sinh Vũ's consulting and deliverable experience.

Frequently asked questions

Quarterly review to determine if special software is needed?

Not necessarily. A manually tracked spreadsheet combined with brief meeting notes is enough for most teams. More important than the tool is the question posed during the review: is the system being used correctly, which teams are falling behind, and what needs to be prioritized in the next quarter?

If the system is still new and not many teams are using it, what metrics should be measured first?

Start from output: the number of completed components, the number of releases, the number of resolved support cases. Once the system is launched and at least one team starts using it, shift to measuring coverage and who-is-using-what. Don’t wait for the system to be large before measuring; early measurement habits help detect issues sooner.

← Back to Digital design system