Why board security metrics mislead

Most security dashboards report that something exists or happened: coverage percentages, patch counts, training completion, alerts closed. Boards read those figures as a measure of protection. Often they are a measure of activity.

Consider "MFA coverage: 98%". It may be accurate. But it rarely says which systems make up the remaining 2%, whether privileged and service accounts are included, how the figure was calculated, when it was last checked or who is accountable if it is wrong. A green figure with no answers to those questions is presence, not proof.

Four tests of an evidenced metric

A metric deserves board-level trust when it passes four tests:

  • Source: the figure comes from a system of record, not a manual spreadsheet or a self-assessment.
  • Recency: it has been validated recently enough to reflect the current environment.
  • Independent testing: someone other than the control owner has checked that the figure is accurate and that the underlying control works.
  • Ownership: a named person is accountable for the metric and for acting when it moves.

The Dashboard Integrity Score Auditor scores each metric against these tests, so you can see which figures would survive a sceptical challenge and which would not.

Common integrity failures

  • Shrinking denominators: coverage improves because the asset scope quietly narrows, not because more assets are protected.
  • Activity as outcome: vulnerabilities patched is reported instead of exposure remaining on critical systems.
  • Inherited figures: a number is carried forward from the last report because nobody has re-measured it.
  • Self-attestation: the team that owns the control also produces the metric and declares it healthy.
  • No threshold: the metric has no defined tolerance, so nobody knows when it should trigger action.

What a trustworthy dashboard looks like

A trustworthy dashboard is usually smaller. It reports fewer metrics, each tied to an outcome that matters, with its source, validation date and owner visible alongside the figure. Where evidence is weak, it says so, rather than presenting every metric with the same confidence.

That transparency is the point. A board that can see how strong the evidence is behind each figure can make better decisions than one shown a page of green.

Related tools and reading