Skip to content

No account required

Start a project

5 min · 4 sections

Why two dashboards give different numbers for the same thing.

Two people are usually both right about a number, and disagreeing about which number it is.

By Data Analysis App team

Why do two reports show different numbers for the same metric?

Almost always a definition rather than a bug. The four usual causes are a different filter, such as one report excluding cancelled orders; a different date basis, such as order date against ship date; a different timezone, which moves everything near midnight, and a different refresh time. Compare the definitions before comparing the numbers.

Section 01

Where should you start when two dashboards disagree?

Write down, in one sentence each, what the two reports think they are measuring. In most cases the disagreement resolves here, before anybody opens a query.

Revenue is the classic example: booked, invoiced, collected, and net of refunds are four different numbers, all correctly called revenue by somebody.

If the definitions match, the next thing to compare is the filters, and specifically the ones nobody wrote down: excluded test accounts, an internal customer, a region that migrated systems last year.

The fastest diagnostic is to reconcile a single day rather than the whole period. The cause is usually visible immediately.

Section 02

Could the two reports be using different date bases?

Order date, ship date, invoice date and payment date all produce plausible and different monthly totals from the same transactions. Any report that does not say which it uses is one of the two reports in this argument.

Timezone moves everything that happened near midnight into a different day, and at month boundaries that becomes a different month. It is a small effect that produces persistent, unexplainable differences of a few tenths of a per cent, which is exactly the size that wastes the most time.

Section 03

Could refresh time and late-arriving data explain the gap?

A report built at nine and one built at five are looking at different data, and if either caches, the difference persists after both appear to have updated.

Late-arriving rows compound this. Refunds, adjustments and corrections attach to earlier periods, so a figure for last month legitimately changes for weeks afterwards. A report that says when it was computed removes most of this class of argument permanently.

Section 04

Should you change the report, or the definition?

The instinct once the cause is found is to change one report to match the other. That is usually the wrong repair, because it leaves two definitions in the organisation and one of them now silently mirrors the other.

Write the definition down where both reports can reference it, decide which one is correct for which audience, and let them differ openly if they genuinely should. Finance and operations often need different revenue figures, and the problem was never that the numbers differed: it was that nobody could say why.

See it on a real project

Contractor spend rose $412,000 while headcount spend fell $448,000, leaving only a $4,000 net change.

What actually changed between these budget versions?

Keep reading

Every check in this guide runs on every upload.

Drop the file in and the problems described here are tested before anything is reported: with the rows behind each repair kept, so you can see exactly what changed.

  • Subtotal rows detected and excluded
  • Duplicates matched on identity, not on whole rows
  • Text-typed numbers found, coerced and counted

No account needed to start. You only pay when you like what you see.