Why two dashboards give different numbers for the same thing.
Two people are usually both right about a number, and disagreeing about which number it is.
- Read5 min
- Sections4
Why do two reports show different numbers for the same metric?
Almost always a definition rather than a bug. The four usual causes are a different filter, such as one report excluding cancelled orders; a different date basis, such as order date against ship date; a different timezone, which moves everything near midnight; and a different refresh time. Compare the definitions before comparing the numbers.
01
Where should you start when two dashboards disagree?
Write down, in one sentence each, what the two reports think they are measuring. In most cases the disagreement resolves here, before anybody opens a query.
Revenue is the classic example: booked, invoiced, collected, and net of refunds are four different numbers, all correctly called revenue by somebody.
If the definitions match, the next thing to compare is the filters, and specifically the ones nobody wrote down: excluded test accounts, an internal customer, a region that migrated systems last year.
The fastest diagnostic is to reconcile a single day rather than the whole period. The cause is usually visible immediately.
02
Could the two reports be using different date bases?
Order date, ship date, invoice date and payment date all produce plausible and different monthly totals from the same transactions. Any report that does not say which it uses is one of the two reports in this argument.
Timezone moves everything that happened near midnight into a different day, and at month boundaries that becomes a different month. It is a small effect that produces persistent, unexplainable differences of a few tenths of a per cent, which is exactly the size that wastes the most time.
03
Could refresh time and late-arriving data explain the gap?
A report built at nine and one built at five are looking at different data, and if either caches, the difference persists after both appear to have updated.
Late-arriving rows compound this. Refunds, adjustments and corrections attach to earlier periods, so a figure for last month legitimately changes for weeks afterwards. A report that says when it was computed removes most of this class of argument permanently.
04
Should you change the report, or the definition?
The instinct once the cause is found is to change one report to match the other. That is usually the wrong repair, because it leaves two definitions in the organisation and one of them now silently mirrors the other.
Write the definition down where both reports can reference it, decide which one is correct for which audience, and let them differ openly if they genuinely should. Finance and operations often need different revenue figures, and the problem was never that the numbers differed — it was that nobody could say why.
See it on a real project
Contractor spend rose $412,000 while headcount spend fell $448,000, leaving only a $4,000 net change.
What actually changed between these budget versions?Related
Try it on your own file.
Every check described here runs automatically, and your first findings arrive in full before you pay for any of it.
No account needed to start. You only pay when you like what you see.