Skip to content

No account required

Start a project

Six ways a chart misleads without containing a false number.

Almost every misleading chart contains only true numbers. The misleading part is the encoding.

  • Read6 min
  • Sections4

How can I tell if a chart is misleading?

Check six things. Whether bars start at zero, since bars encode length and a cut axis makes a small difference look enormous. Whether the final period is complete. What the denominator of any rate is. Whether categories are sorted by value or by nothing. Whether a dual axis has been positioned to make two lines cross. And whether the sample behind any percentage is large enough to quote as one.

01

Bars must start at zero. Lines need not.

This is the rule people half-remember, and the half they drop is the important one. Bars encode value as length, so a bar starting at forty encodes a length corresponding to nothing, and the ratio between two such bars is arbitrary.

A line chart is about change rather than magnitude, so a non-zero baseline is legitimate — but a heavily truncated one converts a two per cent move into a visual collapse, and the reader's impression is set by the shape rather than by the labels.

The honest test: if the point is that a change is small, does the chart let it look small?

02

The partial final period

Month-to-date plotted against complete months is the single most common way a chart shows a collapse that is not happening. The line falls off a cliff on the last point and the cliff is the calendar.

It is also the easiest to do by accident, because the data is correct and nobody has done anything dishonest. Look at the last point on every time series and ask whether that period has finished.

If the final period must be included, it should be drawn differently from the rest and labelled with how far through it is.

03

Denominators, ordering and dual axes

A rate of forty per cent means nothing without knowing forty per cent of what. Rates are where charts mislead most often, because the numerator is usually obvious and the denominator usually is not.

Alphabetical ordering of categories wastes the chart's most valuable dimension on information the reader already has. Sorting by value is what turns a lookup table into a finding, and its absence is often a sign nobody looked at the chart analytically.

Two series on two different axes can be made to cross wherever the author likes, simply by choosing the two ranges. There is no correct scaling, which is the argument against dual axes generally: any relationship the chart appears to show is a property of the axis choice.

04

Percentages of very small groups

Below about thirty observations, one member moves the rate by more than most real effects. A segment of twenty-four people reported as a percentage invites a comparison that the sample cannot support.

Counts are less satisfying and more honest, and they make the sample size impossible to overlook — which is usually why the percentage was chosen instead.

See it on a real project

Contractor spend rose $412,000 while headcount spend fell $448,000, leaving only a $4,000 net change.

What actually changed between these budget versions?

Related

Try it on your own file.

Every check described here runs automatically, and your first findings arrive in full before you pay for any of it.

No account needed to start. You only pay when you like what you see.