Skip to content

No account required

Start a project

6 min · 4 sections

Six ways a chart misleads without containing a false number.

Almost every misleading chart contains only true numbers. The misleading part is the encoding.

By Data Analysis App team

How can I tell if a chart is misleading?

Check six things. Whether bars start at zero, since bars encode length and a cut axis makes a small difference look enormous. Whether the final period is complete. What the denominator of any rate is. Whether categories are sorted by value or by nothing. Whether a dual axis has been positioned to make two lines cross. And whether the sample behind any percentage is large enough to quote as one.

Section 01

Bars must start at zero. Lines need not.

This is the rule people half-remember, and the half they drop is the important one. Bars encode value as length, so a bar starting at forty encodes a length corresponding to nothing, and the ratio between two such bars is arbitrary.

A line chart is about change rather than magnitude, so a non-zero baseline is legitimate, but a heavily truncated one converts a two per cent move into a visual collapse, and the reader's impression is set by the shape rather than by the labels.

The honest test: if the point is that a change is small, does the chart let it look small?

Section 02

The partial final period

Month-to-date plotted against complete months is how a chart most often shows a collapse that is not happening. The line falls off a cliff on the last point and the cliff is the calendar.

It is also the easiest to do by accident, because the data is correct and nobody has done anything dishonest. Look at the last point on every time series and ask whether that period has finished.

If the final period must be included, it should be drawn differently from the rest and labelled with how far through it is.

Section 03

Denominators, ordering and dual axes

A rate of forty per cent means nothing without knowing forty per cent of what. Rates are where charts mislead most often, because the numerator is usually obvious and the denominator usually is not.

Alphabetical ordering of categories wastes the chart's most valuable dimension on information the reader already has. Sorting by value is what turns a lookup table into a finding, and its absence is often a sign nobody looked at the chart analytically.

Two series on two different axes can be made to cross wherever the author likes, simply by choosing the two ranges. There is no correct scaling, which is the argument against dual axes generally: any relationship the chart appears to show is a property of the axis choice.

Section 04

Percentages of very small groups

Below about thirty observations, one member moves the rate by more than most real effects. A segment of twenty-four people reported as a percentage invites a comparison that the sample cannot support.

Counts are less satisfying and more honest, and they make the sample size impossible to overlook, which is usually why the percentage was chosen instead.

See it on a real project

Contractor spend rose $412,000 while headcount spend fell $448,000, leaving only a $4,000 net change.

What actually changed between these budget versions?

Keep reading

Every check in this guide runs on every upload.

Drop the file in and the problems described here are tested before anything is reported: with the rows behind each repair kept, so you can see exactly what changed.

  • Subtotal rows detected and excluded
  • Duplicates matched on identity, not on whole rows
  • Text-typed numbers found, coerced and counted

No account needed to start. You only pay when you like what you see.