← The collection

Ecological Fallacy.

Inspect individual cells before translating a district-level association into a personal claim.

Interactive experimentintuitiveField note ·
INTERACTIVE EXPERIMENT / P23

Ecological Fallacy

Inspect individual cells before translating a district-level association into a personal claim.

PLAY & EXPLAIN

Two fictional districts have different school-library access and exam pass rates. Both district summaries appear positively associated. Predict whether the same is true for individuals.

District-level summaries
DistrictLibrary accessOverall pass rate
A80%70%
B20%30%

The ecological fallacy is an inference across levels. These invented cells illustrate the problem; they do not claim libraries have no educational benefit.

Counts are stipulated illustrations, not evidence about libraries. Aggregate data can be informative with appropriate assumptions, but those assumptions are not supplied by a correlation alone.

THE SHORT VERSION

Ecological Fallacy, explained.

The ecological fallacy is an unsupported inference about individual relationships from relationships observed in aggregate groups.

01 / THE MECHANISM

Why it happens

Two districts differ in library access and passing rates. A detailed count ledger reveals equal pass rates for access and non-access groups within each district despite the positive aggregate association.

The ecological fallacy is an unsupported inference about individual relationships from relationships observed in aggregate groups.

Read the result

The district summaries describe groups. The detailed cells are required before making a claim about individuals within either district.

02 / FOLLOW IT THROUGH

A worked example

Unpack a district-level association

  1. Compare district A’s eighty-percent access and seventy-percent pass rate with B’s twenty and thirty percent.

  2. Reveal the access-by-passing cells separately within each district.

  3. Observe equal within-district pass rates for access and non-access groups without interpreting this example as a causal finding about libraries.

OPTIONAL DEEPER DETAILGo deeper: inside the model

Inside this model

Two districts differ in library access and passing rates. A detailed count ledger reveals equal pass rates for access and non-access groups within each district despite the positive aggregate association.

03 / BEYOND THE EXPERIMENT

Where this idea is useful

A practical use

Check the level of analysis before attributing a neighbourhood trend to every resident or a programme’s causal effect.

CHECK YOUR INTUITION

A common misconception

THE TEMPTING CONCLUSION

“A positive group-level association must hold within each group.”

THE MORE USEFUL DISTINCTION

Differences between groups can generate an aggregate pattern without the corresponding within-group relationship; the level of analysis matters.

What this explanation leaves out

  • Counts are stipulated illustrations, not evidence about libraries. Aggregate data can be informative with appropriate assumptions, but those assumptions are not supplied by a correlation alone.
ONE MORE QUESTION

Does this prove aggregate research is useless?

No. Aggregate data can answer group-level questions and support other inferences with justified assumptions; the unsupported level change is the problem.

TAKE THE IDEA WITH YOU

At which level were the observations collected and at which level is the conclusion being stated?

Associated thinkers

Associations marked provisional are awaiting source review.

Further reading

Explore the original research or the teaching reference behind this experiment.