Zipf’s Law, explained.
Zipf's Law describes a rank-frequency pattern in which frequency is approximately inversely proportional to rank, famously observed in word usage.
Why it happens
Ordering items by frequency reveals a steep head and a long tail. With exponent one, the second-ranked item has roughly half the frequency of the first, and the tenth about one tenth. Other exponents give different levels of concentration.
Rank-frequency patterns can be highly uneven without a sharp cutoff.
Read the result
Adjust the exponent and compare the ranked curve. The rank plot summarizes frequency differences; it does not identify a single mechanism that must have produced them.
A worked example
Common words and a long tail
A vocabulary dataset is sorted from the most common word to the least common.
Under an ideal exponent-one pattern, a first-ranked frequency of 1,000 corresponds to about 500 at rank two and 100 at rank ten.
Many rare words can collectively matter even when each one contributes very little.
OPTIONAL DEEPER DETAILGo deeper: inside the model
Inside this model
Twenty ranks receive weights proportional to 1/r^s, normalized to 100%. The plot displays their relative frequencies as the exponent changes.
Where this idea is useful
A practical use
Examine why a few words appear far more often than most others in a text corpus.
A common misconception
“A Zipf-like curve proves one universal cause.”
Different processes can generate similar ranked patterns. A visual fit is a starting point for investigation, not a causal explanation.
What this explanation leaves out
- The exponent varies by data set and range; a good-looking rank plot alone does not establish a universal law.
How does this differ from the Pareto idea?
Zipf emphasizes frequencies ordered by rank. Pareto usually describes a tail distribution of values. They are related under particular assumptions but are not interchangeable measurements.
Does the long tail matter collectively even when its individual entries seem negligible?
Associated thinkers
Further reading
Explore the original research or the teaching reference behind this experiment.