Equipment rolls off a production line carrying serial numbers , and is a secret. You capture of the units, drawn at random from the whole run rather than in production order, look at their serials, and want to estimate . This is the German tank problem, named for its most consequential application, and it is a small parade of estimation theory: the obvious estimator is provably bad, the good one has a two-line derivation, and there is a theorem saying nothing better exists.
Model the capture as a uniform random sample of distinct serials from , and write for the largest serial observed. Intuition already says carries the information: knowing the smaller serials tells you about the layout below the maximum, not about how far the line continues above it. (The formal version: is a sufficient statistic for , meaning the conditional distribution of the rest of the sample given does not involve .) The maximum-likelihood estimate is itself: among all values of , the sample in hand is most probable when , since larger spreads probability over more possible samples. But always. An estimator that can never overshoot must undershoot on average, and the interesting question is by how much, and what to add back.
The distribution of the maximum
All subsets are equally likely. The maximum equals exactly when the subset contains and its other elements come from :
The expectation comes out of the hockey-stick identity, , which counts the -subsets of by their largest element. Using ,
So the maximum sits, on average, a fraction of the way up: five captured tanks put near , and using as the estimate is systematically 17% short.
The gap estimator
The correction has a derivation that needs no algebra at all. The observed serials cut into gaps of unobserved serials: the run below the smallest observation, the runs between consecutive observations, and the run above the maximum. By symmetry the gap lengths are exchangeable (relabeling the line from the top renumbers the gaps but not the sampling), so each gap has the same expected length, .
The one gap you cannot see the end of is the run above , and its expected length matches the gaps you can see. Below and including the maximum there are unobserved serials spread over gaps, an average of per gap. Extend the line above the maximum by one average gap:
The expectation computed above certifies the guess: , exactly unbiased. And this is not merely one good estimator among many: is a complete sufficient statistic for this family, so by the Lehmann–Scheffé theorem, is the unique minimum-variance unbiased estimator; the analysis goes back to Goodman’s 1952 paper. Concretely: four captured tanks with a highest serial of 60 give , where maximum likelihood would have said 60.
The variance
A second pass through the hockey-stick identity, applied to , yields the exact variance, and hence
The standard error is roughly . That is worth staring at: estimators built from averages improve like , and this one improves like , because an extreme order statistic hugs the boundary it estimates far more tightly than any average does. The comparison can be made exact. The estimator , twice the sample mean minus one, is also unbiased for , and a standard finite-population computation gives it variance . The ratio of variances is about : with twelve captured tanks, the maximum-based estimator is four times as precise, and the advantage keeps growing with every capture.
In the four-tanks example, the standard error attached to is : two dozen tanks of uncertainty, from four serial numbers.
The Bayesian version
Treating as the unknown in a posterior needs only one identity. Given , the observed sample has probability for every , so under a flat prior the posterior is proportional to . The telescoping identity
collapses the normalizing sum to (the prior is improper, but the posterior is proper as soon as ), and the tail probabilities inherit the same closed form:
The posterior has a power-law tail with exponent : heavy for small samples, and in fact the posterior mean is infinite for . For it exists and is again closed-form,
For the running example (, ): posterior mean , noticeably above the unbiased 74 because of that heavy tail, and . A production run twice the highest observed serial is a live possibility at ; it takes more captures, not more cleverness, to rule it out.
All four numbers, for any and , from the closed forms above:
The historical record
During the Second World War, analysts in the Economic Warfare Division of the American embassy in London, working with British counterparts, estimated German war production from the markings on captured and destroyed equipment: serial numbers and maker’s codes on gearboxes, chassis, engines, and tyre moulds. Their post-war account (Ruggles and Brodie, 1947) includes the comparison that made the method famous. Monthly German tank production, three ways:
| Month | Serial-number estimate | Conventional intelligence | German records |
|---|---|---|---|
| June 1940 | 169 | 1000 | 122 |
| June 1941 | 244 | 1550 | 271 |
| August 1942 | 327 | 1550 | 342 |
Conventional intelligence, extrapolating from prewar industrial capacity and relying on reports and rumor, overestimated production by factors of four to six. The serial-number estimates landed within about 10% in two of the three months and within 40% in the worst one, using arithmetic a page long. The postwar audit of Speer-ministry records is the rare case where an estimator meets its ground truth decades ahead of declassification.
The practice was messier than the model. Serial numbers did not always start at 1, several factories numbered in separate blocks, and some sequences had deliberate gaps; a large part of the actual work in Ruggles and Brodie is reconstructing the numbering scheme before any formula applies. The estimator itself is indifferent to the application, and the same arithmetic applies whenever sequential identifiers leak: invoice numbers, database row IDs, order numbers on receipts. Issuing sequential serial numbers in public is a quiet way of publishing your production figures.
References
- Richard Ruggles, Henry Brodie. An empirical approach to economic intelligence in World War II. Journal of the American Statistical Association, 42(237):72–91, 1947. The wartime method and the postwar comparison table.
- Leo A. Goodman. Serial number analysis. Journal of the American Statistical Association, 47(259):622–634, 1952. The estimation theory: unbiasedness, variance, and optimality.
- E. L. Lehmann, George Casella. Theory of Point Estimation. 2nd edition, Springer, 1998. Sufficiency, completeness, and the Lehmann–Scheffé theorem used above.
- Roger W. Johnson. Estimating the size of a population. Teaching Statistics, 16(2):50–52, 1994. A clean expository treatment comparing the candidate estimators.