Skip to content

Kelly criterion

Posted on:

A bet pays even money and wins with probability p>1/2p > 1/2; the bet repeats indefinitely, and each round you may stake any fraction ff of your current bankroll. How much should you stake?

Expected value pulls toward recklessness. Each round multiplies the expected bankroll by 1+f(2p1)1 + f(2p - 1), increasing in ff, so expectation is maximized at f=1f = 1: stake everything, every round. But the all-in strategy loses the entire bankroll on the first lost bet, and with probability one some bet eventually loses. The strategy with the largest expected wealth is also the strategy that ends in ruin almost surely; the expectation is carried entirely by an exponentially unlikely streak of wins. Whatever “optimal” ought to mean for a repeated bet, this tension says the mean of the final wealth is the wrong summary to maximize.

The Kelly criterion is the resolution: maximize the expected logarithm of wealth, equivalently the long-run exponential growth rate. That choice is not arbitrary taste, it is the unique objective the law of large numbers itself picks out, and every quantity it produces has a closed form.

The growth rate of repeated bets

Let each round’s payoff odds be bb to 1 (stake 1, win bb or lose the stake; b=1b = 1 is even money), with win probability pp and q=1pq = 1 - p. Staking a fixed fraction f[0,1)f \in [0, 1) turns the bankroll into a product,

Wn=W0i=1n(1+fXi),Xi={+bwith probability p,1with probability q,W_n = W_0 \prod_{i=1}^{n} (1 + f X_i), \qquad X_i = \begin{cases} +b & \text{with probability } p, \\ -1 & \text{with probability } q, \end{cases}

and products are sums in the log:

1nlnWnW0=1ni=1nln(1+fXi)  na.s.  G(f)=pln(1+bf)+qln(1f),\frac{1}{n} \ln \frac{W_n}{W_0} = \frac{1}{n} \sum_{i=1}^{n} \ln(1 + f X_i) \;\xrightarrow[n \to \infty]{\text{a.s.}}\; G(f) = p \ln(1 + bf) + q \ln(1 - f),

by the strong law of large numbers. So WnW0enG(f)W_n \approx W_0\, e^{n G(f)} along almost every history: if G(f)>0G(f) > 0 the bankroll grows exponentially, if G(f)<0G(f) < 0 it decays exponentially, and this verdict is delivered by almost every sequence of outcomes, not by an average over them. The gap between the two summaries is volatility drag: the arithmetic mean of the factor 1+fX1 + fX can comfortably exceed 1 while its geometric mean, which is what compounds, sits below 1. The all-in strategy is the extreme case, G(1)=G(1) = -\infty.

The optimal fraction

GG is strictly concave in ff (each term is), so the unique maximizer comes from one derivative:

G(f)=pb1+bfq1f=0f=bpqb=pqb.G'(f) = \frac{pb}{1 + bf} - \frac{q}{1 - f} = 0 \quad\Longrightarrow\quad f^* = \frac{bp - q}{b} = p - \frac{q}{b}.

The numerator bpqbp - q is the expected profit per unit staked, the edge; the denominator is the odds. For even money the rule is starkly simple: f=pqf^* = p - q, stake your edge. A 55% coin at even odds gets 10% of the bankroll, no more.

At the optimum, the even-money growth rate collapses to an information-theoretic quantity:

G(f)=pln(2p)+qln(2q)=ln2H(p),G(f^*) = p \ln(2p) + q \ln(2q) = \ln 2 - H(p),

where H(p)=plnpqlnqH(p) = -p \ln p - q \ln q is the entropy of the coin in nats. For p=0.55p = 0.55: f=0.10f^* = 0.10 and G(f)=ln2H(0.55)0.0050G(f^*) = \ln 2 - H(0.55) \approx 0.0050 per bet, so the bankroll doubles about every ln2/0.0050138\ln 2 / 0.0050 \approx 138 bets. Everything in the widget is these formulas evaluated exactly:

win probability p = 55.0%
odds b = 1.0
f* = 10.0%growth per bet: 0.501%bets to double: 139
full Kelly f*half Kellytwice Kelly

Properties of the optimum

The shape of GG near its peak governs everything a practitioner cares about, and a quadratic approximation captures it cleanly. Since G(0)=0G(0) = 0 and GG is smooth and concave with its maximum at ff^*, writing G(f)G12G(f)(ff)2G(f) \approx G^* - \tfrac{1}{2}\,|G''(f^*)|\,(f - f^*)^2 and evaluating at f=0f = 0 ties the curvature to the peak: G12G(f)f2G^* \approx \tfrac{1}{2}|G''(f^*)|\,f^{*2}. Staking a multiple cc of the Kelly fraction then gives

G(cf)    c(2c)  G.G(c f^*) \;\approx\; c\,(2 - c)\; G^*.

Two readings of this parabola do most of the practical work:

The asymmetry matters: underbetting by a factor costs a fraction of the growth rate, overbetting by the same factor can flip its sign, and GG \to -\infty as f1f \to 1. Every practical error (an overestimated pp, a correlated sequence of bets) lands on the overbetting side, which is the argument usually given for staking a deliberate fraction of ff^*.

Even at the exact optimum, the ride is rough, and the roughness has a closed form. In the diffusion limit, log-wealth under a fraction cc of Kelly is a Brownian motion with drift ν=(cc2/2)σ2\nu = (c - c^2/2)\sigma^2 and variance rate c2σ2c^2\sigma^2; the process W2ν/(cσ)2W^{-2\nu/(c\sigma)^2} is then an exponential martingale, and optional stopping at the first passage to a fraction x<1x < 1 of the starting bankroll gives

P(ever drop to fraction x)=x2/c1.\mathbb{P}\bigl(\text{ever drop to fraction } x\bigr) = x^{\,2/c - 1}.

At full Kelly (c=1c = 1) the exponent is 1: the probability of ever losing half the bankroll is exactly 1/21/2, and of ever being down 90% is 1/101/10. At half Kelly the exponent is 3, and the halving probability falls to 1/81/8. Deep drawdowns under full Kelly are not misfortune; they are a computable property of the optimum.

The information connection

Kelly’s 1956 paper did not frame any of this as gambling advice. His gambler receives tips about the outcome over a noisy channel, and the question is what a rate of RR bits per bet is worth. For even-money bets where the tip is correct with probability pp, the optimal growth rate derived above,

G=ln2H(p),G^* = \ln 2 - H(p),

is precisely the capacity of the binary symmetric channel with error probability qq (in nats per use). The general theorem, in Cover and Thomas’s chapter on gambling: with fair odds, side information YY about the outcome XX raises the achievable growth rate by exactly the mutual information I(X;Y)I(X; Y). Information has a monetary exchange rate, and it is the Shannon quantity: a gambler’s capital, optimally compounded, doubles once per bit of information about the outcomes. Kelly’s title, “a new interpretation of information rate,” was meant literally: this is capacity showing up in a setting with no codes and no messages, six years after Shannon’s theory and one floor away from Shannon himself at Bell Labs.

The scope of the argument

What is actually proved is worth stating carefully, because the criterion attracts overclaims in both directions. Breiman’s 1961 theorems: among all betting strategies, log-optimal betting achieves the maximal almost-sure exponential growth rate, asymptotically outgrows any strategy that deviates from it infinitely often, and minimizes the expected number of bets to reach a distant wealth target. Those are statements about growth, and they are as strong as they sound.

What is not proved is that anyone must want maximal growth. An investor maximizing expected utility for a utility function other than the logarithm will bet differently at every horizon, and no long-run argument dissolves that; the expectation-versus-growth tension from the opening does not force the log, it only rules out the raw mean. This is Samuelson’s objection, pressed across several papers, one of them written entirely in words of one syllable to make the point that the fallacy is elementary. The criterion is best read the way Breiman proved it and Thorp used it: not as the correct objective, but as the sharp upper boundary of aggressive play, the stake beyond which more risk buys less growth, with closed-form penalties on either side.

A little history

The logarithm as a utility for multiplicative wealth is much older than information theory: Daniel Bernoulli proposed it in 1738 to resolve the St. Petersburg paradox. Kelly’s contribution, at Bell Labs in 1956, was the growth-rate theorem and the identification with channel capacity; Breiman supplied the rigorous asymptotic optimality results in 1961. Edward Thorp carried the criterion into practice, first for blackjack bet sizing in Beat the Dealer (1962), the book that forced casinos to change their rules, and later in convertible-bond arbitrage, where the same sizing logic ran a hedge fund for two decades. Samuelson’s critiques (1971, 1979) fixed the criterion’s proper scope. The result is a rare trajectory: a theorem born as an interpretation of Shannon’s capacity, road-tested at casino tables, and still the standard vocabulary (“full Kelly”, “half Kelly”) for position sizing arguments.

References



Next Post
German tank problem