Saddle Point

Chapter 7 · begins on page 269

Decisions in Time

Clock back to it on the cover

The models

Each model in the book is stated on one card: who decides, when, with what information and commitment, what they get, what they may do, and the question it answers.

Model D1 · p. 292

Who can be where first, and what does that geometry decide?

Model D1 · Chapter 7 · page 292

Who can be where first, and what does that geometry decide?

Guarding a target; Model D1


1Decision-makers
evader and guard
2Time
continuous; the game ends at capture or at the target
3Information
both observe both positions; the guard also responds to the evader's current velocity
4Commitment
none
5Payoffs
zero-sum: the guard receives , the evader ( the capture distance to the target; distance on non-terminating plays)
6Strategies
evader: open-loop paths suffice; guard: nonanticipative rules responding to the evader's current velocity (the mirror rule). A positional version of the guard's guarantee (Krasovskii–Subbotin) is not proved here

The analysis contract

(i) concept
value as the common guarantee of the two players (saddle point, Theorem 0.7 (p. 8))
(ii) deviations
arbitrary measurable motions of either player at unit speed
(iii) beliefs
none needed
(iv) selection
none
(v) attainment
attained by straight paths to one point; distances certified in exact squared arithmetic on a rational grid
In the book: Chapter 7, Decisions in Time, page 292

Model D2 · p. 295

What is one period of foresight worth, and how is an infinite horizon certified?

Model D2 · Chapter 7 · page 295

What is one period of foresight worth, and how is an infinite horizon certified?

Graph pursuit; Model D2


1Decision-makers
pursuer and evader
2Time
discrete periods; horizon or discounted
3Information
both see the state (both positions); the current move is hidden (simultaneous), seen by the evader first, or seen by the pursuer first
4Commitment
none
5Payoffs
zero-sum: periods survived
6Strategies
behaviour rules from the state (and the observed move, where allowed) to mixtures over moves

The analysis contract

(i) concept
value of the zero-sum stochastic game (Theorem 0.17 (p. 18))
(ii) deviations
all behaviour rules
(iii) beliefs
none needed (public state)
(iv) selection
none
(v) attainment
finite horizons: exact, every stage matrix solved and verified; discounted: a certified rational enclosure of width below
In the book: Chapter 7, Decisions in Time, page 295

Model D3 · p. 297

When is concentration worth a whole army, and when is it worth nothing?

Model D3 · Chapter 7 · page 297

When is concentration worth a whole army, and when is it worth nothing?

Two laws of attrition; Model D3


1Decision-makers
one planner selecting a deployment schedule (combined or in parts); attrition within each engagement is deterministic
2Time
continuous within a battle; battles in sequence
3Information
complete
4Commitment
none
5Payoffs
survivors of the final battle
6Strategies
fight the parts in sequence, or the whole at once

The analysis contract

(i) concept
closed-form outcomes from conserved quantities
(ii) deviations
the stated alternatives
(iii) beliefs
none
(iv) selection
none
(v) attainment
exact: the invariants are polynomial identities in the vector fields; survivors computed in exact squared units
In the book: Chapter 7, Decisions in Time, page 297

Model D4 · p. 299

What does the fight over a fixed prize cost, and who gets the prize's value?

Model D4 · Chapter 7 · page 299

What does the fight over a fixed prize cost, and who gets the prize's value?

Discrete war of attrition; Model D4


1Decision-makers
two contestants
2Time
discrete periods, unbounded (and a lapsing-prize finite variant)
3Information
complete; actions observed each period
4Commitment
none: quitting is always available, so no threat to fight for ever is binding
5Payoffs
the prize to the last one standing, minus accumulated fighting costs; no discounting
6Strategies
behaviour rules; the stationary and the pure equilibria are analysed

The analysis contract

(i) concept
Nash equilibrium (stationary mixed; and the pure asymmetric profiles)
(ii) deviations
one-shot deviations plus the stationarity argument; finite-horizon backward induction agrees
(iii) beliefs
none needed
(iv) selection
all three equilibria of the stated classes are reported; none is selected
(v) attainment
exact
In the book: Chapter 7, Decisions in Time, page 299

Model D5 · p. 300

From which starts can the follower close the gap by whatever the leader does, and which lever moves the closing date?

Model D5 · Chapter 7 · page 300

From which starts can the follower close the gap by whatever the leader does, and which lever moves the closing date?

A capacity race; Model D5


1Decision-makers
a leader and a follower
2Time
discrete periods; a deadline
3Information
both capacities public; the current build hidden (simultaneous), or seen first by one side
4Commitment
none
5Payoffs
zero-sum: to the follower if the gap reaches by
6Strategies
behaviour rules from the date and both capacities (and the observed build, where allowed) to builds, randomised rules included

The analysis contract

(i) concept
value of the zero-sum game; the follower's bridge is the set of starts of value (Theorem 0.17 (p. 18))
(ii) deviations
all behaviour rules of either side
(iii) beliefs
none needed (public state)
(iv) selection
none
(v) attainment
exact: closed forms in rational arithmetic; the value checked by exhaustive backward induction at a set of starts under all three information patterns
In the book: Chapter 7, Decisions in Time, page 300

What is proved, in words

The book follows each result with one sentence that says what it means without symbols. The formal statement is a click away; the proofs are in the book.

Proposition 7.2 · The bisector decides · p. 293

With equal speeds the line of equal arrival times decides the game before anyone moves: the evader can be caught no closer to the target than the target's distance from the evader's side, and the guard can enforce exactly that with a nonanticipative rule; if the evader is never caught, the payoff is the limit inferior of its distance.

Proposition 7.2 · Chapter 7 · page 293

The bisector decides

In words With equal speeds the line of equal arrival times decides the game before anyone moves: the evader can be caught no closer to the target than the target's distance from the evader's side, and the guard can enforce exactly that with a nonanticipative rule; if the evader is never caught, the payoff is the limit inferior of its distance.


Let be the closed half-plane of points no farther from than from (boundary: the perpendicular bisector ). The value of the game is the distance from to : for it is exactly , attained at the foot , which both players reach in the same time ; for it is .

The proof is in the book: Chapter 7, Decisions in Time, page 293

Proposition 7.6 · The exact price of seeing the current move · p. 295

Seeing the opponent's current move is worth a computable amount: from the centre it decides between never being caught and being caught at once, and the simultaneous game lies between.

Proposition 7.6 · Chapter 7 · page 295

The exact price of seeing the current move

In words Seeing the opponent's current move is worth a computable amount: from the centre it decides between never being caught and being caught at once, and the simultaneous game lies between.


At every state and horizon the three values are ordered: pursuer-sees-first simultaneous evader-sees-first (checked exactly for all states and ). From the start with the pursuer at the centre and the evader on the rim: an evader that sees the pursuer's move first is never caught (value ); a pursuer that sees the evader's move first captures at once (value ); the simultaneous value is for one period, for two, and for ten. From opposite rim nodes the ten-period simultaneous value is .

The proof is in the book: Chapter 7, Decisions in Time, page 295

Proposition 7.7 · A certified enclosure of the discounted value · p. 296

An infinite-horizon value can be certified in finitely many exact steps: iterating from a lower and an upper start squeezes it into a rational interval whose width bound halves with every step at .

Proposition 7.7 · Chapter 7 · page 296

A certified enclosure of the discounted value

In words An infinite-horizon value can be certified in finitely many exact steps: iterating from a lower and an upper start squeezes it into a rational interval whose width bound halves with every step at .


Let be the one-period (Shapley) operator of the simultaneous discounted game. is monotone and a -contraction, so iterating from the exact bounds and gives monotone rational sequences with and . At , after iterations, the value from opposite rim nodes lies in and from the centre start in ; the width bound is checked on the exact rationals.

The proof is in the book: Chapter 7, Decisions in Time, page 296

Proposition 7.10 · Invariants, concentration, quality · p. 298

Under the aimed-fire equations fighting strength grows with the square of numbers, so in the chapter's example meeting an enemy in parts loses what a combined force wins; under the unaimed-fire equations splitting makes no difference — both statements about the model, not empirical laws.

Proposition 7.10 · Chapter 7 · page 298

Invariants, concentration, quality

In words Under the aimed-fire equations fighting strength grows with the square of numbers, so in the chapter's example meeting an enemy in parts loses what a combined force wins; under the unaimed-fire equations splitting makes no difference — both statements about the model, not empirical laws.


Along the square law, is constant; along the linear law, is constant (both are polynomial identities in the vector fields, checked exactly). Consequences, at : an attacker of destroys defenders of and met in sequence at the price of its own annihilation — survive the first battle and annihilate exactly against the second — while the combined defence of wins with survivors. Under the linear law the same numbers give the defenders survivors whether split or combined. With (each unit of four times as effective), of defeat of with exactly survivors, and draw against exactly : effectiveness enters the square law linearly, numbers quadratically.

The proof is in the book: Chapter 7, Decisions in Time, page 298

Proposition 7.12 · Full dissipation · p. 299

When two sides contest a fixed prize by paying to stay, the symmetric mixed equilibrium consumes the whole expected prize in fighting costs, and a richer prize enriches no one.

Proposition 7.12 · Chapter 7 · page 299

Full dissipation

In words When two sides contest a fixed prize by paying to stay, the symmetric mixed equilibrium consumes the whole expected prize in fighting costs, and a richer prize enriches no one.


In the stationary symmetric equilibrium each player quits each period with probability , and each player's expected payoff is . The standoff continues each period with probability and lasts periods in expectation; the prize is eventually won with probability , worth in expectation, and the two players' expected fighting costs total exactly : the contest dissipates the entire expected prize. With a finite horizon and a lapsing prize, backward induction gives the same in every period if the interior mixed equilibrium is selected at every stage; it is not the only backward-induction solution. With positive and there are exactly three stationary equilibria: the mixed one and two pure ones in which one player fights for ever and the other quits at once, with payoffs . The pure equilibria need no external commitment device — they are equilibria of expectations — whereas both quitting at once (either would gain by staying) and both fighting for ever (unbounded costs against for leaving) are not equilibria. In the asymmetric variant the stationary mixed equilibrium has , and still gives both players : a larger prize does not raise its holder's equilibrium value, and the rival quits less often ( against ), since its exit rate is what keeps the richer side indifferent.

The proof is in the book: Chapter 7, Decisions in Time, page 299

The worked case

A parallax in history

1922 · Chapter 7 · p. 288

The agreement already knew it needed data

Then

Santa Fe, 1922: an apportionment by annual totals, with the annual flow to be ascertained and published

Now

2026: guidelines that adjust releases within the year to hold an elevation (Exercise 7.1 (p. 290))

1922 · Chapter 7 · page 288

The agreement already knew it needed data

Then

Santa Fe, 1922: an apportionment by annual totals, with the annual flow to be ascertained and published

Now

2026: guidelines that adjust releases within the year to hold an elevation (Exercise 7.1 (p. 290))


What happened

The Colorado River Compact was signed at Santa Fe on 24 November 1922. It apportions to the Upper Basin and to the Lower Basin, in perpetuity, the exclusive beneficial consumptive use of acre-feet of water a year each (Art. III(a)); and it fixes the dividing point, Lee Ferry, one mile below the mouth of the Paria River (Art. II). Article V directs the chief water-rights official of each signatory state, together with the Directors of the Reclamation Service and of the Geological Survey, to cooperate ex officio “to promote the systematic determination and co-ordination of the facts as to flow, appropriation, consumption and use of water” and “the interchange of available information in such matters”, and “to secure the ascertainment and publication of the annual flow of the Colorado River at Lee Ferry” D [Colorado River Compact 1922, Arts. II, III(a), V, the compact text as ratified in Arizona].

The model

Field 3 of Model D5's card (“both capacities are observed before every move”) and the worked case's lesson that the gap is not the state. An apportionment is a number on an annual total; whether a path of releases that honours it is feasible is a condition on the stock at every date (Exercise 7.1 (p. 290)); and neither can be checked without the measured flow. Article V is the compact's provision for observing the state. What it requires to be published is the annual flow at Lee Ferry; it does not fix how often the river is gauged or how quickly a decision can respond to what is measured R.

What could be known

In 1922 the figure the compact required to be published was a yearly total, and the apportionment itself is stated in annual totals; how often anyone could observe the river and act on it is not settled by the text. The operating guidelines of August 2026 (the situation above) fix an elevation to be held, adjust releases through the spring to hold it and set the year's volume in April from the winter's observations: a rule contingent on information arriving inside the year. What the guidelines add is a rule written to be contingent on observations within the year; the resource has not grown, and the water-balance equation does not say whose claim yields when the measured flow falls short of the apportioned totals. That was an institutional decision in 1922 and is one in 2026 R.

Where the parallel stops

The compact is one instrument among the many that govern the river; deliveries to Mexico under the treaty of 1944 and obligations to the tribes are separate; the parties are several states, not a leader and a follower; and no number of the compact enters Model D5 or the exercise.

In the book: Chapter 7, page 288All sixteen parallaxes on the timeline →

The people

Chapter 7 · Decisions in Time

Rufus Isaacs

1914 – 1981

Mathematician who received his doctorate from Columbia University. At the RAND Corporation in the early 1950s he founded the theory of differential games and developed it systematically in a series of research memoranda — pursuit and evasion, the Main Equation now read as the Hamilton–Jacobi–Isaacs equation, dominance regions, and worked examples such as the homicidal chauffeur and the guarding of a territory — published a decade later as a book. He later worked in industry and defence analysis and taught at Johns Hopkins University.

The life, in moments →

Main works

  • Differential Games (1965)
  • the RAND research memoranda Differential Games I–IV (1954–55)

Chapter 7 · Decisions in Time

Frederick W. Lanchester

1868 – 1946

English engineer. He built one of the first British petrol motor cars and founded the Lanchester Engine Company, and his two-volume Aerial Flight developed the circulation theory of lift. In Aircraft in Warfare (1916) he proposed the differential equations of attrition now named after him and derived the -square law, the quantitative case for concentration. M. Osipov published a closely related analysis independently in a Russian military journal in 1915.

The life, in moments →

Main works

  • Aerial Flight (1907–08)
  • Aircraft in Warfare: The Dawn of the Fourth Arm (1916)

Chapter 7 · Decisions in Time

Nikolai N. Krasovskii

1924 – 2012

Mathematician in Sverdlovsk, now Yekaterinburg, at the Ural Polytechnic Institute, the Ural State University and the Institute of Mathematics and Mechanics of the Academy of Sciences' Ural branch, which he directed from 1970 to 1977 and which now bears his name. He worked first on the stability of motion, extending Lyapunov's methods, and then built the theory of positional differential games: strategies as feedback rules, the extremal-shift aiming rule, and the alternative theorem on stable bridges, with A. I. Subbotin.

The life, in moments →

Main works

  • Stability of Motion (Russian 1959; English 1963)
  • Positional Differential Games, with A. I. Subbotin (in Russian, Nauka, 1974; revised English edition, Game-Theoretical Control Problems, Springer, 1988)

Chapter 7 · Decisions in Time

Lev S. Pontryagin

1908 – 1988

Mathematician at the Steklov Institute in Moscow, blind from the age of fourteen. He first worked in topology — duality theorems, topological groups, characteristic classes — and from the 1950s turned to control, leading the group whose maximum principle became the foundation of optimal control theory; he later developed linear differential games of pursuit and evasion, pursuing the subject independently of Isaacs' line.

The life, in moments →

Main works

  • Topological Groups (1938)
  • The Mathematical Theory of Optimal Processes, with V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko (Russian 1961; English 1962)
  • “Linear differential games of pursuit” (in Russian, Matematicheskii Sbornik, 1980)