Minimax theorem

Not to be confused with Min-max theorem.

In the mathematical area of game theory and of convex optimization, a minimax theorem is a theorem that claims that

$\underset{x\in X}{\max }\underset{y\in Y}{\min }f(x,y)=\underset{y\in Y}{\min }\underset{x\in X}{\max }f(x,y)$

under certain conditions on the sets $X$ and $Y$ and on the function $f$. It is always true that the left-hand side is at most the right-hand side (max–min inequality) but equality only holds under certain conditions identified by minimax theorems. The first theorem in this sense is von Neumann's minimax theorem about two-player zero-sum games published in 1928, which is considered the starting point of game theory. Von Neumann is quoted as saying "As far as I can see, there could be no theory of games ... without that theorem ... I thought there was nothing worth publishing until the Minimax Theorem was proved". Since then, several generalizations and alternative versions of von Neumann's original theorem have appeared in the literature.

Bilinear functions and zero-sum games

Von Neumann's original theorem was motivated by game theory and applies to the case where

• $X$ and $Y$ are standard simplexes: $X=\{(x_1,\dots ,x_n)\in [0,1{]}^n:{\sum }_{i=1}^n{x}_i=1\}$ and $Y=\{(y_1,\dots ,y_m)\in [0,1{]}^m:{\sum }_{j=1}^m{y}_j=1\}$, and
• $f(x,y)$ is a linear function in both of its arguments (that is, $f$ is bilinear) and therefore can be written $f(x,y)=x^{\mathsf{T}}Ay$ for a finite matrix $A\in {\mathbb{ℝ}}^{n\times m}$, or equivalently as $f(x,y)={\sum }_{i=1}^n{\sum }_{j=1}^m{A}_{ij}{x}_i{y}_j$.

Under these assumptions, von Neumann proved that

$\underset{x\in X}{\max }\underset{y\in Y}{\min }{x}^{\mathsf{T}}Ay=\underset{y\in Y}{\min }\underset{x\in X}{\max }{x}^{\mathsf{T}}Ay.$

In the context of two-player zero-sum games, the sets $X$ and $Y$ correspond to the strategy sets of the first and second player, respectively, which consist of lotteries over their actions (so-called mixed strategies), and their payoffs are defined by the payoff matrix $A$. The function $f(x,y)$ encodes the expected value of the payoff to the first player when the first player plays the strategy $x$ and the second player plays the strategy $y$.

Concave-convex functions

File:Saddle point.svg

The function f(x, y) = x² − y² is concave-convex.

Von Neumann's minimax theorem can be generalized to domains that are compact and convex, and to functions that are concave in their first argument and convex in their second argument (known as concave-convex functions). Formally, let $X\subseteq {\mathbb{ℝ}}^n$ and $Y\subseteq {\mathbb{ℝ}}^m$ be compact convex sets. If $f:X\times Y\to \mathbb{ℝ}$ is a continuous function that is concave-convex, i.e.

$f(\cdot ,y):X\to \mathbb{ℝ}$ is concave for every fixed $y\in Y$, and

$f(x,\cdot ):Y\to \mathbb{ℝ}$ is convex for every fixed $x\in X$.

Then we have that

$\underset{x\in X}{\max }\underset{y\in Y}{\min }f(x,y)=\underset{y\in Y}{\min }\underset{x\in X}{\max }f(x,y).$

Sion's minimax theorem

Sion's minimax theorem is a generalization of von Neumann's minimax theorem due to Maurice Sion, relaxing the requirement that It states: Let $X$ be a convex subset of a linear topological space and let $Y$ be a compact convex subset of a linear topological space. If $f$ is a real-valued function on $X\times Y$ with

$f(\cdot ,y)$ upper semicontinuous and quasi-concave on $X$, for every fixed $y\in Y$, and

$f(x,\cdot )$ lower semicontinuous and quasi-convex on $Y$, for every fixed $x\in X$.

Then we have that

$\underset{x\in X}{\sup }\underset{y\in Y}{\min }f(x,y)=\underset{y\in Y}{\min }\underset{x\in X}{\sup }f(x,y).$

See also

• Parthasarathy's theorem – a generalization of Von Neumann's minimax theorem
• Dual linear program can be used to prove the minimax theorem for zero-sum games.
• Yao's principle – an application of the minimax theorem to computational complexity