Minimax theorem
- REDIRECTTemplate:Distinguish
Template:Rcatsh Template:Short description In the mathematical area of game theory and of convex optimization, a minimax theorem is a theorem that claims that
- <math>\max_{x\in X} \min_{y\in Y} f(x,y) = \min_{y\in Y} \max_{x\in X}f(x,y)</math>
under certain conditions on the sets <math>X</math> and <math>Y</math> and on the function <math>f</math>.<ref>Template:Citation</ref> It is always true that the left-hand side is at most the right-hand side (max–min inequality) but equality only holds under certain conditions identified by minimax theorems. The first theorem in this sense is von Neumann's minimax theorem about two-player zero-sum games published in 1928,<ref name=":0">Template:Cite journal</ref> which is considered the starting point of game theory. Von Neumann is quoted as saying "As far as I can see, there could be no theory of games ... without that theorem ... I thought there was nothing worth publishing until the Minimax Theorem was proved".<ref name="Casti">Template:Cite book</ref> Since then, several generalizations and alternative versions of von Neumann's original theorem have appeared in the literature.<ref>Template:Cite book</ref><ref>Template:Cite journal</ref>
Bilinear functions and zero-sum gamesEdit
Von Neumann's original theorem<ref name=":0" /> was motivated by game theory and applies to the case where
- <math>X</math> and <math>Y</math> are standard simplexes: <math display="inline">X = \{ (x_1, \dots, x_n) \in [0,1]^n : \sum_{i = 1}^n x_i = 1 \}
</math> and <math display="inline">Y = \{ (y_1, \dots, y_m) \in [0,1]^m : \sum_{j = 1}^m y_j = 1 \}</math>, and
- <math>f(x,y)</math> is a linear function in both of its arguments (that is, <math>f</math> is bilinear) and therefore can be written <math>f(x,y) = x^\mathsf{T} A y</math> for a finite matrix <math>A \in \mathbb{R}^{n \times m}</math>, or equivalently as <math display="inline">f(x,y) = \sum_{i=1}^n\sum_{j=1}^m A_{ij}x_iy_j</math>.
Under these assumptions, von Neumann proved that
- <math>\max_{x \in X} \min_{y \in Y} x^\mathsf{T} A y = \min_{y \in Y}\max_{x \in X} x^\mathsf{T} A y. </math>
In the context of two-player zero-sum games, the sets <math>X</math> and <math>Y</math> correspond to the strategy sets of the first and second player, respectively, which consist of lotteries over their actions (so-called mixed strategies), and their payoffs are defined by the payoff matrix <math>A</math>. The function <math>f(x,y)</math> encodes the expected value of the payoff to the first player when the first player plays the strategy <math>x</math> and the second player plays the strategy <math>y</math>.
Concave-convex functionsEdit
Von Neumann's minimax theorem can be generalized to domains that are compact and convex, and to functions that are concave in their first argument and convex in their second argument (known as concave-convex functions). Formally, let <math>X \subseteq \mathbb{R}^n</math> and <math>Y \subseteq \mathbb{R}^m</math> be compact convex sets. If <math>f: X \times Y \rightarrow \mathbb{R}</math> is a continuous function that is concave-convex, i.e.
- <math>f(\cdot,y): X \to \mathbb{R}</math> is concave for every fixed <math>y \in Y</math>, and
- <math>f(x,\cdot): Y \to \mathbb{R}</math> is convex for every fixed <math>x \in X</math>.
Then we have that
- <math>\max_{x\in X} \min_{y\in Y} f(x,y) = \min_{y\in Y} \max_{x\in X}f(x,y).</math>
Sion's minimax theoremEdit
Sion's minimax theorem is a generalization of von Neumann's minimax theorem due to Maurice Sion,<ref name=":1">Template:Cite journal</ref> relaxing the requirement that X and Y be standard simplexes and that f be bilinear. It states:<ref name=":1" /><ref>Template:Cite journal</ref>
Let <math>X</math> be a convex subset of a linear topological space and let <math>Y</math> be a compact convex subset of a linear topological space. If <math>f</math> is a real-valued function on <math>X\times Y</math> with
- <math>f(\cdot,y)</math> upper semicontinuous and quasi-concave on <math>X</math>, for every fixed <math>y\in Y</math>, and
- <math>f(x,\cdot)</math> lower semicontinuous and quasi-convex on <math>Y</math>, for every fixed <math>x\in X</math>.
Then we have that
- <math>\sup_{x\in X}\min_{y\in Y} f(x,y) = \min_{y\in Y}\sup_{x\in X} f(x,y). </math>
See alsoEdit
- Parthasarathy's theoremTemplate:Snda generalization of Von Neumann's minimax theorem
- Dual linear program can be used to prove the minimax theorem for zero-sum games.
- Yao's principleTemplate:Sndan application of the minimax theorem to computational complexity