Hahn–Banach theorem: Difference between revisions

From The Right Wiki
Jump to navigationJump to search
imported>Linearoperator
m Fixed grammatical typo
 
imported>Linearoperator
m Fixed grammatical typo
 
(No difference)

Latest revision as of 14:21, 19 April 2024

The Hahn–Banach theorem is a central tool in functional analysis. It allows the extension of bounded linear functionals defined on a vector subspace of some vector space to the whole space, and it also shows that there are "enough" continuous linear functionals defined on every normed vector space to make the study of the dual space "interesting". Another version of the Hahn–Banach theorem is known as the Hahn–Banach separation theorem or the hyperplane separation theorem, and has numerous uses in convex geometry.

History

The theorem is named for the mathematicians Hans Hahn and Stefan Banach, who proved it independently in the late 1920s. The special case of the theorem for the space C[a,b] of continuous functions on an interval was proved earlier (in 1912) by Eduard Helly,[1] and a more general extension theorem, the M. Riesz extension theorem, from which the Hahn–Banach theorem can be derived, was proved in 1923 by Marcel Riesz.[2] The first Hahn–Banach theorem was proved by Eduard Helly in 1912 who showed that certain linear functionals defined on a subspace of a certain type of normed space () had an extension of the same norm. Helly did this through the technique of first proving that a one-dimensional extension exists (where the linear functional has its domain extended by one dimension) and then using induction. In 1927, Hahn defined general Banach spaces and used Helly's technique to prove a norm-preserving version of Hahn–Banach theorem for Banach spaces (where a bounded linear functional on a subspace has a bounded linear extension of the same norm to the whole space). In 1929, Banach, who was unaware of Hahn's result, generalized it by replacing the norm-preserving version with the dominated extension version that uses sublinear functions. Whereas Helly's proof used mathematical induction, Hahn and Banach both used transfinite induction.[3] The Hahn–Banach theorem arose from attempts to solve infinite systems of linear equations. This is needed to solve problems such as the moment problem, whereby given all the potential moments of a function one must determine if a function having these moments exists, and, if so, find it in terms of those moments. Another such problem is the Fourier cosine series problem, whereby given all the potential Fourier cosine coefficients one must determine if a function having those coefficients exists, and, again, find it if so. Riesz and Helly solved the problem for certain classes of spaces (such as Lp([0,1]) and C([a,b])) where they discovered that the existence of a solution was equivalent to the existence and continuity of certain linear functionals. In effect, they needed to solve the following problem:[3]

(The vector problem) Given a collection (fi)iI of bounded linear functionals on a normed space X and a collection of scalars (ci)iI, determine if there is an xX such that fi(x)=ci for all iI.

If X happens to be a reflexive space then to solve the vector problem, it suffices to solve the following dual problem:[3]

(The functional problem) Given a collection (xi)iI of vectors in a normed space X and a collection of scalars (ci)iI, determine if there is a bounded linear functional f on X such that f(xi)=ci for all iI.

Riesz went on to define Lp([0,1]) space (1<p<) in 1910 and the p spaces in 1913. While investigating these spaces he proved a special case of the Hahn–Banach theorem. Helly also proved a special case of the Hahn–Banach theorem in 1912. In 1910, Riesz solved the functional problem for some specific spaces and in 1912, Helly solved it for a more general class of spaces. It wasn't until 1932 that Banach, in one of the first important applications of the Hahn–Banach theorem, solved the general functional problem. The following theorem states the general functional problem and characterizes its solution.[3]

Theorem[3] (The functional problem) — Let (xi)iI be vectors in a real or complex normed space X and let (ci)iI be scalars also indexed by I. There exists a continuous linear functional f on X such that f(xi)=ci for all iI if and only if there exists a K>0 such that for any choice of scalars (si)iI where all but finitely many si are 0, the following holds: |iIsici|KiIsixi.

The Hahn–Banach theorem can be deduced from the above theorem.[3] If X is reflexive then this theorem solves the vector problem.

Hahn–Banach theorem

A real-valued function f:M defined on a subset M of X is said to be dominated (above) by a function p:X if f(m)p(m) for every mM. Hence the reason why the following version of the Hahn–Banach theorem is called the dominated extension theorem.

Hahn–Banach dominated extension theorem (for real linear functionals)[4][5][6] — If p:X is a sublinear function (such as a norm or seminorm for example) defined on a real vector space X then any linear functional defined on a vector subspace of X that is dominated above by p has at least one linear extension to all of X that is also dominated above by p. Explicitly, if p:X is a sublinear function, which by definition means that it satisfies p(x+y)p(x)+p(y) and p(tx)=tp(x) for all x,yX and all real t0, and if f:M is a linear functional defined on a vector subspace M of X such that f(m)p(m) for all mM then there exists a linear functional F:X such that F(m)=f(m) for all mM, F(x)p(x) for all xX. Moreover, if p is a seminorm then |F(x)|p(x) necessarily holds for all xX.

The theorem remains true if the requirements on p are relaxed to require only that p be a convex function:[7][8] p(tx+(1t)y)tp(x)+(1t)p(y) for all 0<t<1 and x,yX. A function p:X is convex and satisfies p(0)0 if and only if p(ax+by)ap(x)+bp(y) for all vectors x,yX and all non-negative real a,b0 such that a+b1. Every sublinear function is a convex function. On the other hand, if p:X is convex with p(0)0, then the function defined by p0(x)=definft>0p(tx)t is positively homogeneous (because for all x and r>0 one has p0(rx)=inft>0p(trx)t)=rinft>0p(trx)tr=rinfτ>0p(τx)τ=rp0(x)), hence, being convex, it is sublinear. It is also bounded above by p0p, and satisfies Fp0 for every linear functional Fp. So the extension of the Hahn–Banach theorem to convex functionals does not have a much larger content than the classical one stated for sublinear functionals. If F:X is linear then Fp if and only if[4] p(x)F(x)p(x) for all xX, which is the (equivalent) conclusion that some authors[4] write instead of Fp. It follows that if p:X is also symmetric, meaning that p(x)=p(x) holds for all xX, then Fp if and only |F|p. Every norm is a seminorm and both are symmetric balanced sublinear functions. A sublinear function is a seminorm if and only if it is a balanced function. On a real vector space (although not on a complex vector space), a sublinear function is a seminorm if and only if it is symmetric. The identity function on X:= is an example of a sublinear function that is not a seminorm.

For complex or real vector spaces

The dominated extension theorem for real linear functionals implies the following alternative statement of the Hahn–Banach theorem that can be applied to linear functionals on real or complex vector spaces.

Hahn–Banach theorem[3][9] — Suppose p:X a seminorm on a vector space X over the field K, which is either or . If f:MK is a linear functional on a vector subspace M such that |f(m)|p(m) for all mM, then there exists a linear functional F:XK such that F(m)=f(m) for all mM, |F(x)|p(x) for all xX.

The theorem remains true if the requirements on p are relaxed to require only that for all x,yX and all scalars a and b satisfying |a|+|b|1,[8] p(ax+by)|a|p(x)+|b|p(y). This condition holds if and only if p is a convex and balanced function satisfying p(0)0, or equivalently, if and only if it is convex, satisfies p(0)0, and p(ux)p(x) for all xX and all unit length scalars u. A complex-valued functional F is said to be dominated by p if |F(x)|p(x) for all x in the domain of F. With this terminology, the above statements of the Hahn–Banach theorem can be restated more succinctly:

Hahn–Banach dominated extension theorem: If p:X is a seminorm defined on a real or complex vector space X, then every dominated linear functional defined on a vector subspace of X has a dominated linear extension to all of X. In the case where X is a real vector space and p:X is merely a convex or sublinear function, this conclusion will remain true if both instances of "dominated" (meaning |F|p) are weakened to instead mean "dominated above" (meaning Fp).[7][8]

Proof The following observations allow the Hahn–Banach theorem for real vector spaces to be applied to (complex-valued) linear functionals on complex vector spaces. Every linear functional F:X on a complex vector space is completely determined by its real part ReF:X through the formula[6][proof 1] F(x)=ReF(x)iReF(ix) for all xX and moreover, if is a norm on X then their dual norms are equal: F=ReF.[10] In particular, a linear functional on X extends another one defined on MX if and only if their real parts are equal on M (in other words, a linear functional F extends f if and only if ReF extends Ref). The real part of a linear functional on X is always a real-linear functional (meaning that it is linear when X is considered as a real vector space) and if R:X is a real-linear functional on a complex vector space then xR(x)iR(ix) defines the unique linear functional on X whose real part is R. If F is a linear functional on a (complex or real) vector space X and if p:X is a seminorm then[6][proof 2] |F|p if and only if ReFp. Stated in simpler language, a linear functional is dominated by a seminorm p if and only if its real part is dominated above by p.

Proof of Hahn–Banach for complex vector spaces by reduction to real vector spaces[3]

Suppose p:X is a seminorm on a complex vector space X and let f:M be a linear functional defined on a vector subspace M of X that satisfies |f|p on M. Consider X as a real vector space and apply the Hahn–Banach theorem for real vector spaces to the real-linear functional Ref:M to obtain a real-linear extension R:X that is also dominated above by p, so that it satisfies Rp on X and R=Ref on M. The map F:X defined by F(x)=R(x)iR(ix) is a linear functional on X that extends f (because their real parts agree on M) and satisfies |F|p on X (because ReFp and p is a seminorm).

The proof above shows that when p is a seminorm then there is a one-to-one correspondence between dominated linear extensions of f:M and dominated real-linear extensions of Ref:M; the proof even gives a formula for explicitly constructing a linear extension of f from any given real-linear extension of its real part. Continuity A linear functional F on a topological vector space is continuous if and only if this is true of its real part ReF; if the domain is a normed space then F=ReF (where one side is infinite if and only if the other side is infinite).[10] Assume X is a topological vector space and p:X is sublinear function. If p is a continuous sublinear function that dominates a linear functional F then F is necessarily continuous.[6] Moreover, a linear functional F is continuous if and only if its absolute value |F| (which is a seminorm that dominates F) is continuous.[6] In particular, a linear functional is continuous if and only if it is dominated by some continuous sublinear function.

Proof

The Hahn–Banach theorem for real vector spaces ultimately follows from Helly's initial result for the special case where the linear functional is extended from M to a larger vector space in which M has codimension 1.[3]

Lemma[6] (One–dimensional dominated extension theorem) — Let p:X be a sublinear function on a real vector space X, let f:M a linear functional on a proper vector subspace MX such that fp on M (meaning f(m)p(m) for all mM), and let xX be a vector not in M (so Mx=span{M,x}). There exists a linear extension F:Mx of f such that Fp on Mx.

Proof[6]

Given any real number b, the map Fb:Mx defined by Fb(m+rx)=f(m)+rb is always a linear extension of f to Mx[note 1] but it might not satisfy Fbp. It will be shown that b can always be chosen so as to guarantee that Fbp, which will complete the proof. If m,nM then f(m)f(n)=f(mn)p(mn)=p(m+xxn)p(m+x)+p(xn) which implies p(nx)f(n)p(m+x)f(m). So define a=supnM[p(nx)f(n)] and c=infmM[p(m+x)f(m)] where ac are real numbers. To guarantee Fbp, it suffices that abc (in fact, this is also necessary[note 2]) because then b satisfies "the decisive inequality"[6] p(nx)f(n)bp(m+x)f(m) for all m,nM. To see that f(m)+rbp(m+rx) follows,[note 3] assume r0 and substitute 1rm in for both m and n to obtain p(1rmx)1rf(m)bp(1rm+x)1rf(m). If r>0 (respectively, if r<0) then the right (respectively, the left) hand side equals 1r[p(m+rx)f(m)] so that multiplying by r gives rbp(m+rx)f(m).

This lemma remains true if p:X is merely a convex function instead of a sublinear function.[7][8]

Proof

Assume that p is convex, which means that p(ty+(1t)z)tp(y)+(1t)p(z) for all 0t1 and y,zX. Let M, f:M, and xXM be as in the lemma's statement. Given any m,nM and any positive real r,s>0, the positive real numbers t:=sr+s and rr+s=1t sum to 1 so that the convexity of p on X guarantees p(sr+sm+rr+sn)=p(sr+s(mrx)+rr+s(n+sx))sr+sp(mrx)+rr+sp(n+sx) and hence sf(m)+rf(n)=(r+s)f(sr+sm+rr+sn) by linearity of f(r+s)p(sr+sm+rr+sn)fp on Msp(mrx)+rp(n+sx) thus proving that sp(mrx)+sf(m)rp(n+sx)rf(n), which after multiplying both sides by 1rs becomes 1r[p(mrx)+f(m)]1s[p(n+sx)f(n)]. This implies that the values defined by a=supr>0mM1r[p(mrx)+f(m)] and c=infs>0nM1s[p(n+sx)f(n)] are real numbers that satisfy ac. As in the above proof of the one–dimensional dominated extension theorem above, for any real b define Fb:Mx by Fb(m+rx)=f(m)+rb. It can be verified that if abc then Fbp where rbp(m+rx)f(m) follows from bc when r>0 (respectively, follows from ab when r<0).

The lemma above is the key step in deducing the dominated extension theorem from Zorn's lemma.

Proof of dominated extension theorem using Zorn's lemma

The set of all possible dominated linear extensions of f are partially ordered by extension of each other, so there is a maximal extension F. By the codimension-1 result, if F is not defined on all of X, then it can be further extended. Thus F must be defined everywhere, as claimed.

When M has countable codimension, then using induction and the lemma completes the proof of the Hahn–Banach theorem. The standard proof of the general case uses Zorn's lemma although the strictly weaker ultrafilter lemma[11] (which is equivalent to the compactness theorem and to the Boolean prime ideal theorem) may be used instead. Hahn–Banach can also be proved using Tychonoff's theorem for compact Hausdorff spaces[12] (which is also equivalent to the ultrafilter lemma) The Mizar project has completely formalized and automatically checked the proof of the Hahn–Banach theorem in the HAHNBAN file.[13]

Continuous extension theorem

The Hahn–Banach theorem can be used to guarantee the existence of continuous linear extensions of continuous linear functionals.

Hahn–Banach continuous extension theorem[14] — Every continuous linear functional f defined on a vector subspace M of a (real or complex) locally convex topological vector space X has a continuous linear extension F to all of X. If in addition X is a normed space, then this extension can be chosen so that its dual norm is equal to that of f.

In category-theoretic terms, the underlying field of the vector space is an injective object in the category of locally convex vector spaces. On a normed (or seminormed) space, a linear extension F of a bounded linear functional f is said to be norm-preserving if it has the same dual norm as the original functional: F=f. Because of this terminology, the second part of the above theorem is sometimes referred to as the "norm-preserving" version of the Hahn–Banach theorem.[15] Explicitly:

Norm-preserving Hahn–Banach continuous extension theorem[15] — Every continuous linear functional f defined on a vector subspace M of a (real or complex) normed space X has a continuous linear extension F to all of X that satisfies f=F.

Proof of the continuous extension theorem

The following observations allow the continuous extension theorem to be deduced from the Hahn–Banach theorem.[16] The absolute value of a linear functional is always a seminorm. A linear functional F on a topological vector space X is continuous if and only if its absolute value |F| is continuous, which happens if and only if there exists a continuous seminorm p on X such that |F|p on the domain of F.[17] If X is a locally convex space then this statement remains true when the linear functional F is defined on a proper vector subspace of X.

Proof of the continuous extension theorem for locally convex spaces[16]

Let f be a continuous linear functional defined on a vector subspace M of a locally convex topological vector space X. Because X is locally convex, there exists a continuous seminorm p:X on X that dominates f (meaning that |f(m)|p(m) for all mM). By the Hahn–Banach theorem, there exists a linear extension of f to X, call it F, that satisfies |F|p on X. This linear functional F is continuous since |F|p and p is a continuous seminorm.

Proof for normed spaces A linear functional f on a normed space is continuous if and only if it is bounded, which means that its dual norm f=sup{|f(m)|:m1,mdomainf} is finite, in which case |f(m)|fm holds for every point m in its domain. Moreover, if c0 is such that |f(m)|cm for all m in the functional's domain, then necessarily fc. If F is a linear extension of a linear functional f then their dual norms always satisfy fF[proof 3] so that equality f=F is equivalent to Ff, which holds if and only if |F(x)|fx for every point x in the extension's domain. This can be restated in terms of the function f:X defined by xfx, which is always a seminorm:[note 4]

A linear extension of a bounded linear functional f is norm-preserving if and only if the extension is dominated by the seminorm f.

Applying the Hahn–Banach theorem to f with this seminorm f thus produces a dominated linear extension whose norm is (necessarily) equal to that of f, which proves the theorem:

Proof of the norm-preserving Hahn–Banach continuous extension theorem[15]

Let f be a continuous linear functional defined on a vector subspace M of a normed space X. Then the function p:X defined by p(x)=fx is a seminorm on X that dominates f, meaning that |f(m)|p(m) holds for every mM. By the Hahn–Banach theorem, there exists a linear functional F on X that extends f (which guarantees fF) and that is also dominated by p, meaning that |F(x)|p(x) for every xX. The fact that f is a real number such that |F(x)|fx for every xX, guarantees Ff. Since F=f is finite, the linear functional F is bounded and thus continuous.

Non-locally convex spaces

The continuous extension theorem might fail if the topological vector space (TVS) X is not locally convex. For example, for 0<p<1, the Lebesgue space Lp([0,1]) is a complete metrizable TVS (an F-space) that is not locally convex (in fact, its only convex open subsets are itself Lp([0,1]) and the empty set) and the only continuous linear functional on Lp([0,1]) is the constant 0 function (Rudin 1991, §1.47). Since Lp([0,1]) is Hausdorff, every finite-dimensional vector subspace MLp([0,1]) is linearly homeomorphic to Euclidean space dimM or dimM (by F. Riesz's theorem) and so every non-zero linear functional f on M is continuous but none has a continuous linear extension to all of Lp([0,1]). However, it is possible for a TVS X to not be locally convex but nevertheless have enough continuous linear functionals that its continuous dual space X* separates points; for such a TVS, a continuous linear functional defined on a vector subspace might have a continuous linear extension to the whole space. If the TVS X is not locally convex then there might not exist any continuous seminorm p:X defined on X (not just on M) that dominates f, in which case the Hahn–Banach theorem can not be applied as it was in the above proof of the continuous extension theorem. However, the proof's argument can be generalized to give a characterization of when a continuous linear functional has a continuous linear extension: If X is any TVS (not necessarily locally convex), then a continuous linear functional f defined on a vector subspace M has a continuous linear extension F to all of X if and only if there exists some continuous seminorm p on X that dominates f. Specifically, if given a continuous linear extension F then p:=|F| is a continuous seminorm on X that dominates f; and conversely, if given a continuous seminorm p:X on X that dominates f then any dominated linear extension of f to X (the existence of which is guaranteed by the Hahn–Banach theorem) will be a continuous linear extension.

Geometric Hahn–Banach (the Hahn–Banach separation theorems)

The key element of the Hahn–Banach theorem is fundamentally a result about the separation of two convex sets: {p(xn)f(n):nM}, and {p(m+x)f(m):mM}. This sort of argument appears widely in convex geometry,[18] optimization theory, and economics. Lemmas to this end derived from the original Hahn–Banach theorem are known as the Hahn–Banach separation theorems.[19][20] They are generalizations of the hyperplane separation theorem, which states that two disjoint nonempty convex subsets of a finite-dimensional space n can be separated by some affine hyperplane, which is a fiber (level set) of the form f1(s)={x:f(x)=s} where f0 is a non-zero linear functional and s is a scalar.

Theorem[19] — Let A and B be non-empty convex subsets of a real locally convex topological vector space X. If IntA and BIntA= then there exists a continuous linear functional f on X such that supf(A)inff(B) and f(a)<inff(B) for all aIntA (such an f is necessarily non-zero).

When the convex sets have additional properties, such as being open or compact for example, then the conclusion can be substantially strengthened:

Theorem[3][21] — Let A and B be convex non-empty disjoint subsets of a real topological vector space X.

  • If A is open then A and B are separated by a closed hyperplane. Explicitly, this means that there exists a continuous linear map f:XK and s such that f(a)<sf(b) for all aA,bB. If both A and B are open then the right-hand side may be taken strict as well.
  • If X is locally convex, A is compact, and B closed, then A and B are strictly separated: there exists a continuous linear map f:XK and s,t such that f(a)<t<s<f(b) for all aA,bB.

If X is complex (rather than real) then the same claims hold, but for the real part of f.

Then following important corollary is known as the Geometric Hahn–Banach theorem or Mazur's theorem (also known as Ascoli–Mazur theorem[22]). It follows from the first bullet above and the convexity of M.

Theorem (Mazur)[23] — Let M be a vector subspace of the topological vector space X and suppose K is a non-empty convex open subset of X with KM=. Then there is a closed hyperplane (codimension-1 vector subspace) NX that contains M, but remains disjoint from K.

Mazur's theorem clarifies that vector subspaces (even those that are not closed) can be characterized by linear functionals.

Corollary[24] (Separation of a subspace and an open convex set) — Let M be a vector subspace of a locally convex topological vector space X, and U be a non-empty open convex subset disjoint from M. Then there exists a continuous linear functional f on X such that f(m)=0 for all mM and Ref>0 on U.

Supporting hyperplanes

Since points are trivially convex, geometric Hahn–Banach implies that functionals can detect the boundary of a set. In particular, let X be a real topological vector space and AX be convex with IntA. If a0AIntA then there is a functional that is vanishing at a0, but supported on the interior of A.[19] Call a normed space X smooth if at each point x in its unit ball there exists a unique closed hyperplane to the unit ball at x. Köthe showed in 1983 that a normed space is smooth at a point x if and only if the norm is Gateaux differentiable at that point.[3]

Balanced or disked neighborhoods

Let U be a convex balanced neighborhood of the origin in a locally convex topological vector space X and suppose xX is not an element of U. Then there exists a continuous linear functional f on X such that[3] sup|f(U)||f(x)|.

Applications

The Hahn–Banach theorem is the first sign of an important philosophy in functional analysis: to understand a space, one should understand its continuous functionals. For example, linear subspaces are characterized by functionals: if X is a normed vector space with linear subspace M (not necessarily closed) and if z is an element of X not in the closure of M, then there exists a continuous linear map f:XK with f(m)=0 for all mM, f(z)=1, and f=dist(z,M)1. (To see this, note that dist(,M) is a sublinear function.) Moreover, if z is an element of X, then there exists a continuous linear map f:XK such that f(z)=z and f1. This implies that the natural injection J from a normed space X into its double dual V** is isometric. That last result also suggests that the Hahn–Banach theorem can often be used to locate a "nicer" topology in which to work. For example, many results in functional analysis assume that a space is Hausdorff or locally convex. However, suppose X is a topological vector space, not necessarily Hausdorff or locally convex, but with a nonempty, proper, convex, open set M. Then geometric Hahn–Banach implies that there is a hyperplane separating M from any other point. In particular, there must exist a nonzero functional on X — that is, the continuous dual space X* is non-trivial.[3][25] Considering X with the weak topology induced by X*, then X becomes locally convex; by the second bullet of geometric Hahn–Banach, the weak topology on this new space separates points. Thus X with this weak topology becomes Hausdorff. This sometimes allows some results from locally convex topological vector spaces to be applied to non-Hausdorff and non-locally convex spaces.

Partial differential equations

The Hahn–Banach theorem is often useful when one wishes to apply the method of a priori estimates. Suppose that we wish to solve the linear differential equation Pu=f for u, with f given in some Banach space X. If we have control on the size of u in terms of fX and we can think of u as a bounded linear functional on some suitable space of test functions g, then we can view f as a linear functional by adjunction: (f,g)=(u,P*g). At first, this functional is only defined on the image of P, but using the Hahn–Banach theorem, we can try to extend it to the entire codomain X. The resulting functional is often defined to be a weak solution to the equation.

Characterizing reflexive Banach spaces

Theorem[26] — A real Banach space is reflexive if and only if every pair of non-empty disjoint closed convex subsets, one of which is bounded, can be strictly separated by a hyperplane.

Example from Fredholm theory

To illustrate an actual application of the Hahn–Banach theorem, we will now prove a result that follows almost entirely from the Hahn–Banach theorem.

Proposition — Suppose X is a Hausdorff locally convex TVS over the field K and Y is a vector subspace of X that is TVS–isomorphic to KI for some set I. Then Y is a closed and complemented vector subspace of X.

Proof

Since KI is a complete TVS so is Y, and since any complete subset of a Hausdorff TVS is closed, Y is a closed subset of X. Let f=(fi)iI:YKI be a TVS isomorphism, so that each fi:YK is a continuous surjective linear functional. By the Hahn–Banach theorem, we may extend each fi to a continuous linear functional Fi:XK on X. Let F:=(Fi)iI:XKI so F is a continuous linear surjection such that its restriction to Y is F|Y=(Fi|Y)iI=(fi)iI=f. Let P:=f1F:XY, which is a continuous linear map whose restriction to Y is P|Y=f1F|Y=f1f=1Y, where 𝟙Y denotes the identity map on Y. This shows that P is a continuous linear projection onto Y (that is, PP=P). Thus Y is complemented in X and X=YkerP in the category of TVSs.

The above result may be used to show that every closed vector subspace of is complemented because any such space is either finite dimensional or else TVS–isomorphic to .

Generalizations

General template There are now many other versions of the Hahn–Banach theorem. The general template for the various versions of the Hahn–Banach theorem presented in this article is as follows:

p:X is a sublinear function (possibly a seminorm) on a vector space X, M is a vector subspace of X (possibly closed), and f is a linear functional on M satisfying |f|p on M (and possibly some other conditions). One then concludes that there exists a linear extension F of f to X such that |F|p on X (possibly with additional properties).

Theorem[3] — If D is an absorbing disk in a real or complex vector space X and if f be a linear functional defined on a vector subspace M of X such that |f|1 on MD, then there exists a linear functional F on X extending f such that |F|1 on D.

For seminorms

Hahn–Banach theorem for seminorms[27][28] — If p:M is a seminorm defined on a vector subspace M of X, and if q:X is a seminorm on X such that pq|M, then there exists a seminorm P:X on X such that P|M=p on M and Pq on X.

Proof of the Hahn–Banach theorem for seminorms

Let S be the convex hull of {mM:p(m)1}{xX:q(x)1}. Because S is an absorbing disk in X, its Minkowski functional P is a seminorm. Then p=P on M and Pq on X.

So for example, suppose that f is a bounded linear functional defined on a vector subspace M of a normed space X, so its the operator norm f is a non-negative real number. Then the linear functional's absolute value p:=|f| is a seminorm on M and the map q:X defined by q(x)=fx is a seminorm on X that satisfies pq|M on M. The Hahn–Banach theorem for seminorms guarantees the existence of a seminorm P:X that is equal to |f| on M (since P|M=p=|f|) and is bounded above by P(x)fx everywhere on X (since Pq).

Geometric separation

Hahn–Banach sandwich theorem[3] — Let p:X be a sublinear function on a real vector space X, let SX be any subset of X, and let f:S be any map. If there exist positive real numbers a and b such that 0infsS[p(saxby)f(s)af(x)bf(y)] for all x,yS, then there exists a linear functional F:X on X such that Fp on X and fFp on S.

Maximal dominated linear extension

Theorem[3] (Andenaes, 1970) — Let p:X be a sublinear function on a real vector space X, let f:M be a linear functional on a vector subspace M of X such that fp on M, and let SX be any subset of X. Then there exists a linear functional F:X on X that extends f, satisfies Fp on X, and is (pointwise) maximal on S in the following sense: if F^:X is a linear functional on X that extends f and satisfies F^p on X, then FF^ on S implies F=F^ on S.

If S={s} is a singleton set (where sX is some vector) and if F:X is such a maximal dominated linear extension of f:M, then F(s)=infmM[f(s)+p(sm)].[3]

Vector valued Hahn–Banach

Vector–valued Hahn–Banach theorem[3] — If X and Y are vector spaces over the same field and if f:MY is a linear map defined on a vector subspace M of X, then there exists a linear map F:XY that extends f.

Invariant Hahn–Banach

A set Γ of maps XX is commutative (with respect to function composition ) if FG=GF for all F,GΓ. Say that a function f defined on a subset M of X is Γ-invariant if L(M)M and fL=f on M for every LΓ.

An invariant Hahn–Banach theorem[29] — Suppose Γ is a commutative set of continuous linear maps from a normed space X into itself and let f be a continuous linear functional defined some vector subspace M of X that is Γ-invariant, which means that L(M)M and fL=f on M for every LΓ. Then f has a continuous linear extension F to all of X that has the same operator norm f=F and is also Γ-invariant, meaning that FL=F on X for every LΓ.

This theorem may be summarized:

Every Γ-invariant continuous linear functional defined on a vector subspace of a normed space X has a Γ-invariant Hahn–Banach extension to all of X.[29]

For nonlinear functions

The following theorem of Mazur–Orlicz (1953) is equivalent to the Hahn–Banach theorem.

Mazur–Orlicz theorem[3] — Let p:X be a sublinear function on a real or complex vector space X, let T be any set, and let R:T and v:TX be any maps. The following statements are equivalent:

  1. there exists a real-valued linear functional F on X such that Fp on X and RFv on T;
  2. for any finite sequence s1,,sn of n>0 non-negative real numbers, and any sequence t1,,tnT of elements of T, i=1nsiR(ti)p(i=1nsiv(ti)).

The following theorem characterizes when any scalar function on X (not necessarily linear) has a continuous linear extension to all of X.

Theorem (The extension principle[30]) — Let f a scalar-valued function on a subset S of a topological vector space X. Then there exists a continuous linear functional F on X extending f if and only if there exists a continuous seminorm p on X such that |i=1naif(si)|p(i=1naisi) for all positive integers n and all finite sequences a1,,an of scalars and elements s1,,sn of S.

Converse

Let X be a topological vector space. A vector subspace M of X has the extension property if any continuous linear functional on M can be extended to a continuous linear functional on X, and we say that X has the Hahn–Banach extension property (HBEP) if every vector subspace of X has the extension property.[31] The Hahn–Banach theorem guarantees that every Hausdorff locally convex space has the HBEP. For complete metrizable topological vector spaces there is a converse, due to Kalton: every complete metrizable TVS with the Hahn–Banach extension property is locally convex.[31] On the other hand, a vector space X of uncountable dimension, endowed with the finest vector topology, then this is a topological vector spaces with the Hahn–Banach extension property that is neither locally convex nor metrizable.[31] A vector subspace M of a TVS X has the separation property if for every element of X such that x∉M, there exists a continuous linear functional f on X such that f(x)0 and f(m)=0 for all mM. Clearly, the continuous dual space of a TVS X separates points on X if and only if {0}, has the separation property. In 1992, Kakol proved that any infinite dimensional vector space X, there exist TVS-topologies on X that do not have the HBEP despite having enough continuous linear functionals for the continuous dual space to separate points on X. However, if X is a TVS then every vector subspace of X has the extension property if and only if every vector subspace of X has the separation property.[31]

Relation to axiom of choice and other theorems

The proof of the Hahn–Banach theorem for real vector spaces (HB) commonly uses Zorn's lemma, which in the axiomatic framework of Zermelo–Fraenkel set theory (ZF) is equivalent to the axiom of choice (AC). It was discovered by Łoś and Ryll-Nardzewski[12] and independently by Luxemburg[11] that HB can be proved using the ultrafilter lemma (UL), which is equivalent (under ZF) to the Boolean prime ideal theorem (BPI). BPI is strictly weaker than the axiom of choice and it was later shown that HB is strictly weaker than BPI.[32] The ultrafilter lemma is equivalent (under ZF) to the Banach–Alaoglu theorem,[33] which is another foundational theorem in functional analysis. Although the Banach–Alaoglu theorem implies HB,[34] it is not equivalent to it (said differently, the Banach–Alaoglu theorem is strictly stronger than HB). However, HB is equivalent to a certain weakened version of the Banach–Alaoglu theorem for normed spaces.[35] The Hahn–Banach theorem is also equivalent to the following statement:[36]

(∗): On every Boolean algebra B there exists a "probability charge", that is: a non-constant finitely additive map from B into [0,1].

(BPI is equivalent to the statement that there are always non-constant probability charges which take only the values 0 and 1.) In ZF, the Hahn–Banach theorem suffices to derive the existence of a non-Lebesgue measurable set.[37] Moreover, the Hahn–Banach theorem implies the Banach–Tarski paradox.[38] For separable Banach spaces, D. K. Brown and S. G. Simpson proved that the Hahn–Banach theorem follows from WKL0, a weak subsystem of second-order arithmetic that takes a form of Kőnig's lemma restricted to binary trees as an axiom. In fact, they prove that under a weak set of assumptions, the two are equivalent, an example of reverse mathematics.[39][40]

See also

Notes

  1. This definition means, for instance, that Fb(x)=Fb(0+1x)=f(0)+1b=b and if mM then Fb(m)=Fb(m+0x)=f(m)+0b=f(m). In fact, if G:Mx is any linear extension of f to Mx then G=Fb for b:=G(x). In other words, every linear extension of f to Mx is of the form Fb for some (unique) b.
  2. Explicitly, for any real number b, Fbp on Mx if and only if abc. Combined with the fact that Fb(x)=b, it follows that the dominated linear extension of f to Mx is unique if and only if a=c, in which case this scalar will be the extension's values at x. Since every linear extension of f to Mx is of the form Fb for some b, the bounds ab=Fb(x)c thus also limit the range of possible values (at x) that can be taken by any of f's dominated linear extensions. Specifically, if F:X is any linear extension of f satisfying Fp then for every xXM, supmM[p(mx)f(m)]F(x)infmM[p(m+x)f(m)].
  3. Geometric illustration: The geometric idea of the above proof can be fully presented in the case of X=2,M={(x,0):x}. First, define the simple-minded extension f0(x,y)=f(x), It doesn't work, since maybe f0p. But it is a step in the right direction. pf0 is still convex, and pf0ff0. Further, ff0 is identically zero on the x-axis. Thus we have reduced to the case of f=0,p0 on the x-axis. If p0 on 2, then we are done. Otherwise, pick some v2, such that p(v)<0. The idea now is to perform a simultaneous bounding of p on v+M and v+M such that pb on v+M and pb on v+M, then defining f~(w+rv)=rb would give the desired extension. Since v+M,v+M are on opposite sides of M, and p<0 at some point on v+M, by convexity of p, we must have p0 on all points on v+M. Thus infuv+Mp(u) is finite. Geometrically, this works because {z:p(z)<0} is a convex set that is disjoint from M, and thus must lie entirely on one side of M. Define b=infuv+Mp(u). This satisfies pb on v+M. It remains to check the other side. For all v+wv+M, convexity implies that for all v+wv+M,p(v+w)+p(v+w)2p((w+w)/2)=0, thus p(v+w)supuv+Mp(u)=b. Since during the proof, we only used convexity of p, we see that the lemma remains true for merely convex p.
  4. Like every non-negative scalar multiple of a norm, this seminorm f (the product of the non-negative real number f with the norm ) is a norm when f is positive, although this fact is not needed for the proof.

Proofs

  1. If z=a+ib has real part Rez=a then Re(iz)=b, which proves that z=ReziRe(iz). Substituting F(x) in for z and using iF(x)=F(ix) gives F(x)=ReF(x)iReF(ix).
  2. Let F be any homogeneous scalar-valued map on X (such as a linear functional) and let p:X be any map that satisfies p(ux)=p(x) for all x and unit length scalars u (such as a seminorm). If |F|p then ReF|ReF||F|p. For the converse, assume ReFp and fix xX. Let r=|F(x)| and pick any θ such that F(x)=reiθ; it remains to show rp(x). Homogeneity of F implies F(eiθx)=r is real so that ReF(eiθx)=F(eiθx). By assumption, ReFp and p(eiθx)=p(x), so that r=ReF(eiθx)p(eiθx)=p(x), as desired.
  3. The map F being an extension of f means that domainfdomainF and F(m)=f(m) for every mdomainf. Consequently, {|f(m)|:m1,mdomainf}={|F(m)|:m1,mdomainf}{|F(x)|:x1,xdomainF} and so the supremum of the set on the left hand side, which is f, does not exceed the supremum of the right hand side, which is F. In other words, fF.

References

  1. O'Connor, John J.; Robertson, Edmund F., "Hahn–Banach theorem", MacTutor History of Mathematics Archive, University of St Andrews
  2. See M. Riesz extension theorem. According to Gårding, L. (1970). "Marcel Riesz in memoriam". Acta Math. 124 (1): I–XI. doi:10.1007/bf02394565. MR 0256837., the argument was known to Riesz already in 1918.
  3. 3.00 3.01 3.02 3.03 3.04 3.05 3.06 3.07 3.08 3.09 3.10 3.11 3.12 3.13 3.14 3.15 3.16 3.17 3.18 Narici & Beckenstein 2011, pp. 177–220.
  4. 4.0 4.1 4.2 Rudin 1991, pp. 56–62.
  5. Rudin 1991, Th. 3.2
  6. 6.0 6.1 6.2 6.3 6.4 6.5 6.6 6.7 Narici & Beckenstein 2011, pp. 177–183.
  7. 7.0 7.1 7.2 Schechter 1996, pp. 318–319.
  8. 8.0 8.1 8.2 8.3 Reed & Simon 1980.
  9. Rudin 1991, Th. 3.2
  10. 10.0 10.1 Narici & Beckenstein 2011, pp. 126–128.
  11. 11.0 11.1 Luxemburg 1962.
  12. 12.0 12.1 Łoś & Ryll-Nardzewski 1951, pp. 233–237.
  13. HAHNBAN file
  14. Narici & Beckenstein 2011, pp. 182, 498.
  15. 15.0 15.1 15.2 Narici & Beckenstein 2011, p. 184.
  16. 16.0 16.1 Narici & Beckenstein 2011, p. 182.
  17. Narici & Beckenstein 2011, p. 126.
  18. Harvey, R.; Lawson, H. B. (1983). "An intrinsic characterisation of Kähler manifolds". Invent. Math. 74 (2): 169–198. Bibcode:1983InMat..74..169H. doi:10.1007/BF01394312. S2CID 124399104.
  19. 19.0 19.1 19.2 Zălinescu, C. (2002). Convex analysis in general vector spaces. River Edge, NJ: World Scientific Publishing Co., Inc. pp. 5–7. ISBN 981-238-067-1. MR 1921556.
  20. Gabriel Nagy, Real Analysis lecture notes
  21. Brezis, Haim (2011). Functional Analysis, Sobolev Spaces, and Partial Differential Equations. New York: Springer. pp. 6–7.
  22. Kutateladze, Semen (1996). Fundamentals of Functional Analysis. Kluwer Texts in the Mathematical Sciences. Vol. 12. p. 40. doi:10.1007/978-94-015-8755-6. ISBN 978-90-481-4661-1.
  23. Trèves 2006, p. 184.
  24. Narici & Beckenstein 2011, pp. 195.
  25. Schaefer & Wolff 1999, p. 47.
  26. Narici & Beckenstein 2011, p. 212.
  27. Wilansky 2013, pp. 18–21.
  28. Narici & Beckenstein 2011, pp. 150.
  29. 29.0 29.1 Rudin 1991, p. 141.
  30. Edwards 1995, pp. 124–125.
  31. 31.0 31.1 31.2 31.3 Narici & Beckenstein 2011, pp. 225–273.
  32. Pincus 1974, pp. 203–205.
  33. Schechter 1996, pp. 766–767.
  34. Muger, Michael (2020). Topology for the Working Mathematician.
  35. Bell, J.; Fremlin, David (1972). "A Geometric Form of the Axiom of Choice" (PDF). Fundamenta Mathematicae. 77 (2): 167–170. doi:10.4064/fm-77-2-167-170. Retrieved 26 Dec 2021.
  36. Schechter, Eric. Handbook of Analysis and its Foundations. p. 620.
  37. Foreman, M.; Wehrung, F. (1991). "The Hahn–Banach theorem implies the existence of a non-Lebesgue measurable set" (PDF). Fundamenta Mathematicae. 138: 13–19. doi:10.4064/fm-138-1-13-19.
  38. Pawlikowski, Janusz (1991). "The Hahn–Banach theorem implies the Banach–Tarski paradox". Fundamenta Mathematicae. 138: 21–22. doi:10.4064/fm-138-1-21-22.
  39. Brown, D. K.; Simpson, S. G. (1986). "Which set existence axioms are needed to prove the separable Hahn–Banach theorem?". Annals of Pure and Applied Logic. 31: 123–144. doi:10.1016/0168-0072(86)90066-7. Source of citation.
  40. Simpson, Stephen G. (2009), Subsystems of second order arithmetic, Perspectives in Logic (2nd ed.), Cambridge University Press, ISBN 978-0-521-88439-6, MR2517689

Bibliography