Uniform boundedness principle

For the definition of uniformly bounded functions, see Uniform boundedness. For the conjectures in number theory and algebraic geometry, see Uniform boundedness conjecture (disambiguation).

In mathematics, the uniform boundedness principle or Banach–Steinhaus theorem is one of the fundamental results in functional analysis. Together with the Hahn–Banach theorem and the open mapping theorem, it is considered one of the cornerstones of the field. In its basic form, it asserts that for a family of continuous linear operators (and thus bounded operators) whose domain is a Banach space, pointwise boundedness is equivalent to uniform boundedness in operator norm. The theorem was first published in 1927 by Stefan Banach and Hugo Steinhaus, but it was also proven independently by Hans Hahn.

Theorem

Uniform Boundedness Principle — Let $X$ be a Banach space, $Y$ a normed vector space and $B(X,Y)$ the space of all continuous linear operators from $X$ into $Y$. Suppose that $F$ is a collection of continuous linear operators from $X$ to $Y.$ If, for every $x\in X$, $$\underset{T\in F}{\sup }\Vert T(x){\Vert }_Y<\mathrm{\infty },$$ then $$\underset{T\in F}{\sup }\Vert T{\Vert }_{B(X,Y)}<\mathrm{\infty }.$$

The first inequality (that is, $\underset{T\in F}{\sup }\Vert T(x)\Vert <\mathrm{\infty }$ for all $x$) states that the functionals in $F$ are pointwise bounded while the second states that they are uniformly bounded. The second supremum always equals $$\underset{T\in F}{\sup }\Vert T{\Vert }_{B(X,Y)}=\underset{\stackrel{T\in F,}{\Vert x\Vert \le 1}}{\sup }\Vert T(x){\Vert }_Y$$ and if $X$ is not the trivial vector space (or if the supremum is taken over $[0,\mathrm{\infty }]$ rather than $[-\mathrm{\infty },\mathrm{\infty }]$) then closed unit ball can be replaced with the unit sphere $$\underset{T\in F}{\sup }\Vert T{\Vert }_{B(X,Y)}=\underset{\stackrel{T\in F,}{\Vert x\Vert =1}}{\sup }\Vert T(x){\Vert }_Y.$$ The completeness of the Banach space $X$ enables the following short proof, using the Baire category theorem.

Proof

Suppose $X$ is a Banach space and that for every $x\in X,$ $$\underset{T\in F}{\sup }\Vert T(x){\Vert }_Y<\mathrm{\infty }.$$ For every integer $n\in \mathbb{\mathbb{N}},$ let $$\begin{gathered} X_n=\{x\in X \\ : \\ \underset{T\in F}{\sup }\Vert T(x){\Vert }_Y\le n\}. \end{gathered}$$ Each set $X_n$ is a closed set and by the assumption, $$\bigcup _{n\in \mathbb{\mathbb{N}}}{X}_n=X\ne \varnothing .$$ By the Baire category theorem for the non-empty complete metric space $X,$ there exists some $m\in \mathbb{\mathbb{N}}$ such that $X_m$ has non-empty interior; that is, there exist $x_0\in X_m$ and $\epsilon >0$ such that $$\overline{B_{\epsilon }(x_0)}:=\{x\in X:\Vert x-x_0\Vert \le \epsilon \}\subseteq X_m.$$ Let $u\in X$ with $\Vert u\Vert \le 1$ and $T\in F.$ Then: $$\begin{gathered} \begin{array}{rlr}\Vert T(u){\Vert }_Y& ={\epsilon }^{-1}{\Vert T(x_0+\epsilon u)-T\left(x_0\right)\Vert }_Y& [\text{by linearity of }T]\\ & \le {\epsilon }^{-1}({\Vert T(x_0+\epsilon u)\Vert }_Y+{\Vert T(x_0)\Vert }_Y)\\ & \le {\epsilon }^{-1}(m+m).& [\text{since } \\ {x}_0+\epsilon u, \\ {x}_0\in X_m]\\ \end{array} \end{gathered}$$ Taking the supremum over $u$ in the unit ball of $X$ and over $T\in F$ it follows that $$\underset{T\in F}{\sup }\Vert T{\Vert }_{B(X,Y)}\le 2{\epsilon }^{-1}m<\mathrm{\infty }.$$

There are also simple proofs not using the Baire theorem (Sokal 2011).

Corollaries

Corollary — If a sequence of bounded operators $\left(T_n\right)$ converges pointwise, that is, the limit of $(T_n(x))$ exists for all $x\in X,$ then these pointwise limits define a bounded linear operator $T.$

The above corollary does not claim that $T_n$ converges to $T$ in operator norm, that is, uniformly on bounded sets. However, since $\left\{T_n\right\}$ is bounded in operator norm, and the limit operator $T$ is continuous, a standard "$3\epsilon$" estimate shows that $T_n$ converges to $T$ uniformly on compact sets.

Proof

Essentially the same as that of the proof that a pointwise convergent sequence of equicontinuous functions on a compact set converges to a continuous function. By uniform boundedness principle, let $M=\max \{\underset{n}{\sup }\Vert T_n\Vert ,\Vert T\Vert \}$ be a uniform upper bound on the operator norms. Fix any compact $K\subset X$. Then for any $ϵ>0$, finitely cover (use compactness) $K$ by a finite set of open balls $\{B(x_i,r){\}}_{i=1,...,N}$ of radius $r=\frac{ϵ}{M}$ Since $T_n\to T$ pointwise on each of $x_1,...,x_N$, for all large $n$, $\Vert T_n(x_i)-T(x_i)\Vert \le ϵ$ for all $i=1,...,N$. Then by triangle inequality, we find for all large $n$, $\mathrm{\forall }x\in K,\Vert T_n(x)-T(x)\Vert \le 3ϵ$.

Corollary — Any weakly bounded subset $S\subseteq Y$ in a normed space $Y$ is bounded.

Indeed, the elements of $S$ define a pointwise bounded family of continuous linear forms on the Banach space $X:=Y^{\prime },$ which is the continuous dual space of $Y.$ By the uniform boundedness principle, the norms of elements of $S,$ as functionals on $X,$ that is, norms in the second dual $Y^{″},$ are bounded. But for every $s\in S,$ the norm in the second dual coincides with the norm in $Y,$ by a consequence of the Hahn–Banach theorem. Let $L(X,Y)$ denote the continuous operators from $X$ to $Y,$ endowed with the operator norm. If the collection $F$ is unbounded in $L(X,Y),$ then the uniform boundedness principle implies: $$\begin{gathered} R=\{x\in X \\ : \\ \sup {\mathrm{\backslash nolimits}}_{T\in F}\Vert Tx{\Vert }_Y=\mathrm{\infty }\}\ne \varnothing . \end{gathered}$$ In fact, $R$ is dense in $X.$ The complement of $R$ in $X$ is the countable union of closed sets $\bigcup X_n.$ By the argument used in proving the theorem, each $X_n$ is nowhere dense, i.e. the subset $\bigcup X_n$ is of first category. Therefore $R$ is the complement of a subset of first category in a Baire space. By definition of a Baire space, such sets (called comeagre or residual sets) are dense. Such reasoning leads to the principle of condensation of singularities, which can be formulated as follows:

Theorem — Let $X$ be a Banach space, $\left(Y_n\right)$ a sequence of normed vector spaces, and for every $n,$ let $F_n$ an unbounded family in $L(X,Y_n).$ Then the set $$\begin{gathered} R:=\{x\in X \\ : \\ \text{ for all }n\in \mathbb{\mathbb{N}},\underset{T\in F_n}{\sup }\Vert Tx{\Vert }_{Y_n}=\mathrm{\infty }\} \end{gathered}$$ is a residual set, and thus dense in $X.$

Proof

The complement of $R$ is the countable union $$\begin{gathered} \bigcup _{n,m}\{x\in X \\ : \\ \underset{T\in F_n}{\sup }\Vert Tx{\Vert }_{Y_n}\le m\} \end{gathered}$$ of sets of first category. Therefore, its residual set $R$ is dense.

Example: pointwise convergence of Fourier series

Let $\mathbb{𝕋}$ be the circle, and let $C(\mathbb{𝕋})$ be the Banach space of continuous functions on $\mathbb{𝕋},$ with the uniform norm. Using the uniform boundedness principle, one can show that there exists an element in $C(\mathbb{𝕋})$ for which the Fourier series does not converge pointwise. For $f\in C(\mathbb{𝕋}),$ its Fourier series is defined by $$\sum _{k\in \mathbb{\mathbb{Z}}}\hat{f}(k)e^{ikx}=\sum _{k\in \mathbb{\mathbb{Z}}}\frac{1}{2\pi }(\underset{0}{\overset{2\pi }{\int }}f(t)e^{-ikt}dt)e^{ikx},$$ and the N-th symmetric partial sum is $$S_N(f)(x)=\sum _{k=-N}^N\hat{f}(k)e^{ikx}=\frac{1}{2\pi }\underset{0}{\overset{2\pi }{\int }}f(t)D_N(x-t)dt,$$ where $D_N$ is the $N$-th Dirichlet kernel. Fix $x\in \mathbb{𝕋}$ and consider the convergence of $\{S_N(f)(x)\}.$ The functional ${\phi }_{N,x}:C(\mathbb{𝕋})\to \mathbb{ℂ}$ defined by $${\phi }_{N,x}(f)=S_N(f)(x),f\in C(\mathbb{𝕋}),$$ is bounded. The norm of ${\phi }_{N,x},$ in the dual of $C(\mathbb{𝕋}),$ is the norm of the signed measure $(2(2\pi {)}^{-1}{D}_N(x-t)dt,$ namely $$\Vert {\phi }_{N,x}\Vert =\frac{1}{2\pi }\underset{0}{\overset{2\pi }{\int }}|D_N(x-t)|dt=\frac{1}{2\pi }\underset{0}{\overset{2\pi }{\int }}|D_N(s)|ds={\Vert D_N\Vert }_{L^1(\mathbb{𝕋})}.$$ It can be verified that $$\frac{1}{2\pi }\underset{0}{\overset{2\pi }{\int }}|D_N(t)|dt\ge \frac{1}{2\pi }\underset{0}{\overset{2\pi }{\int }}\frac{|\sin ((N+\frac{1}{2})t)|}{t/2}dt\to \mathrm{\infty }.$$ So the collection $\left({\phi }_{N,x}\right)$ is unbounded in $C(\mathbb{𝕋}{)}^{\ast },$ the dual of $C(\mathbb{𝕋}).$ Therefore, by the uniform boundedness principle, for any $x\in \mathbb{𝕋},$ the set of continuous functions whose Fourier series diverges at $x$ is dense in $C(\mathbb{𝕋}).$ More can be concluded by applying the principle of condensation of singularities. Let $\left(x_m\right)$ be a dense sequence in $\mathbb{𝕋}.$ Define ${\phi }_{N,x_m}$ in the similar way as above. The principle of condensation of singularities then says that the set of continuous functions whose Fourier series diverges at each $x_m$ is dense in $C(\mathbb{𝕋})$ (however, the Fourier series of a continuous function $f$ converges to $f(x)$ for almost every $x\in \mathbb{𝕋},$ by Carleson's theorem).

Generalizations

In a topological vector space (TVS) $X,$ "bounded subset" refers specifically to the notion of a von Neumann bounded subset. If $X$ happens to also be a normed or seminormed space, say with (semi)norm $\Vert \cdot \Vert ,$ then a subset $B$ is (von Neumann) bounded if and only if it is norm bounded, which by definition means $\underset{b\in B}{\sup }\Vert b\Vert <\mathrm{\infty }.$

Barrelled spaces

Main article: Barrelled space

Attempts to find classes of locally convex topological vector spaces on which the uniform boundedness principle holds eventually led to barrelled spaces. That is, the least restrictive setting for the uniform boundedness principle is a barrelled space, where the following generalized version of the theorem holds (Bourbaki 1987, Theorem III.2.1):

Theorem — Given a barrelled space $X$ and a locally convex space $Y,$ then any family of pointwise bounded continuous linear mappings from $X$ to $Y$ is equicontinuous (and even uniformly equicontinuous). Alternatively, the statement also holds whenever $X$ is a Baire space and $Y$ is a locally convex space.

Uniform boundedness in topological vector spaces

Main article: Uniformly bounded sets (topological vector space)

A family ${ℬ}$ of subsets of a topological vector space $Y$ is said to be uniformly bounded in $Y,$ if there exists some bounded subset $D$ of $Y$ such that $$B\subseteq D\text{ for every }B\in {ℬ},$$ which happens if and only if $$\bigcup _{B\in {ℬ}}B$$ is a bounded subset of $Y$; if $Y$ is a normed space then this happens if and only if there exists some real $M\ge 0$ such that $\underset{\stackrel{b\in B}{B\in {ℬ}}}{\sup }\Vert b\Vert \le M.$ In particular, if $H$ is a family of maps from $X$ to $Y$ and if $C\subseteq X$ then the family $\{h(C):h\in H\}$ is uniformly bounded in $Y$ if and only if there exists some bounded subset $D$ of $Y$ such that $h(C)\subseteq D\text{ for all }h\in H,$ which happens if and only if $H(C):=\bigcup _{h\in H}h(C)$ is a bounded subset of $Y.$

Proposition — Let $H\subseteq L(X,Y)$ be a set of continuous linear operators between two topological vector spaces $X$ and $Y$ and let $C\subseteq X$ be any bounded subset of $X.$ Then the family of sets $\{h(C):h\in H\}$ is uniformly bounded in $Y$ if any of the following conditions are satisfied:

1. $H$ is equicontinuous.
2. $C$ is a convex compact Hausdorff subspace of $X$ and for every $c\in C,$ the orbit $H(c):=\{h(c):h\in H\}$ is a bounded subset of $Y.$

Generalizations involving nonmeager subsets

Although the notion of a nonmeager set is used in the following version of the uniform bounded principle, the domain $X$ is not assumed to be a Baire space.

Theorem — Let $H\subseteq L(X,Y)$ be a set of continuous linear operators between two topological vector spaces $X$ and $Y$ (not necessarily Hausdorff or locally convex). For every $x\in X,$ denote the orbit of $x$ by $$H(x):=\{h(x):h\in H\}$$ and let $B$ denote the set of all $x\in X$ whose orbit $H(x)$ is a bounded subset of $Y.$ If $B$ is of the second category (that is, nonmeager) in $X$ then $B=X$ and $H$ is equicontinuous.

Every proper vector subspace of a TVS $X$ has an empty interior in $X.$ So in particular, every proper vector subspace that is closed is nowhere dense in $X$ and thus of the first category (meager) in $X$ (and the same is thus also true of all its subsets). Consequently, any vector subspace of a TVS $X$ that is of the second category (nonmeager) in $X$ must be a dense subset of $X$ (since otherwise its closure in $X$ would a closed proper vector subspace of $X$ and thus of the first category).

Proof

Proof that $H$ is equicontinuous: Let $W,V\subseteq Y$ be balanced neighborhoods of the origin in $Y$ satisfying $\bar{V}+\bar{V}\subseteq W.$ It must be shown that there exists a neighborhood $N\subseteq X$ of the origin in $X$ such that $h(N)\subseteq W$ for every $h\in H.$ Let $$C:=\bigcap _{h\in H}{h}^{-1}\left(\bar{V}\right),$$ which is a closed subset of $X$ (because it is an intersection of closed subsets) that for every $h\in H,$ also satisfies $h(C)\subseteq \bar{V}$ and $$h(C-C)=h(C)-h(C)\subseteq \bar{V}-\bar{V}=\bar{V}+\bar{V}\subseteq W$$ (as will be shown, the set $C-C$ is in fact a neighborhood of the origin in $X$ because the topological interior of $C$ in $X$ is not empty). If $b\in B$ then $H(b)$ being bounded in $Y$ implies that there exists some integer $n\in \mathbb{\mathbb{N}}$ such that $H(b)\subseteq nV$ so if $h\in H,$ then $b\in h^{-1}\left(nV\right)=n{h}^{-1}(V).$ Since $h\in H$ was arbitrary, $$b\in \bigcap _{h\in H}n{h}^{-1}(V)=n\bigcap _{h\in H}{h}^{-1}(V)\subseteq nC.$$ This proves that $$B\subseteq \bigcup _{n\in \mathbb{\mathbb{N}}}nC.$$ Because $B$ is of the second category in $X,$ the same must be true of at least one of the sets $nC$ for some $n\in \mathbb{\mathbb{N}}.$ The map $X\to X$ defined by $x\mapsto \frac{1}{n}x$ is a (surjective) homeomorphism, so the set $\frac{1}{n}(nC)=C$ is necessarily of the second category in $X.$ Because $C$ is closed and of the second category in $X,$ its topological interior in $X$ is not empty. Pick $c\in {\mathrm{Int}}_{X}C.$ Because the map $X\to X$ defined by $x\mapsto c-x$ is a homeomorphism, the set $$N:=c-{\mathrm{Int}}_{X}C={\mathrm{Int}}_X(c-C)$$ is a neighborhood of $0=c-c$ in $X,$ which implies that the same is true of its superset $C-C.$ And so for every $h\in H,$ $$h(N)\subseteq h(c-C)=h(c)-h(C)\subseteq \bar{V}-\bar{V}\subseteq W.$$ This proves that $H$ is equicontinuous. Q.E.D.

---

Proof that $B=X$: Because $H$ is equicontinuous, if $S\subseteq X$ is bounded in $X$ then $H(S)$ is uniformly bounded in $Y.$ In particular, for any $x\in X,$ because $S:=\{x\}$ is a bounded subset of $X,$ $H(\{x\})=H(x)$ is a uniformly bounded subset of $Y.$ Thus $B=X.$ Q.E.D.

Sequences of continuous linear maps

The following theorem establishes conditions for the pointwise limit of a sequence of continuous linear maps to be itself continuous.

Theorem — Suppose that $h_1,h_2,\dots$ is a sequence of continuous linear maps between two topological vector spaces $X$ and $Y.$

1. If the set $C$ of all $x\in X$ for which $h_1(x),h_2(x),\dots$ is a Cauchy sequence in $Y$ is of the second category in $X,$ then $C=X.$
2. If the set $L$ of all $x\in X$ at which the limit $h(x):=\underset{n\to \mathrm{\infty }}{\lim }{h}_n(x)$ exists in $Y$ is of the second category in $X$ and if $Y$ is a complete metrizable topological vector space (such as a Fréchet space or an F-space), then $L=X$ and $h:X\to Y$ is a continuous linear map.

Theorem — If $h_1,h_2,\dots$ is a sequence of continuous linear maps from an F-space $X$ into a Hausdorff topological vector space $Y$ such that for every $x\in X,$ the limit $$h(x):=\underset{n\to \mathrm{\infty }}{\lim }{h}_n(x)$$ exists in $Y,$ then $h:X\to Y$ is a continuous linear map and the maps $h,h_1,h_2,\dots$ are equicontinuous.

If in addition the domain is a Banach space and the codomain is a normed space then $\Vert h\Vert \le \underset{n\to \mathrm{\infty }}{\mathrm{lim\; inf}}\Vert h_n\Vert <\mathrm{\infty }.$

Complete metrizable domain

Dieudonné (1970) proves a weaker form of this theorem with Fréchet spaces rather than the usual Banach spaces.

Theorem — Let $H\subseteq L(X,Y)$ be a set of continuous linear operators from a complete metrizable topological vector space $X$ (such as a Fréchet space or an F-space) into a Hausdorff topological vector space $Y.$ If for every $x\in X,$ the orbit $$H(x):=\{h(x):h\in H\}$$ is a bounded subset of $Y$ then $H$ is equicontinuous. So in particular, if $Y$ is also a normed space and if $$\underset{h\in H}{\sup }\Vert h(x)\Vert <\mathrm{\infty }\text{ for every }x\in X,$$ then $H$ is equicontinuous.

See also

• Barrelled space – Type of topological vector space
• Ursescu theorem – Generalization of closed graph, open mapping, and uniform boundedness theorem

Bibliography

• Banach, Stefan; Steinhaus, Hugo (1927), "Sur le principe de la condensation de singularités" (PDF), Fundamenta Mathematicae, 9: 50–61, doi:10.4064/fm-9-1-50-61. (in French)
• Banach, Stefan (1932). Théorie des Opérations Linéaires [Theory of Linear Operations] (PDF). Monografie Matematyczne (in français). Vol. 1. Warszawa: Subwencji Funduszu Kultury Narodowej. Zbl 0005.20901. Archived from the original (PDF) on 2014-01-11. Retrieved 2020-07-11.
• Bourbaki, Nicolas (1987) [1981]. Topological Vector Spaces: Chapters 1–5. Éléments de mathématique. Translated by Eggleston, H.G.; Madan, S. Berlin New York: Springer-Verlag. ISBN 3-540-13627-4. OCLC 17499190.
• Dieudonné, Jean (1970), Treatise on analysis, Volume 2, Academic Press.
• Husain, Taqdir; Khaleelulla, S. M. (1978). Barrelledness in Topological and Ordered Vector Spaces. Lecture Notes in Mathematics. Vol. 692. Berlin, New York, Heidelberg: Springer-Verlag. ISBN 978-3-540-09096-0. OCLC 4493665.
• Khaleelulla, S. M. (1982). Counterexamples in Topological Vector Spaces. Lecture Notes in Mathematics. Vol. 936. Berlin, Heidelberg, New York: Springer-Verlag. ISBN 978-3-540-11565-6. OCLC 8588370.
• Narici, Lawrence; Beckenstein, Edward (2011). Topological Vector Spaces. Pure and applied mathematics (Second ed.). Boca Raton, FL: CRC Press. ISBN 978-1584888666. OCLC 144216834.
• Rudin, Walter (1966), Real and complex analysis, McGraw-Hill.
• Rudin, Walter (1991). Functional Analysis. International Series in Pure and Applied Mathematics. Vol. 8 (Second ed.). New York, NY: McGraw-Hill Science/Engineering/Math. ISBN 978-0-07-054236-5. OCLC 21163277.
• Schaefer, Helmut H.; Wolff, Manfred P. (1999). Topological Vector Spaces. GTM. Vol. 8 (Second ed.). New York, NY: Springer New York Imprint Springer. ISBN 978-1-4612-7155-0. OCLC 840278135.
• Schechter, Eric (1996). Handbook of Analysis and Its Foundations. San Diego, CA: Academic Press. ISBN 978-0-12-622760-4. OCLC 175294365.
• Shtern, A.I. (2001) [1994], "Uniform boundedness principle", Encyclopedia of Mathematics, EMS Press.
• Sokal, Alan (2011), "A really simple elementary proof of the uniform boundedness theorem", Amer. Math. Monthly, 118 (5): 450–452, arXiv:1005.1585, doi:10.4169/amer.math.monthly.118.05.450, S2CID 41853641.
• Trèves, François (2006) [1967]. Topological Vector Spaces, Distributions and Kernels. Mineola, N.Y.: Dover Publications. ISBN 978-0-486-45352-1. OCLC 853623322.
• Wilansky, Albert (2013). Modern Methods in Topological Vector Spaces. Mineola, New York: Dover Publications, Inc. ISBN 978-0-486-49353-4. OCLC 849801114.