Editing Uniform continuity

{{Short description|Uniform restraint of the change in functions}}[[File:Continuity and uniform continuity 2.gif|thumb|upright=1.5|As the center of the blue window, with real height <math>2 \varepsilon\in\mathbb R_{>0}</math> and real width <math>2\delta\in\mathbb R_{>0}</math>, moves over the graph of <math>f(x)=\tfrac1x</math> in the direction of <math> x=0</math>, there comes a point at which the graph of <math>f</math> penetrates the (interior of the) top and/or bottom of that window. This means that <math>f</math> ranges over an interval larger than or equal to <math>\varepsilon</math> over an <math>x</math>-interval smaller than <math>\delta</math>. If there existed a window whereof top and/or bottom is never penetrated by the graph of <math>f</math> as the window moves along it over its domain, then that window's width would need to be infinitesimally small (nonreal), meaning that <math>f(x)</math> is '''not''' uniformly continuous. The function <math>g(x)=\sqrt x</math>, on the other hand, '''is''' uniformly continuous.]]
In [[mathematics]], a real [[function (mathematics)|function]] <math>f</math> of real numbers is said to be '''uniformly continuous''' if there is a positive real number <math>\delta</math> such that function values over any function domain interval of the size <math>\delta</math> are as close to each other as we want. In other words, for a uniformly continuous real function of real numbers, if we want function value differences to be less than any positive real number <math>\varepsilon</math>, then there is a positive real number <math>\delta</math> such that <math>|f(x) - f(y)| < \varepsilon</math> for any <math>x</math> and <math>y</math> in any interval of length <math>\delta</math> within the domain of <math>f</math>. 

The difference between uniform continuity and (ordinary) [[Continuous function|continuity]] is that in uniform continuity there is a globally applicable <math>\delta</math> (the size of a function domain interval over which function value differences are less than <math>\varepsilon</math>) that depends on only <math>\varepsilon</math>, while in (ordinary) continuity there is a locally applicable <math>\delta</math> that depends on both <math>\varepsilon</math> and <math>x</math>. So uniform continuity is a stronger continuity condition than continuity; a function that is uniformly continuous is continuous but a function that is continuous is not necessarily uniformly continuous. The concepts of uniform continuity and continuity can be expanded to functions defined between [[metric spaces]]. 

Continuous functions can fail to be uniformly continuous if they are unbounded on a bounded domain, such as <math>f(x) = \tfrac1x</math> on <math> (0,1) </math>, or if their slopes become unbounded on an infinite domain, such as <math>f(x)=x^2</math> on the real (number) line. However, any [[Lipschitz continuity|Lipschitz map]] between metric spaces is uniformly continuous, in particular any [[isometry]] (distance-preserving map). 

Although continuity can be defined for functions between general topological spaces, defining uniform continuity requires more structure. The concept relies on comparing the sizes of [[neighbourhood (mathematics)|neighbourhood]]s of distinct points, so it requires a metric space, or more generally a [[uniform space]].

== Definition for functions on metric spaces ==
For a function <math> f : X \to Y </math> with [[metric spaces]] <math> (X,d_1) </math> and <math> (Y,d_2) </math>, the following definitions of uniform continuity and (ordinary) continuity hold.

=== Definition of uniform continuity ===

* <math>f</math> is called '''uniformly continuous''' if for every [[real number]] <math> \varepsilon > 0 </math> there exists a real number <math> \delta > 0 </math> such that for every <math> x,y \in X </math> with <math> d_1(x,y) < \delta </math>, we have <math> d_2(f(x),f(y)) < \varepsilon </math>. The set <math> \{ y \in X: d_1(x,y) < \delta\} </math> for each <math> x </math> is a neighbourhood of <math> x </math> and the set <math> \{ x \in X: d_1(x,y) < \delta\} </math> for each <math> y </math> is a neighbourhood of <math> y </math> by [[Neighbourhood (mathematics)|the definition of a neighbourhood in a metric space]].
** If <math> X </math> and <math> Y </math> are subsets of the [[real line]], then <math> d_1 </math> and <math> d_2 </math> can be the [[Real_line#As_a_metric_space|standard one-dimensional Euclidean distance]], yielding the following definition: for every real number <math> \varepsilon > 0 </math> there exists a real number <math> \delta > 0 </math> such that for every <math> x,y \in X </math>, <math> |x - y| < \delta \implies |f(x) - f(y)| < \varepsilon </math> (where <math> A \implies B </math> is a [[material conditional]] statement saying "if <math> A </math>, then <math> B </math>").
* Equivalently, <math>f</math> is said to be uniformly continuous if <math>\forall \varepsilon > 0 \; \exists \delta > 0 \; \forall x \in X \; \forall y \in X : \, d_1(x,y) < \delta \, \Rightarrow \,d_2(f(x),f(y)) < \varepsilon </math>. Here [[Quantification (logic)|quantifications]] (<math>\forall \varepsilon > 0  </math>, <math>\exists \delta > 0  </math>, <math>\forall x \in X  </math>, and <math>\forall y \in X  </math>) are used.
* Equivalently, <math>f</math> is uniformly continuous if it admits a [[modulus of continuity]].

=== Definition of (ordinary) continuity ===

* <math>f</math> is called '''continuous''' <math> \underline{\text{at } x} </math> if for every [[real number]] <math> \varepsilon > 0 </math> there exists a real number <math> \delta > 0 </math> such that for every <math> y \in X </math> with <math> d_1(x,y) < \delta </math>, we have <math> d_2(f(x),f(y)) < \varepsilon </math>. The set <math> \{ y \in X: d_1(x,y) < \delta\} </math> is a neighbourhood of <math> x </math>. Thus, (ordinary) continuity is a local property of the function at the point <math> x </math>.
* Equivalently, a function <math>f</math> is said to be continuous if <math>\forall x \in X \; \forall \varepsilon > 0 \; \exists \delta > 0 \; \forall y \in X :  \, d_1(x,y) < \delta \, \Rightarrow \, d_2(f(x),f(y)) < \varepsilon</math>.
* Alternatively, a function <math>f</math> is said to be continuous if there is a function of all positive real numbers <math>\varepsilon</math> and <math>x \in X</math>, <math>\delta(\varepsilon, x)</math> representing the maximum positive real number, such that at each <math>x</math> if <math>y \in X</math> satisfies <math> d_1(x,y) < \delta(\varepsilon,x) </math> then <math> d_2(f(x),f(y)) < \varepsilon </math>. At every <math>x</math>, <math>\delta(\varepsilon, x)</math> is a monotonically non-decreasing function.

== Local continuity versus global uniform continuity ==
In the definitions, the difference between uniform continuity and [[Continuous function|continuity]] is that, in uniform continuity there is a globally applicable <math>\delta</math> (the size of a neighbourhood in <math> X </math> over which values of the metric for function values in <math> Y </math> are less than <math>\varepsilon</math>) that depends on only <math>\varepsilon</math> while in continuity there is a locally applicable <math>\delta</math> that depends on the both <math>\varepsilon</math> and <math>x</math>. Continuity is a ''local'' property of a function — that is, a function <math>f</math> is continuous, or not, at a particular point <math>x</math> of the function domain <math>X</math>, and this can be determined by looking at only the values of the function in an arbitrarily small neighbourhood of that point. When we speak of a function being continuous on an [[interval (mathematics)|interval]], we mean that the function is continuous at every point of the interval. In contrast, uniform continuity is a ''global'' property of <math>f</math>, in the sense that the standard definition of uniform continuity refers to every point of <math>X</math>. On the other hand, it is possible to give a definition that is ''local'' in terms of the natural extension <math>f^*</math>(the characteristics of which at nonstandard points are determined by the global properties of <math>f</math>), although it is not possible to give a local definition of uniform continuity for an arbitrary hyperreal-valued function, see [[Uniform continuity#Non-standard analysis|below]].

A mathematical definition that a function <math>f</math> is continuous on an interval <math>I</math> and a definition that <math>f</math> is uniformly continuous on <math>I</math> are structurally similar as shown in the following.

Continuity of a function <math>f:X \to Y</math> for [[metric spaces]] <math> (X,d_1) </math> and <math> (Y,d_2) </math> at every point ''<math>x</math>'' of an interval <math>I \subseteq X</math> (i.e., continuity of <math>f</math> on the interval <math>I</math>) is expressed by a formula starting with [[Quantification (logic)|quantifications]]
: <math>\forall x \in I \; \forall \varepsilon > 0 \; \exists \delta > 0 \; \forall y \in I :  \, d_1(x,y) < \delta \, \Rightarrow \, d_2(f(x),f(y)) < \varepsilon</math>,
(metrics <math>d_1(x,y) </math> and <math>d_2(f(x),f(y)) </math> are <math>|x - y| </math> and <math>|f(x) - f(y)| </math> for <math>f:\mathbb{R} \to \mathbb{R} </math> for [[Real number|the set of real numbers]] <math>\mathbb{R} </math>).

For uniform continuity, the order of the first, second, and third [[Quantifier (logic)|quantifications]] (<math>\forall x \in I </math>, <math>\forall \varepsilon > 0</math>, and <math>\exists \delta > 0</math>) are rotated:
: <math>\forall \varepsilon > 0 \; \exists \delta > 0 \; \forall x \in I \; \forall y \in I : \, d_1(x,y) < \delta \, \Rightarrow \,d_2(f(x),f(y)) < \varepsilon </math>.
Thus for continuity on the interval, one takes an arbitrary point <math>x</math> of the interval'','' and then there must exist a distance <math>\delta</math>,
: <math>\cdots \forall x \, \exists \delta \cdots ,</math>
while for uniform continuity, a single <math>\delta</math> must work uniformly for all points <math>x</math> of the interval,
: <math>\cdots \exists \delta \, \forall x \cdots .</math>

== Properties ==

Every uniformly continuous function is [[continuous function|continuous]], but the converse does not hold. Consider for instance the continuous function <math>f \colon \mathbb{R} \rightarrow \mathbb{R}, x
\mapsto x^2</math> where <math>\mathbb{R}</math> is [[Real number|the set of real numbers]]. Given a positive real number <math>\varepsilon</math>, uniform continuity requires the existence of a positive real number <math>\delta</math> such that for all <math>x_1, x_2 \in \mathbb{R}</math> with <math>|x_1 - x_2| < \delta</math>, we have <math>|f(x_1)-f(x_2)| < \varepsilon</math>. But
: <math>f\left(x + \delta \right)-f(x) = 2x\cdot \delta + \delta^2,</math>
and as <math>x</math> goes to be a higher and higher value, <math>\delta</math> needs to be lower and lower to satisfy <math>|f(x + \beta) -f(x)| < \varepsilon</math> for positive real numbers <math>\beta < \delta</math> and the given <math>\varepsilon</math>. This means that there is no specifiable (no matter how small it is) positive real number <math>\delta</math> to satisfy the condition for <math>f</math> to be uniformly continuous so <math>f</math> is not uniformly continuous.

Any [[absolutely continuous]] function (over a compact interval) is uniformly continuous. On the other hand, the [[Cantor function]] is uniformly continuous but not absolutely continuous.

The image of a [[totally bounded space|totally bounded]] subset under a uniformly continuous function is totally bounded. However, the image of a bounded subset of an arbitrary metric space under a uniformly continuous function need not be bounded: as a counterexample, consider the identity function from the integers endowed with the [[discrete metric]] to the integers endowed with the usual [[Euclidean metric]].

The [[Heine–Cantor theorem]] asserts that ''every continuous function on a [[compact set]] is uniformly continuous''. In particular, ''if a function is continuous on a [[interval (mathematics)|closed bounded interval]] of the real line, it is uniformly continuous on that interval''. The [[Darboux integral|Darboux integrability]] of continuous functions follows almost immediately from this theorem.

If a real-valued function <math>f</math> is continuous on <math>[0, \infty)</math> and <math>\lim_{x \to \infty} f(x)</math> exists (and is finite), then <math>f</math> is uniformly continuous. In particular, every element of <math>C_0(\mathbb{R})</math>, the space of continuous functions on <math>\mathbb{R}</math> that vanish at infinity, is uniformly continuous.<!-- This is true for some more general X instead of R, but I don't know how general X can get. --> This is a generalization of the Heine-Cantor theorem mentioned above, since <math>C_c(\mathbb{R}) \subset C_0(\mathbb{R}) </math>.

== Examples and nonexamples ==

=== Examples ===
* [[Linear function]]s <math>x \mapsto ax + b</math> are the simplest examples of uniformly continuous functions.
* Any continuous function on the interval <math>[0,1]</math> is also uniformly continuous, since <math>[0,1]</math> is a compact set.
* If a function is differentiable on an open interval and its derivative is bounded, then the function is uniformly continuous on that interval.
* Every [[Lipschitz continuous]] map between two metric spaces is uniformly continuous. More generally, every [[Hölder continuous]] function is uniformly continuous.
* The [[absolute value|absolute value function]] is uniformly continuous, despite not being differentiable at <math>x = 0</math>. This shows uniformly continuous functions are not always differentiable.
* Despite being nowhere differentiable, the [[Weierstrass function]] is uniformly continuous.
* Every member of a [[Uniform equicontinuity|uniformly equicontinuous]] set of functions is uniformly continuous.

=== Nonexamples ===
* Functions that are unbounded on a bounded domain are not uniformly continuous. The [[tangent function]] is continuous on the interval <math>(-\pi/2, \pi/2)</math> but is ''not'' uniformly continuous on that interval, as it goes to infinity as <math>x \to \pi/2</math>.
* Functions whose derivative tends to infinity as <math>x</math> grows large cannot be uniformly continuous. The exponential function <math>x \mapsto e^x</math> is continuous everywhere on the real line but is not uniformly continuous on the line, since its derivative is <math>e^x</math>, and <math>e^x\to\infty</math> as <math>x \to \infty</math>.

== Visualization ==
For a uniformly continuous function, for every positive real number <math>\varepsilon > 0</math> there is a positive real number <math>\delta > 0</math> such that two function values <math>f(x)</math> and <math>f(y)</math> have the maximum distance <math>\varepsilon</math> whenever <math>x</math> and <math>y</math> are within the maximum distance <math>\delta</math>. Thus at each point <math>(x,f(x))</math> of the graph, if we draw a rectangle with a height slightly less than <math>2\varepsilon</math> and width a slightly less than <math>2\delta</math> around that point, then the graph lies completely within the height of the rectangle, i.e., the graph do not pass through the top or the bottom side of the rectangle. For functions that are not uniformly continuous, this isn't possible; for these functions, the graph might lie inside the height of the rectangle at some point on the graph but there is a point on the graph where the graph lies above or below the rectangle. (the graph penetrates the top or bottom side of the rectangle.)

<gallery widths="400" heights="300">
File:Gleichmäßig stetige Funktion.svg|For uniformly continuous functions, for each positive real number <math>\varepsilon > 0</math> there is a positive real number <math>\delta > 0</math> such that when we draw a rectangle around each point of the graph with a width slightly less than <math>2\delta</math> and a height slightly less than <math>2\varepsilon</math>, the graph lies completely inside the height of the rectangle.
File:Nicht gleichmäßig stetige Funktion.svg|For functions that are not uniformly continuous, there is a positive real number <math>\varepsilon > 0</math> such that for every positive real number <math>\delta > 0</math> there is a point on the graph so that when we draw a rectangle with a height slightly less than <math>2\varepsilon</math> and a width slightly less than <math>2\delta</math> around that point, there is a function value directly above or below the rectangle. There might be a graph point where the graph is completely inside the height of the rectangle but this is not true for every point of the graph.
</gallery>

== History ==
The first published definition of uniform continuity was by [[Eduard_Heine|Heine]] in 1870, and in 1872 he published a proof that a continuous function on an open interval need not be uniformly continuous. The proofs are almost verbatim given by [[Peter_Gustav_Lejeune_Dirichlet|Dirichlet]] in his lectures on definite integrals in 1854. The definition of uniform continuity appears earlier in the work of Bolzano where he also proved that continuous functions on an open interval do not need to be uniformly continuous.  In addition he also states that a continuous function on a closed interval is uniformly continuous, but he does not give a complete proof.{{sfn|Rusnock|Kerr-Lawson|2005}}

== Other characterizations ==

=== Non-standard analysis ===
In [[non-standard analysis]], a real-valued function ''<math>f</math>'' of a real variable is [[microcontinuity|microcontinuous]] at a point ''<math>a</math>'' precisely if the difference <math>f^*(a + \delta) - f^*(a)</math> is infinitesimal whenever ''<math>\delta</math>'' is infinitesimal. Thus ''<math>f</math>'' is continuous on a set ''<math>A</math>'' in <math>\mathbb{R}</math> precisely if <math>f^*</math> is microcontinuous at every real point <math>a \in A</math>. Uniform continuity can be expressed as the condition that (the natural extension of) <math>f</math> is microcontinuous not only at real points in <math>A</math>, but at all points in its non-standard counterpart (natural extension) <math>^*A</math> in <math>^*\mathbb{R}</math>. Note that there exist hyperreal-valued functions which meet this criterion but are not uniformly continuous, as well as uniformly continuous hyperreal-valued functions which do not meet this criterion, however, such functions cannot be expressed in the form <math>f^*</math> for any real-valued function <math>f</math>. (see [[non-standard calculus]] for more details and examples).

=== Cauchy continuity ===

For a function between metric spaces, uniform continuity implies [[Cauchy continuity]] {{harv|Fitzpatrick|2006}}. More specifically, let <math>A</math> be a subset of <math>\mathbb{R}^n</math>. If a function <math>f:A \to \mathbb{R}^n</math> is uniformly continuous then for every pair of sequences <math>x_n</math> and <math>y_n</math> such that

:<math>\lim_{n\to\infty} |x_n-y_n|=0</math>

we have

:<math>\lim_{n\to\infty} |f(x_n)-f(y_n)|=0.</math>

== Relations with the extension problem ==

Let <math>X</math> be a metric space, <math>S</math> a subset of <math>X</math>'','' <math>R</math> a complete metric space, and <math>f: S \rightarrow R</math> a continuous function. A question to answer: ''When can <math>f</math> be extended to a continuous function on all of <math>X</math>?''

If ''<math>S</math>'' is closed in <math>X</math>, the answer is given by the [[Tietze extension theorem]]. So it is necessary and sufficient to extend ''<math>f</math>'' to the closure of <math>S</math> in <math>X</math>: that is, we may assume without loss of generality that ''<math>S</math>'' is dense in <math>X</math>, and this has the further pleasant consequence that if the extension exists, it is unique. A sufficient condition for <math>f</math> to extend to a continuous function <math>f: X \rightarrow R</math> is that it is [[Cauchy-continuous function|Cauchy-continuous]], i.e., the image under ''<math>f</math>'' of a Cauchy sequence remains Cauchy. If <math>X</math> is complete (and thus the completion of ''<math>S</math>''), then every continuous function from ''<math>X</math>'' to a metric space ''<math>Y</math>'' is Cauchy-continuous. Therefore when ''<math>X</math>'' is complete, ''<math>f</math>'' extends to a continuous function <math>f: X \rightarrow R</math> if and only if ''<math>f</math>'' is Cauchy-continuous.

It is easy to see that every uniformly continuous function is Cauchy-continuous and thus extends to ''<math>X</math>''. The converse does not hold, since the function <math>f: R \rightarrow R, x \mapsto x^2</math> is, as seen above, not uniformly continuous, but it is continuous and thus Cauchy continuous. In general, for functions defined on unbounded spaces like ''<math>R</math>'', uniform continuity is a rather strong condition. It is desirable to have a weaker condition from which to deduce extendability.

For example, suppose <math>a > 1</math> is a real number. At the precalculus level, the function <math>f: x \mapsto a^x</math> can be given a precise definition only for rational values of ''<math>x</math>'' (assuming the existence of qth roots of positive real numbers, an application of the [[Intermediate value theorem|Intermediate Value Theorem]]). One would like to extend <math>f</math> to a function defined on all of <math>R</math>. The identity

: <math>f(x+\delta)-f(x) = a^x\left(a^{\delta} - 1\right)</math>

shows that ''<math>f</math>'' is not uniformly continuous on the set ''<math>Q</math>'' of all rational numbers; however for any bounded interval ''<math>I</math>'' the restriction of ''<math>f</math>'' to <math>Q \cap I</math> is uniformly continuous, hence Cauchy-continuous, hence <math>f</math> extends to a continuous function on ''<math>I</math>''. But since this holds for every ''<math>I</math>'', there is then a unique extension of ''<math>f</math>'' to a continuous function on all of ''<math>R</math>''.

More generally, a continuous function <math>f: S \rightarrow R</math> whose restriction to every bounded subset of ''<math>S</math>'' is uniformly continuous is extendable to ''<math>X</math>'', and the converse holds if ''<math>X</math>'' is [[locally compact]].

A typical application of the extendability of a uniformly continuous function is the proof of the inverse [[Fourier transformation]] formula. We first prove that the formula is true for test functions, there are densely many of them. We then extend the inverse map to the whole space using the fact that linear map is continuous; thus, uniformly continuous.

== Generalization to topological vector spaces ==

In the special case of two [[topological vector spaces]] <math>V</math> and <math>W</math>, the notion of uniform continuity of a map <math>f:V\to W</math> becomes: for any neighborhood <math>B</math> of zero in <math>W</math>, there exists a neighborhood <math>A</math> of zero in <math>V</math> such that <math>v_1-v_2\in A</math> implies <math>f(v_1)-f(v_2)\in B.</math>

For [[linear transformation]]s <math>f:V\to W</math>, uniform continuity is equivalent to continuity. This fact is frequently used implicitly in [[functional analysis]] to extend a linear map off a dense subspace of a [[Banach space]].

== Generalization to uniform spaces ==
Just as the most natural and general setting for continuity is [[topological space]]s, the most natural and general setting for the study of ''uniform'' continuity are the [[uniform space]]s. A function <math>f:X \to Y</math> between uniform spaces is called ''uniformly continuous'' if for every [[entourage (topology)|entourage]] ''<math>V</math>'' in ''<math>Y</math>'' there exists an entourage ''<math>U</math>'' in ''<math>X</math>'' such that for every <math>(x_1,x_2)</math> in <math>U</math> we have <math>(f(x_1),f(x_2))</math> in <math>V</math>.

In this setting, it is also true that uniformly continuous maps transform Cauchy sequences into Cauchy sequences.

Each [[compact Hausdorff space]] possesses exactly one uniform structure compatible with the topology. A consequence is a generalization of the Heine-Cantor theorem: each continuous function from a compact Hausdorff space to a uniform space is uniformly continuous.

==See also==

* {{annotated link|Contraction mapping}}
* {{annotated link|Uniform convergence}}
* {{annotated link|Uniform isomorphism}}

== References ==
{{reflist}}

== Further reading ==
* {{cite book |author-link=Nicolas Bourbaki |first=Nicolas |last=Bourbaki |title=General Topology: Chapters 1–4 |date=1989 |publisher=Springer |trans-title=Topologie Générale |isbn=0-387-19374-X}} Chapter II is a comprehensive reference of uniform spaces.
* {{cite book |first=Jean |last=Dieudonné |author-link=Jean Dieudonné |title=Foundations of Modern Analysis |publisher=Academic Press |year=1960}}
* {{cite book |first=Patrick |last=Fitzpatrick |title=Advanced Calculus |publisher=Brooks/Cole |year=2006 |isbn=0-534-92612-6}}
* {{cite book |first=John L. |last=Kelley |title=General topology |year=1955 |publisher=Springer-Verlag |series=Graduate Texts in Mathematics |isbn=0-387-90125-6}}
* {{SpringerEOM|title=Uniform continuity|id=Uniform_continuity&oldid=12797|last=Kudryavtsev|first=L.D.}}
* {{cite book |last=Rudin |first=Walter |author-link=Walter Rudin |title=Principles of Mathematical Analysis |url=https://archive.org/details/principlesofmath00rudi |url-access=registration |publisher=[[McGraw-Hill]] |location=New York |isbn=978-0-07-054235-8 |year=1976}}
*{{citation|last1=Rusnock|first1=P.|last2=Kerr-Lawson|first2=A.|title=Bolzano and uniform continuity|journal=Historia Mathematica|volume=32|year=2005|pages=303–311|number=3|doi=10.1016/j.hm.2004.11.003|doi-access=}}

{{Metric spaces}}

[[Category:Calculus]]
[[Category:General topology]]
[[Category:Mathematical analysis]]
[[Category:Theory of continuous functions]]