Incubator escapee wiki

Total variation

Article Discussion

Template:Short description Template:Distinguish Template:Primary sources

In mathematics, the total variation identifies several slightly different concepts, related to the (local or global) structure of the codomain of a function or a measure. For a real-valued continuous function f, defined on an interval [a, b] ⊂ R, its total variation on the interval of definition is a measure of the one-dimensional arclength of the curve with parametric equation x ↦ f(x), for x ∈ [a, b]. Functions whose total variation is finite are called functions of bounded variation.

Historical noteEdit

The concept of total variation for functions of one real variable was first introduced by Camille Jordan in the paper Template:Harv.<ref>According to Template:Harvtxt.</ref> He used the new concept in order to prove a convergence theorem for Fourier series of discontinuous periodic functions whose variation is bounded. The extension of the concept to functions of more than one variable however is not simple for various reasons.

DefinitionsEdit

Total variation for functions of one real variableEdit

Template:EquationRef The total variation of a real-valued (or more generally complex-valued) function <math>f</math>, defined on an interval <math> [a , b] \subset \mathbb{R}</math> is the quantity

<math> V_a^b(f)=\sup_{\mathcal{P}} \sum_{i=0}^{n_P-1} | f(x_{i+1})-f(x_i) |, </math>

where the supremum runs over the set of all partitions <math> \mathcal{P} = \left\{P=\{ x_0, \dots , x_{n_P}\} \mid P\text{ is a partition of } [a,b] \right\} </math> of the given interval. Which means that <math>a = x_{0} < x_{1} < ... < x_{n_{P}} = b</math>.

Total variation for functions of n > 1 real variablesEdit

Template:Citation needed section Template:EquationRef<ref name="10.1093/oso/9780198502456.001.0001">Template:Cite book</ref> Let Ω be an open subset of Rn. Given a function f belonging to L1(Ω), the total variation of f in Ω is defined as

<math> V(f,\Omega):=\sup\left\{\int_\Omega f(x) \operatorname{div} \phi(x) \, \mathrm{d}x \colon \phi\in C_c^1(\Omega,\mathbb{R}^n),\ \Vert \phi\Vert_{L^\infty(\Omega)}\le 1\right\}, </math>

where

This definition does not require that the domain <math>\Omega \subseteq \mathbb{R}^n</math> of the given function be a bounded set.

Total variation in measure theoryEdit

Classical total variation definitionEdit

Following Template:Harvtxt, consider a signed measure <math>\mu</math> on a measurable space <math>(X,\Sigma)</math>: then it is possible to define two set functions <math>\overline{\mathrm{W}}(\mu,\cdot)</math> and <math>\underline{\mathrm{W}}(\mu,\cdot)</math>, respectively called upper variation and lower variation, as follows

<math>\overline{\mathrm{W}}(\mu,E)=\sup\left\{\mu(A)\mid A\in\Sigma\text{ and }A\subset E \right\}\qquad\forall E\in\Sigma</math>
<math>\underline{\mathrm{W}}(\mu,E)=\inf\left\{\mu(A)\mid A\in\Sigma\text{ and }A\subset E \right\}\qquad\forall E\in\Sigma</math>

clearly

<math>\overline{\mathrm{W}}(\mu,E)\geq 0 \geq \underline{\mathrm{W}}(\mu,E)\qquad\forall E\in\Sigma</math>

Template:EquationRef The variation (also called absolute variation) of the signed measure <math>\mu</math> is the set function

<math>|\mu|(E)=\overline{\mathrm{W}}(\mu,E)+\left|\underline{\mathrm{W}}(\mu,E)\right|\qquad\forall E\in\Sigma</math>

and its total variation is defined as the value of this measure on the whole space of definition, i.e.

<math>\|\mu\|=|\mu|(X)</math>

Modern definition of total variation normEdit

Template:Harvtxt uses upper and lower variations to prove the Hahn–Jordan decomposition: according to his version of this theorem, the upper and lower variation are respectively a non-negative and a non-positive measure. Using a more modern notation, define

<math>\mu^+(\cdot)=\overline{\mathrm{W}}(\mu,\cdot)\,,</math>
<math>\mu^-(\cdot)=-\underline{\mathrm{W}}(\mu,\cdot)\,,</math>

Then <math>\mu^+</math> and <math>\mu^-</math> are two non-negative measures such that

<math>\mu=\mu^+-\mu^-</math>
<math>|\mu|=\mu^++\mu^-</math>

The last measure is sometimes called, by abuse of notation, total variation measure.

Total variation norm of complex measuresEdit

If the measure <math>\mu</math> is complex-valued i.e. is a complex measure, its upper and lower variation cannot be defined and the Hahn–Jordan decomposition theorem can only be applied to its real and imaginary parts. However, it is possible to follow Template:Harvtxt and define the total variation of the complex-valued measure <math>\mu</math> as follows

Template:EquationRef The variation of the complex-valued measure <math>\mu</math> is the set function

<math>|\mu|(E)=\sup_\pi \sum_{A\isin\pi} |\mu(A)|\qquad\forall E\in\Sigma</math>

where the supremum is taken over all partitions <math>\pi</math> of a measurable set <math>E</math> into a countable number of disjoint measurable subsets.

This definition coincides with the above definition <math>|\mu|=\mu^++\mu^-</math> for the case of real-valued signed measures.

Total variation norm of vector-valued measuresEdit

The variation so defined is a positive measure (see Template:Harvtxt) and coincides with the one defined by Template:EquationNote when <math>\mu</math> is a signed measure: its total variation is defined as above. This definition works also if <math>\mu</math> is a vector measure: the variation is then defined by the following formula

<math>|\mu|(E) = \sup_\pi \sum_{A\isin\pi} \|\mu(A)\|\qquad\forall E\in\Sigma</math>

where the supremum is as above. This definition is slightly more general than the one given by Template:Harvtxt since it requires only to consider finite partitions of the space <math>X</math>: this implies that it can be used also to define the total variation on finite-additive measures.

Total variation of probability measuresEdit

{{ safesubst:#invoke:Unsubst||date=__DATE__ |$B= {{ safesubst:#invoke:Unsubst||date=__DATE__ |$B= Template:Ambox }} }} {{#invoke:Labelled list hatnote|labelledList|Main article|Main articles|Main page|Main pages}} The total variation of any probability measure is exactly one, therefore it is not interesting as a means of investigating the properties of such measures. However, when μ and ν are probability measures, the total variation distance of probability measures can be defined as <math>\| \mu - \nu \|</math> where the norm is the total variation norm of signed measures. Using the property that <math>(\mu-\nu)(X)=0</math>, we eventually arrive at the equivalent definition

<math>\|\mu-\nu\| = |\mu-\nu|(X)=2 \sup\left\{\,\left|\mu(A)-\nu(A)\right| : A\in \Sigma\,\right\}</math>

and its values are non-trivial. The factor <math>2</math> above is usually dropped (as is the convention in the article total variation distance of probability measures). Informally, this is the largest possible difference between the probabilities that the two probability distributions can assign to the same event. For a categorical distribution it is possible to write the total variation distance as follows

<math>\delta(\mu,\nu) = \sum_x \left| \mu(x) - \nu(x) \right|\;.</math>

It may also be normalized to values in <math>[0, 1]</math> by halving the previous definition as follows

<math>\delta(\mu,\nu) = \frac{1}{2}\sum_x \left| \mu(x) - \nu(x) \right|</math><ref>{{#invoke:citation/CS1|citation

|CitationClass=web }}</ref>

Basic propertiesEdit

Total variation of differentiable functionsEdit

The total variation of a <math>C^1(\overline{\Omega})</math> function <math>f</math> can be expressed as an integral involving the given function instead of as the supremum of the functionals of definitions Template:EquationNote and Template:EquationNote.

The form of the total variation of a differentiable function of one variableEdit

Template:EquationRef The total variation of a differentiable function <math>f</math>, defined on an interval <math> [a , b] \subset \mathbb{R}</math>, has the following expression if <math>f'</math> is Riemann integrable

<math> V_a^b(f) = \int _a^b |f'(x)|\mathrm{d}x</math>

If <math> f</math> is differentiable and monotonic, then the above simplifies to

<math> V_a^b(f) = |f(a) - f(b)|</math>

For any differentiable function <math>f</math>, we can decompose the domain interval <math>[a,b]</math>, into subintervals <math>[a,a_1], [a_1,a_2], \dots, [a_N,b]</math> (with <math>a<a_1<a_2<\cdots<a_N<b </math>) in which <math>f</math> is locally monotonic, then the total variation of <math> f</math> over <math>[a,b]</math> can be written as the sum of local variations on those subintervals:

<math>

\begin{align} V_a^b(f) &= V_a^{a_1}(f) + V_{a_1}^{a_2}(f) + \, \cdots \, +V_{a_N}^b(f)\\[0.3em] &=|f(a)-f(a_1)|+|f(a_1)-f(a_2)|+ \,\cdots \, + |f(a_N)-f(b)| \end{align}</math>

The form of the total variation of a differentiable function of several variablesEdit

Template:EquationRef Given a <math>C^1(\overline{\Omega})</math> function <math>f</math> defined on a bounded open set <math>\Omega \subseteq \mathbb{R}^n</math>, with <math>\partial \Omega </math> of class <math>C^1</math>, the total variation of <math>f</math> has the following expression

<math>V(f,\Omega) = \int_\Omega \left|\nabla f(x) \right| \mathrm{d}x</math> .
ProofEdit

The first step in the proof is to first prove an equality which follows from the Gauss–Ostrogradsky theorem.

LemmaEdit

Under the conditions of the theorem, the following equality holds:

<math> \int_\Omega f\operatorname{div}\varphi = -\int_\Omega\nabla f\cdot\varphi </math>
Proof of the lemmaEdit

From the Gauss–Ostrogradsky theorem:

<math> \int_\Omega \operatorname{div}\mathbf R = \int_{\partial\Omega}\mathbf R\cdot \mathbf n </math>

by substituting <math>\mathbf R:= f\mathbf\varphi</math>, we have:

<math> \int_\Omega\operatorname{div}\left(f\mathbf\varphi\right) =

\int_{\partial\Omega}\left(f\mathbf\varphi\right)\cdot\mathbf n </math> where <math>\mathbf\varphi </math> is zero on the border of <math>\Omega</math> by definition:

<math> \int_\Omega\operatorname{div}\left(f\mathbf\varphi\right)=0</math>
<math> \int_\Omega \partial_{x_i} \left(f\mathbf\varphi_i\right)=0</math>
<math> \int_\Omega \mathbf\varphi_i\partial_{x_i} f + f\partial_{x_i}\mathbf\varphi_i=0</math>
<math> \int_\Omega f\partial_{x_i}\mathbf\varphi_i = - \int_\Omega \mathbf\varphi_i\partial_{x_i} f </math>
<math> \int_\Omega f\operatorname{div} \mathbf\varphi = - \int_\Omega \mathbf\varphi\cdot\nabla f </math>
Proof of the equalityEdit

Under the conditions of the theorem, from the lemma we have:

<math> \int_\Omega f\operatorname{div} \mathbf\varphi

= - \int_\Omega \mathbf\varphi\cdot\nabla f \leq \left| \int_\Omega \mathbf\varphi\cdot\nabla f \right| \leq \int_\Omega \left|\mathbf\varphi\right|\cdot\left|\nabla f\right| \leq \int_\Omega \left|\nabla f\right| </math> in the last part <math>\mathbf\varphi</math> could be omitted, because by definition its essential supremum is at most one.

On the other hand, we consider <math>\theta_N:=-\mathbb I_{\left[-N,N\right]}\mathbb I_{\{\nabla f\ne 0\}}\frac{\nabla f}{\left|\nabla f\right|}</math> and <math>\theta^*_N</math> which is the up to <math>\varepsilon</math> approximation of <math>\theta_N</math> in <math> C^1_c</math> with the same integral. We can do this since <math> C^1_c</math> is dense in <math> L^1 </math>. Now again substituting into the lemma:

<math>\begin{align}

&\lim_{N\to\infty}\int_\Omega f\operatorname{div}\theta^*_N \\[4pt] &= \lim_{N\to\infty}\int_{\{\nabla f\ne 0\}}\mathbb I_{\left[-N,N\right]}\nabla f\cdot\frac{\nabla f}{\left|\nabla f\right|} \\[4pt] &= \lim_{N\to\infty}\int_{\left[-N,N\right]\cap{\{\nabla f\ne 0\}}} \nabla f\cdot\frac{\nabla f}{\left|\nabla f\right|} \\[4pt] &= \int_\Omega\left|\nabla f\right| \end{align}</math> This means we have a convergent sequence of <math display="inline">\int_\Omega f \operatorname{div} \mathbf\varphi</math> that tends to <math display="inline">\int_\Omega\left|\nabla f\right|</math> as well as we know that <math display="inline">\int_\Omega f\operatorname{div}\mathbf\varphi \leq \int_\Omega\left|\nabla f\right| </math>. Q.E.D.

It can be seen from the proof that the supremum is attained when

<math>\varphi\to \frac{-\nabla f}{\left|\nabla f\right|}.</math>

The function <math>f</math> is said to be of bounded variation precisely if its total variation is finite.

Total variation of a measureEdit

The total variation is a norm defined on the space of measures of bounded variation. The space of measures on a σ-algebra of sets is a Banach space, called the ca space, relative to this norm. It is contained in the larger Banach space, called the ba space, consisting of finitely additive (as opposed to countably additive) measures, also with the same norm. The distance function associated to the norm gives rise to the total variation distance between two measures μ and ν.

For finite measures on R, the link between the total variation of a measure μ and the total variation of a function, as described above, goes as follows. Given μ, define a function <math>\varphi\colon \mathbb{R}\to \mathbb{R}</math> by

<math>\varphi(t) = \mu((-\infty,t])~.</math>

Then, the total variation of the signed measure μ is equal to the total variation, in the above sense, of the function <math>\varphi</math>. In general, the total variation of a signed measure can be defined using Jordan's decomposition theorem by

<math>\|\mu\|_{TV} = \mu_+(X) + \mu_-(X)~,</math>

for any signed measure μ on a measurable space <math>(X,\Sigma)</math>.

ApplicationsEdit

Total variation can be seen as a non-negative real-valued functional defined on the space of real-valued functions (for the case of functions of one variable) or on the space of integrable functions (for the case of functions of several variables). As a functional, total variation finds applications in several branches of mathematics and engineering, like optimal control, numerical analysis, and calculus of variations, where the solution to a certain problem has to minimize its value. As an example, use of the total variation functional is common in the following two kind of problems

See alsoEdit

NotesEdit

Template:More footnotes Template:Reflist

Historical referencesEdit

Template:Sfn whitelist

ReferencesEdit

External linksEdit

One variable

One and more variables

Measure theory

  • {{#invoke:Template wrapper|{{#if:|list|wrap}}|_template=cite web

|_exclude=urlname, _debug, id |url = https://mathworld.wolfram.com/{{#if:TotalVariation%7CTotalVariation.html}} |title = Total Variation |author = Rowland, Todd |website = MathWorld |access-date = |ref = Template:SfnRef }}.

ApplicationsEdit

Retrieved from "https://zalansite.site/mediawiki/index.php?title=Total_variation&oldid=408339"