Concentration of measure

Let ${\displaystyle (X,d)}$ be a metric space with a measure ${\displaystyle \mu }$ on the Borel sets with ${\displaystyle \mu (X)=1}$. Let

${\displaystyle \alpha (\epsilon )=\sup \left\{\mu (X\setminus A_{\epsilon })\,|A{\mbox{ is a Borel set and}}\,\mu (A)\geq 1/2\right\},}$

where

${\displaystyle A_{\epsilon }=\left\{x\,|\,d(x,A)<\epsilon \right\}}$

is the ${\displaystyle \epsilon }$-extension (also called ${\displaystyle \epsilon }$-fattening in the context of the Hausdorff distance) of a set ${\displaystyle A}$.

The function ${\displaystyle \alpha (\cdot )}$ is called the concentration rate of the space ${\displaystyle X}$. The following equivalent definition has many applications:

${\displaystyle \alpha (\epsilon )=\sup \left\{\mu (\{F\geq \mathop {M} +\epsilon \})\right\},}$

where the supremum is over all 1-Lipschitz functions ${\displaystyle F:X\to \mathbb {R} }$, and the median (or Levy mean) ${\displaystyle M=\mathop {\mathrm {Med} } F}$ is defined by the inequalities

${\displaystyle \mu \{F\geq M\}\geq 1/2,\,\mu \{F\leq M\}\geq 1/2.}$

Informally, the space ${\displaystyle X}$ exhibits a concentration phenomenon if ${\displaystyle \alpha (\epsilon )}$ decays very fast as ${\displaystyle \epsilon }$ grows. More formally, a family of metric measure spaces ${\displaystyle (X_{n},d_{n},\mu _{n})}$ is called a Lévy family if the corresponding concentration rates ${\displaystyle \alpha _{n}}$ satisfy

${\displaystyle \forall \epsilon >0\,\,\alpha _{n}(\epsilon )\to 0{\rm {\;as\;}}n\to \infty ,}$

and a normal Lévy family if

${\displaystyle \forall \epsilon >0\,\,\alpha _{n}(\epsilon )\leq C\exp(-cn\epsilon ^{2})}$

for some constants ${\displaystyle c,C>0}$. For examples see below.

The first example goes back to Paul Lévy. According to the spherical isoperimetric inequality, among all subsets ${\displaystyle A}$ of the sphere ${\displaystyle S^{n}}$ with prescribed spherical measure ${\displaystyle \sigma _{n}(A)}$, the spherical cap

${\displaystyle \left\{x\in S^{n}|\mathrm {dist} (x,x_{0})\leq R\right\},}$

for suitable ${\displaystyle R}$, has the smallest ${\displaystyle \epsilon }$-extension ${\displaystyle A_{\epsilon }}$ (for any ${\displaystyle \epsilon >0}$).

Applying this to sets of measure ${\displaystyle \sigma _{n}(A)=1/2}$ (where ${\displaystyle \sigma _{n}(S^{n})=1}$), one can deduce the following concentration inequality:

${\displaystyle \sigma _{n}(A_{\epsilon })\geq 1-C\exp(-cn\epsilon ^{2})}$,

where ${\displaystyle C,c}$ are universal constants. Therefore ${\displaystyle (S^{n})_{n}}$ meet the definition above of a normal Lévy family.

Vitali Milman applied this fact to several problems in the local theory of Banach spaces, in particular, to give a new proof of Dvoretzky's theorem.

All classical statistical physics is based on the concentration of measure phenomena: The fundamental idea (‘theorem’) about equivalence of ensembles in thermodynamic limit (Gibbs, 1902[4] and Einstein, 1902-1904[5][6][7]) is exactly the thin shell concentration theorem. For each mechanical system consider the phase space equipped by the invariant Liouville measure (the phase volume) and conserving energy E. The microcanonical ensemble is just an invariant distribution over the surface of constant energy E obtained by Gibbs as the limit of distributions in phase space with constant density in thin layers between the surfaces of states with energy E and with energy E+ΔE. The canonical ensemble is given by the probability density in the phase space (with respect to the phase volume) ${\displaystyle \rho =e^{\frac {F-E}{kT}},}$ where quantities F=const and T=const are defined by the conditions of probability normalisation and the given expectation of energy E.

When the number of particles is large, then the difference between average values of the macroscopic variables for the canonical and microcanonical ensembles tends to zero, and their fluctuations are explicitly evaluated. These results are proven rigorously under some regularity conditions on the energy function E by Khinchin (1943).[8] The simplest particular case when E is a sum of squares was well-known in detail before Khinchin and Lévy and even before Gibbs and Einstein. This is the Maxwell–Boltzmann distribution of the particle energy in ideal gas.

The microcanonical ensemble is very natural from the naïve physical point of view: this is just a natural equidistribution on the isoenergetic hypersurface. The canonical ensemble is very useful because of an important property: if a system consists of two non-interacting subsystems, i.e. if the energy E is the sum, ${\displaystyle E=E_{1}(X_{1})+E_{2}(X_{2})}$, where ${\displaystyle X_{1},X_{2}}$ are the states of the subsystems, then the equilibrium states of subsystems are independent, the equilibrium distribution of the system is the product of equilibrium distributions of the subsystems with the same T. The equivalence of these ensembles is the cornerstone of the mechanical foundations of thermodynamics.

• Borell–TIS inequality
• Gaussian isoperimetric inequality
• McDiarmid's inequality
• Talagrand's concentration inequality

• Ledoux, Michel (2001). The Concentration of Measure Phenomenon. American Mathematical Society. ISBN 0-8218-2864-9.

• A. A. Giannopoulos and V. Milman, Concentration property on probability spaces, Advances in Mathematics 156 (2000), 77-106.