Fréchet mean

In mathematics and statistics, the Fréchet mean is a generalization of centroids to metric spaces, giving a single representative point or central tendency for a cluster of points. It is named after Maurice Fréchet. Karcher mean is the renaming of the Riemannian Center of Mass construction developed by Karsten Grove and Hermann Karcher.[1][2] On the real numbers, the arithmetic mean, median, geometric mean, and harmonic mean can all be interpreted as Fréchet means for different distance functions.

Definition

Let (M, d) be a complete metric space. Let x₁, x₂, …, x_N be random points in M. For any point p in M, define the Fréchet variance to be the sum of squared distances from p to the x_i:

\Psi (p)=\sum _{i=1}^{N}d^{2}\left(p,x_{i}\right)

The Karcher means are then those points, m of M, which locally minimise Ψ:[2]

m=\mathop {\text{arg min}} _{p\in M}\sum _{i=1}^{N}d^{2}\left(p,x_{i}\right)

If there is an m of M that globally minimises Ψ, then it is Fréchet mean.

Sometimes, the x_i are assigned weights w_i. Then, the Fréchet variance is calculated as a weighted sum,

\Psi (p)=\sum _{i=1}^{N}w_{i}d^{2}\left(p,x_{i}\right),\;\;\;\;m=\mathop {\text{arg min}} _{p\in M}\sum _{i=1}^{N}w_{i}d^{2}\left(p,x_{i}\right).

Examples of Fréchet means

Arithmetic mean and median

For real numbers, the arithmetic mean is a Fréchet mean, using the usual Euclidean distance as the distance function.

The median is also a Fréchet mean, if the definition of the function Ψ is generalized to the non-quadratic

\Psi (p)=\sum _{i=1}^{N}d^{\alpha }\left(p,x_{i}\right),

where $\alpha =1$ , and the Euclidean distance is the distance function d.[3] In higher-dimensional spaces, this becomes the geometric median.

Geometric mean

On the positive real numbers, the (hyperbolic) distance function $d(x,y)=|\log(x)-\log(y)|$ can be defined. The geometric mean is the corresponding Fréchet mean. Indeed $f:x\mapsto e^{x}$ is then an isometry from the euclidean space to this "hyperbolic" space and must respect the Fréchet mean: the Fréchet mean of the $x_{i}$ is the image by $f$ of the Fréchet mean (in the Euclidean sense) of the $f^{-1}(x_{i})$ , i.e. it must be:

f\left({\frac {1}{n}}\sum _{i=1}^{n}f^{-1}\left(x_{i}\right)\right)=\exp \left({\frac {1}{n}}\sum _{i=1}^{n}\log x_{i}\right)={\sqrt[{n}]{x_{1}\cdots x_{n}}}

.

Harmonic mean

On the positive real numbers, the metric (distance function):

d_{\operatorname {H} }(x,y)=\left|{\frac {1}{x}}-{\frac {1}{y}}\right|

can be defined. The harmonic mean is the corresponding Fréchet mean.

Power means

Given a non-zero real number $m$ , the power mean can be obtained as a Fréchet mean by introducing the metric

d_{m}\left(x,y\right)=\left|x^{m}-y^{m}\right|

f-mean

Given an invertible and continuous function $f$ , the f-mean can be defined as the Fréchet mean obtained by using the metric:

d_{f}(x,y)=\left|f(x)-f(y)\right|

This is sometimes called the generalised f-mean or quasi-arithmetic mean.

Weighted means

The general definition of the Fréchet mean that includes the possibility of weighting observations can be used to derive weighted versions for all of the above types of means.

References

Grove, Karsten; Karcher, Hermann (1973), "How to conjugate C1-close group actions, Math.Z. 132", Mathematische Zeitschrift, 132 (1): 11–20, doi:10.1007/BF01214029.
Nielsen, Frank; Bhatia, Rajendra (2012), Matrix Information Geometry, Springer, p. 171, ISBN 9783642302329.
Nielsen & Bhatia (2012), p. 136.

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.

[gk73-1] Grove, Karsten; Karcher, Hermann (1973), "How to conjugate C1-close group actions, Math.Z. 132", Mathematische Zeitschrift, 132 (1): 11–20, doi:10.1007/BF01214029.

[nb12-2] Nielsen, Frank; Bhatia, Rajendra (2012), Matrix Information Geometry, Springer, p. 171, ISBN 9783642302329.

[rb12-136-3] Nielsen & Bhatia (2012), p. 136.