Cantelli's inequality

In probability theory, Cantelli's inequality is a generalization of Chebyshev's inequality in the case of a single "tail".[1][2][3] The inequality states that

where

is a real-valued random variable,
is the probability measure,
is the expected value of ,
is the variance of .

Combining the cases of and gives, for

A weaker version of Chebyshev's inequality.

While the inequality is often attributed to Francesco Paolo Cantelli who published it in 1928,[4] it originates in Chebyshev's work of 1874.[5] The Chebyshev inequality implies that in any data sample or probability distribution, "nearly all" values are close to the mean in terms of the absolute value of the difference between the points of the data sample and the weighted average of the data sample. The Cantelli inequality (sometimes called the "Chebyshev–Cantelli inequality" or the "one-sided Chebyshev inequality") gives a way of estimating how the points of the data sample are bigger than or smaller than their weighted average without the two tails of the absolute value estimate. The Chebyshev inequality has "higher moments versions" and "vector versions", and so does the Cantelli inequality.

Proof

Case

Let be a real-valued random variable with finite variance and expectation , and define (so that and ).

Then, for any , we have

the last inequality being a consequence of Markov's inequality. As the above holds for any choice of , we can choose to apply it with the value that minimizes the function . By differentiating, this can be seen to be , leading to

if

Case

We proceed as before, writing and for any

using the previous derivation on . By taking the complement of the left-hand side, we obtain

if

Generalizations

Using more moments, various stronger inequalities can be shown. He, Zhang and Zhang and showed,[6] when and :


See also

References

  1. Research and practice in multiple criteria decision making: proceedings of the XIVth International Conference on Multiple Criteria Decision Making (MCDM), Charlottesville, Virginia, USA, June 8–12, 1998, edited by Y.Y. Haimes and R.E. Steuer, Springer, 2000, ISBN 3540672664.
  2. "Tail and Concentration Inequalities" by Hung Q. Ngo
  3. "Concentration-of-measure inequalities" by Gábor Lugosi
  4. Cantelli, F. P. (1928), "Sui confini della probabilita," Atti del Congresso Inter- nazional del Matematici, Bologna, 6, 47-5
  5. Ghosh, B.K., 2002. Probability inequalities related to Markov's theorem. The American Statistician, 56(3), pp.186-190
  6. He, S.; Zhang, J.; Zhang, S. (2010). "Bounding probability of small deviation: A fourth moment approach". Mathematics of Operations Research. 35 (1): 208–232. doi:10.1287/moor.1090.0438. S2CID 11298475.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.