Misplaced Pages

Degenerate distribution

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
(Redirected from Deterministic distribution) The probability distribution of a random variable which only takes a single value
This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.
Find sources: "Degenerate distribution" – news · newspapers · books · scholar · JSTOR (August 2021) (Learn how and when to remove this message)
Degenerate univariate
Cumulative distribution functionPlot of the degenerate distribution CDF for k0=0
CDF for k0=0. The horizontal axis is x.
Parameters k 0 ( , ) {\displaystyle k_{0}\in (-\infty ,\infty )\,}
Support x = k 0 {\displaystyle x=k_{0}\,}
PMF 1 for  x = k 0 0 elsewhere {\displaystyle {\begin{matrix}1&{\mbox{for }}x=k_{0}\\0&{\mbox{elsewhere}}\end{matrix}}}
CDF 0 for  x < k 0 1 for  x k 0 {\displaystyle {\begin{matrix}0&{\mbox{for }}x<k_{0}\\1&{\mbox{for }}x\geq k_{0}\end{matrix}}}
Mean k 0 {\displaystyle k_{0}\,}
Median k 0 {\displaystyle k_{0}\,}
Mode k 0 {\displaystyle k_{0}\,}
Variance 0 {\displaystyle 0\,}
Skewness undefined
Excess kurtosis undefined
Entropy 0 {\displaystyle 0\,}
MGF e k 0 t {\displaystyle e^{k_{0}t}\,}
CF e i k 0 t {\displaystyle e^{ik_{0}t}\,}
PGF 1 {\displaystyle 1\,}

In mathematics, a degenerate distribution (sometimes also Dirac distribution) is, according to some, a probability distribution in a space with support only on a manifold of lower dimension, and according to others a distribution with support only at a single point. By the latter definition, it is a deterministic distribution and takes only a single value. Examples include a two-headed coin and rolling a die whose sides all show the same number. This distribution satisfies the definition of "random variable" even though it does not appear random in the everyday sense of the word; hence it is considered degenerate.

In the case of a real-valued random variable, the degenerate distribution is a one-point distribution, localized at a point k0 on the real line. The probability mass function equals 1 at this point and 0 elsewhere.

The degenerate univariate distribution can be viewed as the limiting case of a continuous distribution whose variance goes to 0 causing the probability density function to be a delta function at k0, with infinite height there but area equal to 1.

The cumulative distribution function of the univariate degenerate distribution is:

F k 0 ( x ) = { 1 , if  x k 0 0 , if  x < k 0 {\displaystyle F_{k_{0}}(x)=\left\{{\begin{matrix}1,&{\mbox{if }}x\geq k_{0}\\0,&{\mbox{if }}x<k_{0}\end{matrix}}\right.}

Constant random variable

In probability theory, a constant random variable is a discrete random variable that takes a constant value, regardless of any event that occurs. This is technically different from an almost surely constant random variable, which may take other values, but only on events with probability zero. Constant and almost surely constant random variables, which have a degenerate distribution, provide a way to deal with constant values in a probabilistic framework.

Let  X: Ω → R  be a random variable defined on a probability space  (Ω, P). Then  X  is an almost surely constant random variable if there exists k 0 R {\displaystyle k_{0}\in \mathbb {R} } such that

Pr ( X = k 0 ) = 1 , {\displaystyle \Pr(X=k_{0})=1,}

and is furthermore a constant random variable if

X ( ω ) = k 0 , ω Ω . {\displaystyle X(\omega )=k_{0},\quad \forall \omega \in \Omega .}

A constant random variable is almost surely constant, but not necessarily vice versa, since if  X  is almost surely constant then there may exist  γ ∈ Ω  such that  X(γ) ≠ k0  (but then necessarily Pr({γ}) = 0, in fact Pr(X ≠ k0) = 0).

For practical purposes, the distinction between  X  being constant or almost surely constant is unimportant, since the cumulative distribution function  F(x)  of  X  does not depend on whether  X  is constant or 'merely' almost surely constant. In either case,

F ( x ) = { 1 , x k 0 , 0 , x < k 0 . {\displaystyle F(x)={\begin{cases}1,&x\geq k_{0},\\0,&x<k_{0}.\end{cases}}}

The function  F(x)  is a step function; in particular it is a translation of the Heaviside step function.

Higher dimensions

Degeneracy of a multivariate distribution in n random variables arises when the support lies in a space of dimension less than n. This occurs when at least one of the variables is a deterministic function of the others. For example, in the 2-variable case suppose that Y = aX + b for scalar random variables X and Y and scalar constants a ≠ 0 and b; here knowing the value of one of X or Y gives exact knowledge of the value of the other. All the possible points (x, y) fall on the one-dimensional line y = ax + b.

In general when one or more of n random variables are exactly linearly determined by the others, if the covariance matrix exists its rank is less than n and its determinant is 0, so it is positive semi-definite but not positive definite, and the joint probability distribution is degenerate.

Degeneracy can also occur even with non-zero covariance. For example, when scalar X is symmetrically distributed about 0 and Y is exactly given by Y = X, all possible points (x, y) fall on the parabola y = x, which is a one-dimensional subset of the two-dimensional space.

References

  1. ^ "Degenerate distribution - Encyclopedia of Mathematics". encyclopediaofmath.org. Archived from the original on 5 December 2020. Retrieved 6 August 2021.
  2. ^ Stephanie (2016-07-14). "Degenerate Distribution: Simple Definition & Examples". Statistics How To. Retrieved 2021-08-06.
Probability distributions (list)
Discrete
univariate
with finite
support
with infinite
support
Continuous
univariate
supported on a
bounded interval
supported on a
semi-infinite
interval
supported
on the whole
real line
with support
whose type varies
Mixed
univariate
continuous-
discrete
Multivariate
(joint)
Directional
Univariate (circular) directional
Circular uniform
Univariate von Mises
Wrapped normal
Wrapped Cauchy
Wrapped exponential
Wrapped asymmetric Laplace
Wrapped Lévy
Bivariate (spherical)
Kent
Bivariate (toroidal)
Bivariate von Mises
Multivariate
von Mises–Fisher
Bingham
Degenerate
and singular
Degenerate
Dirac delta function
Singular
Cantor
Families
Categories: