Misplaced Pages

Gumbel distribution: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editNext edit →Content deleted Content addedVisualWikitext
Revision as of 17:12, 25 November 2020 edit130.225.166.210 (talk) Corrected CDFTag: Reverted← Previous edit Revision as of 03:18, 26 November 2020 edit undoBikernoah (talk | contribs)1 editm Undid revision 990637082 by 130.225.166.210 (talk) because cdf needs to tend to 0 as x tends to negative infinity and 1 as x tends to positive infinity.Tag: UndoNext edit →
Line 7: Line 7:
|support =<math>x\in\mathbb{R}</math> |support =<math>x\in\mathbb{R}</math>
|pdf =<math>\frac{1}{\beta}e^{-(z+e^{-z})}</math><br /> where <math>z=\frac{x-\mu}{\beta}</math> |pdf =<math>\frac{1}{\beta}e^{-(z+e^{-z})}</math><br /> where <math>z=\frac{x-\mu}{\beta}</math>
|cdf =<math>1-e^{-e^{-(x-\mu)/\beta}}</math> |cdf =<math>e^{-e^{-(x-\mu)/\beta}}</math>
|mean =<math>\mu + \beta\gamma</math> <br> where <math>\gamma</math> is the ] |mean =<math>\mu + \beta\gamma</math> <br> where <math>\gamma</math> is the ]
|median =<math>\mu - \beta\ln(\ln 2)</math> |median =<math>\mu - \beta\ln(\ln 2)</math>
Line 31: Line 31:
The ] of the Gumbel distribution is The ] of the Gumbel distribution is


:<math>F(x;\mu,\beta) = 1-e^{-e^{-(x-\mu)/\beta}}.\,</math> :<math>F(x;\mu,\beta) = e^{-e^{-(x-\mu)/\beta}}.\,</math>


===Standard Gumbel distribution=== ===Standard Gumbel distribution===
The standard Gumbel distribution is the case where <math>\mu = 0</math> and <math>\beta = 1</math> with cumulative distribution function The standard Gumbel distribution is the case where <math>\mu = 0</math> and <math>\beta = 1</math> with cumulative distribution function
:<math>F(x) = 1-e^{-e^{(-x)}}\,</math> :<math>F(x) = e^{-e^{(-x)}}\,</math>


and probability density function and probability density function

Revision as of 03:18, 26 November 2020

Gumbel
Probability density functionProbability distribution function
Cumulative distribution functionCumulative distribution function
Parameters μ , {\displaystyle \mu ,} location (real)
β > 0 , {\displaystyle \beta >0,} scale (real)
Support x R {\displaystyle x\in \mathbb {R} }
PDF 1 β e ( z + e z ) {\displaystyle {\frac {1}{\beta }}e^{-(z+e^{-z})}}
where z = x μ β {\displaystyle z={\frac {x-\mu }{\beta }}}
CDF e e ( x μ ) / β {\displaystyle e^{-e^{-(x-\mu )/\beta }}}
Mean μ + β γ {\displaystyle \mu +\beta \gamma }
where γ {\displaystyle \gamma } is the Euler–Mascheroni constant
Median μ β ln ( ln 2 ) {\displaystyle \mu -\beta \ln(\ln 2)}
Mode μ {\displaystyle \mu }
Variance π 2 6 β 2 {\displaystyle {\frac {\pi ^{2}}{6}}\beta ^{2}}
Skewness 12 6 ζ ( 3 ) π 3 1.14 {\displaystyle {\frac {12{\sqrt {6}}\,\zeta (3)}{\pi ^{3}}}\approx 1.14}
Excess kurtosis 12 5 {\displaystyle {\frac {12}{5}}}
Entropy ln ( β ) + γ + 1 {\displaystyle \ln(\beta )+\gamma +1}
MGF Γ ( 1 β t ) e μ t {\displaystyle \Gamma (1-\beta t)e^{\mu t}}
CF Γ ( 1 i β t ) e i μ t {\displaystyle \Gamma (1-i\beta t)e^{i\mu t}}

In probability theory and statistics, the Gumbel distribution (Generalized Extreme Value distribution Type-I) is used to model the distribution of the maximum (or the minimum) of a number of samples of various distributions.

This distribution might be used to represent the distribution of the maximum level of a river in a particular year if there was a list of maximum values for the past ten years. It is useful in predicting the chance that an extreme earthquake, flood or other natural disaster will occur. The potential applicability of the Gumbel distribution to represent the distribution of maxima relates to extreme value theory, which indicates that it is likely to be useful if the distribution of the underlying sample data is of the normal or exponential type. This article uses the Gumbel distribution to model the distribution of the maximum value. To model the minimum value, use the negative of the original values.

The Gumbel distribution is a particular case of the generalized extreme value distribution (also known as the Fisher-Tippett distribution). It is also known as the log-Weibull distribution and the double exponential distribution (a term that is alternatively sometimes used to refer to the Laplace distribution). It is related to the Gompertz distribution: when its density is first reflected about the origin and then restricted to the positive half line, a Gompertz function is obtained.

In the latent variable formulation of the multinomial logit model — common in discrete choice theory — the errors of the latent variables follow a Gumbel distribution. This is useful because the difference of two Gumbel-distributed random variables has a logistic distribution.

The Gumbel distribution is named after Emil Julius Gumbel (1891–1966), based on his original papers describing the distribution.

Definitions

The cumulative distribution function of the Gumbel distribution is

F ( x ; μ , β ) = e e ( x μ ) / β . {\displaystyle F(x;\mu ,\beta )=e^{-e^{-(x-\mu )/\beta }}.\,}

Standard Gumbel distribution

The standard Gumbel distribution is the case where μ = 0 {\displaystyle \mu =0} and β = 1 {\displaystyle \beta =1} with cumulative distribution function

F ( x ) = e e ( x ) {\displaystyle F(x)=e^{-e^{(-x)}}\,}

and probability density function

f ( x ) = e ( x + e x ) . {\displaystyle f(x)=e^{-(x+e^{-x})}.}

In this case the mode is 0, the median is ln ( ln ( 2 ) ) 0.3665 {\displaystyle -\ln(\ln(2))\approx 0.3665} , the mean is γ 0.5772 {\displaystyle \gamma \approx 0.5772} (the Euler–Mascheroni constant), and the standard deviation is π / 6 1.2825. {\displaystyle \pi /{\sqrt {6}}\approx 1.2825.}

The cumulants, for n>1, are given by

κ n = ( n 1 ) ! ζ ( n ) . {\displaystyle \kappa _{n}=(n-1)!\zeta (n).}


Properties

The mode is μ, while the median is μ β ln ( ln 2 ) , {\displaystyle \mu -\beta \ln \left(\ln 2\right),} and the mean is given by

E ( X ) = μ + γ β {\displaystyle \operatorname {E} (X)=\mu +\gamma \beta } ,

where γ {\displaystyle \gamma } is the Euler-Mascheroni constant.

The standard deviation σ {\displaystyle \sigma } is β π / 6 {\displaystyle \beta \pi /{\sqrt {6}}} hence β = σ 6 / π 0.78 σ . {\displaystyle \beta =\sigma {\sqrt {6}}/\pi \approx 0.78\sigma .}

At the mode, where x = μ {\displaystyle x=\mu } , the value of F ( x ; μ , β ) {\displaystyle F(x;\mu ,\beta )} becomes e 1 0.37 {\displaystyle e^{-1}\approx 0.37} , irrespective of the value of β . {\displaystyle \beta .}

Related distributions

  • If X {\displaystyle X} has a Gumbel distribution, then the conditional distribution of Y=−X given that Y is positive, or equivalently given that X is negative, has a Gompertz distribution. The cdf G of Y is related to F, the cdf of X, by the formula G ( y ) = P ( Y y ) = P ( X y | X 0 ) = ( F ( 0 ) F ( y ) ) / F ( 0 ) {\displaystyle G(y)=P(Y\leq y)=P(X\geq -y|X\leq 0)=(F(0)-F(-y))/F(0)} for y>0. Consequently, the densities are related by g ( y ) = f ( y ) / F ( 0 ) {\displaystyle g(y)=f(-y)/F(0)} : the Gompertz density is proportional to a reflected Gumbel density, restricted to the positive half-line.
  • If X is an exponentially distributed variable with mean 1, then −log(X) has a standard Gumbel distribution.
  • If X G u m b e l ( α X , β ) {\displaystyle X\sim \mathrm {Gumbel} (\alpha _{X},\beta )} and Y G u m b e l ( α Y , β ) {\displaystyle Y\sim \mathrm {Gumbel} (\alpha _{Y},\beta )} then X Y L o g i s t i c ( α X α Y , β ) {\displaystyle X-Y\sim \mathrm {Logistic} (\alpha _{X}-\alpha _{Y},\beta )\,} (see Logistic distribution).
  • If X {\displaystyle X} and Y G u m b e l ( α , β ) {\displaystyle Y\sim \mathrm {Gumbel} (\alpha ,\beta )} then X + Y L o g i s t i c ( 2 α , β ) {\displaystyle X+Y\nsim \mathrm {Logistic} (2\alpha ,\beta )\,} . Note that E ( X + Y ) = 2 α + 2 β γ 2 α = E ( L o g i s t i c ( 2 α , β ) ) {\displaystyle E(X+Y)=2\alpha +2\beta \gamma \neq 2\alpha =E\left(\mathrm {Logistic} (2\alpha ,\beta )\right)} .

Theory related to the generalized multivariate log-gamma distribution provides a multivariate version of the Gumbel distribution.

Occurrence and applications

Distribution fitting with confidence band of a cumulative Gumbel distribution to maximum one-day October rainfalls.

Gumbel has shown that the maximum value (or last order statistic) in a sample of a random variable following an exponential distribution minus natural logarithm of the sample size approaches the Gumbel distribution closer with increasing sample size.

In hydrology, therefore, the Gumbel distribution is used to analyze such variables as monthly and annual maximum values of daily rainfall and river discharge volumes, and also to describe droughts.

Gumbel has also shown that the estimator r⁄(n+1) for the probability of an event — where r is the rank number of the observed value in the data series and n is the total number of observations — is an unbiased estimator of the cumulative probability around the mode of the distribution. Therefore, this estimator is often used as a plotting position.

In number theory, the Gumbel distribution approximates the number of terms in a random partition of an integer as well as the trend-adjusted sizes of maximal prime gaps and maximal gaps between prime constellations.

In machine learning, the Gumbel distribution is sometimes employed to generate samples from the categorical distribution.

Computational methods

Probability paper

A piece of graph paper that incorporates the Gumbel distribution.

In pre-software times probability paper was used to picture the Gumbel distribution (see illustration). The paper is based on linearization of the cumulative distribution function F {\displaystyle F}  :

ln [ ln ( F ) ] = ( x μ ) / β {\displaystyle -\ln=(x-\mu )/\beta }

In the paper the horizontal axis is constructed at a double log scale. The vertical axis is linear. By plotting F {\displaystyle F} on the horizontal axis of the paper and the x {\displaystyle x} -variable on the vertical axis, the distribution is represented by a straight line with a slope 1 / β {\displaystyle /\beta } . When distribution fitting software like CumFreq became available, the task of plotting the distribution was made easier, as is demonstrated in the section below.


Generating Gumbel variates

Since the quantile function (inverse cumulative distribution function), Q ( p ) {\displaystyle Q(p)} , of a Gumbel distribution is given by

Q ( p ) = μ β ln ( ln ( p ) ) , {\displaystyle Q(p)=\mu -\beta \ln(-\ln(p)),}

the variate Q ( U ) {\displaystyle Q(U)} has a Gumbel distribution with parameters μ {\displaystyle \mu } and β {\displaystyle \beta } when the random variate U {\displaystyle U} is drawn from the uniform distribution on the interval ( 0 , 1 ) {\displaystyle (0,1)} .

See also

References

  1. Gumbel, E.J. (1935), "Les valeurs extrêmes des distributions statistiques" (PDF), Annales de l'Institut Henri Poincaré, 5 (2): 115–158
  2. Gumbel E.J. (1941). "The return period of flood flows". The Annals of Mathematical Statistics, 12, 163–190.
  3. ^ Oosterbaan, R.J. (1994). "Chapter 6 Frequency and Regression Analysis" (PDF). In Ritzema, H.P. (ed.). Drainage Principles and Applications, Publication 16. Wageningen, The Netherlands: International Institute for Land Reclamation and Improvement (ILRI). pp. 175–224. ISBN 90-70754-33-9.
  4. Willemse, W.J.; Kaas, R. (2007). "Rational reconstruction of frailty-based mortality models by a generalisation of Gompertz' law of mortality" (PDF). Insurance: Mathematics and Economics. 40 (3): 468. doi:10.1016/j.insmatheco.2006.07.003.
  5. CumFreq, software for probability distribution fitting
  6. [https://math.stackexchange.com/questions/3527556/gumbel-distribution-and-exponential-distribution?noredirect=1#comment7669633_3527556 user49229, Gumbel distribution and exponential distribution ]
  7. Gumbel, E.J. (1954). Statistical theory of extreme values and some practical applications. Applied Mathematics Series. Vol. 33 (1st ed.). U.S. Department of Commerce, National Bureau of Standards. ASIN B0007DSHG4.
  8. Burke, Eleanor J.; Perry, Richard H.J.; Brown, Simon J. (2010). "An extreme value analysis of UK drought and projections of change in the future". Journal of Hydrology. 388 (1–2): 131–143. Bibcode:2010JHyd..388..131B. doi:10.1016/j.jhydrol.2010.04.035.
  9. Erdös, Paul; Lehner, Joseph (1941). "The distribution of the number of summands in the partitions of a positive integer". Duke Mathematical Journal. 8 (2): 335. doi:10.1215/S0012-7094-41-00826-8.
  10. Kourbatov, A. (2013). "Maximal gaps between prime k-tuples: a statistical approach". Journal of Integer Sequences. 16. arXiv:1301.2242. Bibcode:2013arXiv1301.2242K. Article 13.5.2.
  11. Adams, Ryan. "The Gumbel-Max Trick for Discrete Distributions".

External links

Probability distributions (list)
Discrete
univariate
with finite
support
with infinite
support
Continuous
univariate
supported on a
bounded interval
supported on a
semi-infinite
interval
supported
on the whole
real line
with support
whose type varies
Mixed
univariate
continuous-
discrete
Multivariate
(joint)
Directional
Univariate (circular) directional
Circular uniform
Univariate von Mises
Wrapped normal
Wrapped Cauchy
Wrapped exponential
Wrapped asymmetric Laplace
Wrapped Lévy
Bivariate (spherical)
Kent
Bivariate (toroidal)
Bivariate von Mises
Multivariate
von Mises–Fisher
Bingham
Degenerate
and singular
Degenerate
Dirac delta function
Singular
Cantor
Families
Categories: