Misplaced Pages

First-difference estimator

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)
This article includes a list of references, related reading, or external links, but its sources remain unclear because it lacks inline citations. Please help improve this article by introducing more precise citations. (June 2012) (Learn how and when to remove this message)
This article may be too technical for most readers to understand. Please help improve it to make it understandable to non-experts, without removing the technical details. (January 2012) (Learn how and when to remove this message)
(Learn how and when to remove this message)

In statistics and econometrics, the first-difference (FD) estimator is an estimator used to address the problem of omitted variables with panel data. It is consistent under the assumptions of the fixed effects model. In certain situations it can be more efficient than the standard fixed effects (or "within") estimator, for example when the error terms follows a random walk.

The estimator requires data on a dependent variable, y i t {\displaystyle y_{it}} , and independent variables, x i t {\displaystyle x_{it}} , for a set of individual units i = 1 , , N {\displaystyle i=1,\dots ,N} and time periods t = 1 , , T {\displaystyle t=1,\dots ,T} . The estimator is obtained by running a pooled ordinary least squares (OLS) estimation for a regression of Δ y i t {\displaystyle \Delta y_{it}} on Δ x i t {\displaystyle \Delta x_{it}} .

Derivation

The FD estimator avoids bias due to some unobserved, time-invariant variable c i {\displaystyle c_{i}} , using the repeated observations over time:

y i t = x i t β + c i + u i t , t = 1 , . . . T , {\displaystyle y_{it}=x_{it}\beta +c_{i}+u_{it},t=1,...T,}
y i t 1 = x i t 1 β + c i + u i t 1 , t = 2 , . . . T . {\displaystyle y_{it-1}=x_{it-1}\beta +c_{i}+u_{it-1},t=2,...T.}

Differencing the equations, gives:

Δ y i t = y i t y i t 1 = Δ x i t β + Δ u i t , t = 2 , . . . T , {\displaystyle \Delta y_{it}=y_{it}-y_{it-1}=\Delta x_{it}\beta +\Delta u_{it},t=2,...T,}

which removes the unobserved c i {\displaystyle c_{i}} and eliminates the first time period.

The FD estimator β ^ F D {\displaystyle {\hat {\beta }}_{FD}} is then obtained by using the differenced terms for x {\displaystyle x} and u {\displaystyle u} in OLS:

β ^ F D = ( Δ X Δ X ) 1 Δ X Δ y = β + ( Δ X Δ X ) 1 Δ X Δ u {\displaystyle {\hat {\beta }}_{FD}=(\Delta X'\Delta X)^{-1}\Delta X'\Delta y=\beta +(\Delta X'\Delta X)^{-1}\Delta X'\Delta u}

where X , y , {\displaystyle X,y,} and u {\displaystyle u} , are notation for matrices of relevant variables. Note that the rank condition must be met for Δ X Δ X {\displaystyle \Delta X'\Delta X} to be invertible ( rank [ Δ X Δ X ] = k {\displaystyle {\text{rank}}=k} ), where k {\displaystyle k} is the number of regressors.

Let

Δ X i = [ Δ X i 2 , Δ X i 3 , . . . , Δ X i T ] {\displaystyle \Delta X_{i}=} ,

and, analogously,

Δ u i = [ Δ u i 2 , Δ u i 3 , . . . , Δ u i T ] {\displaystyle \Delta u_{i}=} .

If the error term is strictly exogenous, i.e. E [ u i t | x i 1 , x i 2 , . . , x i T ] = 0 {\displaystyle E=0} , by the central limit theorem, the law of large numbers, and the Slutsky's theorem, the estimator is distributed normally with asymptotic variance of

Avar ^ ( β ^ F D ) = E [ Δ X i Δ X i ] 1 E [ Δ X i Δ u i Δ u i Δ X i ] E [ Δ X i Δ X i ] 1 {\displaystyle {\widehat {\text{Avar}}}({\hat {\beta }}_{FD})=E^{-1}EE^{-1}} .

Under the assumption of homoskedasticity and no serial correlation, Var ( Δ u | X ) = σ Δ u 2 {\displaystyle {\text{Var}}(\Delta u|X)=\sigma _{\Delta u}^{2}} , the asymptotic variance can be estimated as

Avar ^ ( β ^ F D ) = σ ^ Δ u 2 ( Δ X Δ X ) 1 , {\displaystyle {\widehat {\text{Avar}}}({\hat {\beta }}_{FD})={\hat {\sigma }}_{\Delta u}^{2}(\Delta X'\Delta X)^{-1},}

where σ ^ u 2 {\displaystyle {\hat {\sigma }}_{u}^{2}} , a consistent estimator of σ u 2 {\displaystyle \sigma _{u}^{2}} , is given by

σ ^ Δ u 2 = [ n ( T 1 ) K ] 1 i = 1 n t = 2 T Δ u i t ^ 2 {\displaystyle {\hat {\sigma }}_{\Delta u}^{2}=^{-1}\sum _{i=1}^{n}\sum _{t=2}^{T}{\widehat {\Delta u_{it}}}^{2}}

and

Δ u i t ^ = Δ y i t β ^ F D Δ x i t {\displaystyle {\widehat {\Delta u_{it}}}=\Delta y_{it}-{\hat {\beta }}_{FD}\Delta x_{it}} .

Properties

To be unbiased, the fixed effects estimator (FE) requires strict exogeneity, defined as

E [ u i t | x i 1 , x i 2 , . . , x i T ] = 0 {\displaystyle E=0} .

The first difference estimator (FD) is also unbiased under this assumption.

If strict exogeneity is violated, but the weaker assumption

E [ ( u i t u i t 1 ) ( x i t x i t 1 ) ] = 0 {\displaystyle E=0}

holds, then the FD estimator is consistent.

Note that this assumption is less restrictive than the assumption of strict exogeneity which is required for consistency using the FE estimator when T {\displaystyle T} is fixed. If T {\displaystyle T\rightarrow \infty } , then both FE and FD are consistent under the weaker assumption of contemporaneous exogeneity.

The Hausman test can be used to test the assumptions underlying the consistency of the FE and FD estimators.

Relation to fixed effects estimator

For T = 2 {\displaystyle T=2} , the FD and fixed effects estimators are numerically equivalent.

Under the assumption of homoscedasticity and no serial correlation in u i t {\displaystyle u_{it}} , the FE estimator is more efficient than the FD estimator. This is because the FD estimator induces no serial correlation when differencing the errors. If u i t {\displaystyle u_{it}} follows a random walk, however, the FD estimator is more efficient as Δ u i t {\displaystyle \Delta u_{it}} are serially uncorrelated.

See also

Notes

  1. Wooldridge 2001, p. 284.
  2. Wooldridge 2013, p. 461.
  3. Wooldridge 2001, p. 279.
  4. Wooldridge 2001, p. 281.
  5. Wooldridge 2001, p. 285.
  6. Wooldridge 2001, p. 284.
  7. Wooldridge 2001, p. 284.

References

Categories: