Autoregressive conditional heteroskedasticity

The lag length p of a GARCH(p, q) process is established in three steps:

1. Estimate the best fitting AR(q) model

   ${\displaystyle y_{t}=a_{0}+a_{1}y_{t-1}+\cdots +a_{q}y_{t-q}+\epsilon _{t}=a_{0}+\sum _{i=1}^{q}a_{i}y_{t-i}+\epsilon _{t}}$.

2. Compute and plot the autocorrelations of ${\displaystyle \epsilon ^{2}}$ by

   ${\displaystyle \rho ={{\sum _{t=i+1}^{T}({\hat {\epsilon }}_{t}^{2}-{\hat {\sigma }}_{t}^{2})({\hat {\epsilon }}_{t-1}^{2}-{\hat {\sigma }}_{t-1}^{2})} \over {\sum _{t=1}^{T}({\hat {\epsilon }}_{t}^{2}-{\hat {\sigma }}_{t}^{2})^{2}}}}$

3. The asymptotic, that is for large samples, standard deviation of ${\displaystyle \rho (i)}$ is ${\displaystyle 1/{\sqrt {T}}}$. Individual values that are larger than this indicate GARCH errors. To estimate the total number of lags, use the Ljung-Box test until the value of these are less than, say, 10% significant. The Ljung-Box Q-statistic follows ${\displaystyle \chi ^{2}}$ distribution with n degrees of freedom if the squared residuals ${\displaystyle \epsilon _{t}^{2}}$ are uncorrelated. It is recommended to consider up to T/4 values of n. The null hypothesis states that there are no ARCH or GARCH errors. Rejecting the null thus means that such errors exist in the conditional variance.

Nonlinear Asymmetric GARCH(1,1) (NAGARCH) is a model with the specification:[6][7]

${\displaystyle ~\sigma _{t}^{2}=~\omega +~\alpha (~\epsilon _{t-1}-~\theta ~\sigma _{t-1})^{2}+~\beta ~\sigma _{t-1}^{2}}$,

where ${\displaystyle ~\alpha \geq 0,~\beta \geq 0,~\omega >0}$ and ${\displaystyle ~\alpha (1+~\theta ^{2})+~\beta <1}$, which ensures the non-negativity and stationarity of the variance process.

For stock returns, parameter ${\displaystyle ~\theta }$ is usually estimated to be positive; in this case, it reflects a phenomenon commonly referred to as the "leverage effect", signifying that negative returns increase future volatility by a larger amount than positive returns of the same magnitude.[6][7]

This model should not be confused with the NARCH model, together with the NGARCH extension, introduced by Higgins and Bera in 1992.[8]

Integrated Generalized Autoregressive Conditional heteroskedasticity (IGARCH) is a restricted version of the GARCH model, where the persistent parameters sum up to one, and imports a unit root in the GARCH process. The condition for this is

${\displaystyle \sum _{i=1}^{p}~\beta _{i}+\sum _{i=1}^{q}~\alpha _{i}=1}$.

The exponential generalized autoregressive conditional heteroskedastic (EGARCH) model by Nelson & Cao (1991) is another form of the GARCH model. Formally, an EGARCH(p,q):

${\displaystyle \log \sigma _{t}^{2}=\omega +\sum _{k=1}^{q}\beta _{k}g(Z_{t-k})+\sum _{k=1}^{p}\alpha _{k}\log \sigma _{t-k}^{2}}$

where ${\displaystyle g(Z_{t})=\theta Z_{t}+\lambda (|Z_{t}|-E(|Z_{t}|))}$, ${\displaystyle \sigma _{t}^{2}}$ is the conditional variance, ${\displaystyle \omega }$, ${\displaystyle \beta }$, ${\displaystyle \alpha }$, ${\displaystyle \theta }$ and ${\displaystyle \lambda }$ are coefficients. ${\displaystyle Z_{t}}$ may be a standard normal variable or come from a generalized error distribution. The formulation for ${\displaystyle g(Z_{t})}$ allows the sign and the magnitude of ${\displaystyle Z_{t}}$ to have separate effects on the volatility. This is particularly useful in an asset pricing context.[9][10]

Since ${\displaystyle \log \sigma _{t}^{2}}$ may be negative, there are no sign restrictions for the parameters.

The GARCH-in-mean (GARCH-M) model adds a heteroskedasticity term into the mean equation. It has the specification:

${\displaystyle y_{t}=~\beta x_{t}+~\lambda ~\sigma _{t}+~\epsilon _{t}}$

The residual ${\displaystyle ~\epsilon _{t}}$ is defined as:

${\displaystyle ~\epsilon _{t}=~\sigma _{t}~\times z_{t}}$

The Quadratic GARCH (QGARCH) model by Sentana (1995) is used to model asymmetric effects of positive and negative shocks.

In the example of a GARCH(1,1) model, the residual process ${\displaystyle ~\sigma _{t}}$ is

${\displaystyle ~\epsilon _{t}=~\sigma _{t}z_{t}}$

where ${\displaystyle z_{t}}$ is i.i.d. and

${\displaystyle ~\sigma _{t}^{2}=K+~\alpha ~\epsilon _{t-1}^{2}+~\beta ~\sigma _{t-1}^{2}+~\phi ~\epsilon _{t-1}}$

Similar to QGARCH, the Glosten-Jagannathan-Runkle GARCH (GJR-GARCH) model by Glosten, Jagannathan and Runkle (1993) also models asymmetry in the ARCH process. The suggestion is to model ${\displaystyle ~\epsilon _{t}=~\sigma _{t}z_{t}}$ where ${\displaystyle z_{t}}$ is i.i.d., and

${\displaystyle ~\sigma _{t}^{2}=K+~\delta ~\sigma _{t-1}^{2}+~\alpha ~\epsilon _{t-1}^{2}+~\phi ~\epsilon _{t-1}^{2}I_{t-1}}$

where ${\displaystyle I_{t-1}=0}$ if ${\displaystyle ~\epsilon _{t-1}\geq 0}$, and ${\displaystyle I_{t-1}=1}$ if ${\displaystyle ~\epsilon _{t-1}<0}$.

The Threshold GARCH (TGARCH) model by Zakoian (1994) is similar to GJR GARCH. The specification is one on conditional standard deviation instead of conditional variance:

${\displaystyle ~\sigma _{t}=K+~\delta ~\sigma _{t-1}+~\alpha _{1}^{+}~\epsilon _{t-1}^{+}+~\alpha _{1}^{-}~\epsilon _{t-1}^{-}}$

where ${\displaystyle ~\epsilon _{t-1}^{+}=~\epsilon _{t-1}}$ if ${\displaystyle ~\epsilon _{t-1}>0}$, and ${\displaystyle ~\epsilon _{t-1}^{+}=0}$ if ${\displaystyle ~\epsilon _{t-1}\leq 0}$. Likewise, ${\displaystyle ~\epsilon _{t-1}^{-}=~\epsilon _{t-1}}$ if ${\displaystyle ~\epsilon _{t-1}\leq 0}$, and ${\displaystyle ~\epsilon _{t-1}^{-}=0}$ if ${\displaystyle ~\epsilon _{t-1}>0}$.

Hentschel's fGARCH model,[11] also known as Family GARCH, is an omnibus model that nests a variety of other popular symmetric and asymmetric GARCH models including APARCH, GJR, AVGARCH, NGARCH, etc.

In 2004, Claudia Klüppelberg, Alexander Lindner and Ross Maller proposed a continuous-time generalization of the discrete-time GARCH(1,1) process. The idea is to start with the GARCH(1,1) model equations

${\displaystyle \epsilon _{t}=\sigma _{t}z_{t},}$

${\displaystyle \sigma _{t}^{2}=\alpha _{0}+\alpha _{1}\epsilon _{t-1}^{2}+\beta _{1}\sigma _{t-1}^{2}=\alpha _{0}+\alpha _{1}\sigma _{t-1}^{2}z_{t-1}^{2}+\beta _{1}\sigma _{t-1}^{2},}$

and then to replace the strong white noise process ${\displaystyle z_{t}}$ by the infinitesimal increments ${\displaystyle \mathrm {d} L_{t}}$ of a Lévy process ${\displaystyle (L_{t})_{t\geq 0}}$, and the squared noise process ${\displaystyle z_{t}^{2}}$ by the increments ${\displaystyle \mathrm {d} [L,L]_{t}^{\mathrm {d} }}$, where

${\displaystyle [L,L]_{t}^{\mathrm {d} }=\sum _{s\in [0,t]}(\Delta L_{t})^{2},\quad t\geq 0,}$

is the purely discontinuous part of the quadratic variation process of ${\displaystyle L}$. The result is the following system of stochastic differential equations:

${\displaystyle \mathrm {d} G_{t}=\sigma _{t-}\,\mathrm {d} L_{t},}$

${\displaystyle \mathrm {d} \sigma _{t}^{2}=(\beta -\eta \sigma _{t}^{2})\,\mathrm {d} t+\varphi \sigma _{t-}^{2}\,\mathrm {d} [L,L]_{t}^{\mathrm {d} },}$

where the positive parameters ${\displaystyle \beta }$, ${\displaystyle \eta }$ and ${\displaystyle \varphi }$ are determined by ${\displaystyle \alpha _{0}}$, ${\displaystyle \alpha _{1}}$ and ${\displaystyle \beta _{1}}$. Now given some initial condition ${\displaystyle (G_{0},\sigma _{0}^{2})}$, the system above has a pathwise unique solution ${\displaystyle (G_{t},\sigma _{t}^{2})_{t\geq 0}}$ which is then called the continuous-time GARCH (COGARCH) model.[12]

Unlike GARCH model, the Zero-Drift GARCH (ZD-GARCH) model by Li, Zhang, Zhu and Ling (2018) [13] lets the drift term ${\displaystyle ~\omega =0}$ in the first order GARCH model. The ZD-GARCH model is to model ${\displaystyle ~\epsilon _{t}=~\sigma _{t}z_{t}}$, where ${\displaystyle z_{t}}$ is i.i.d., and

${\displaystyle ~\sigma _{t}^{2}=~\alpha _{1}~\epsilon _{t-1}^{2}+~\beta _{1}~\sigma _{t-1}^{2}.}$

The ZD-GARCH model does not require ${\displaystyle ~\alpha _{1}+~\beta _{1}=1}$, and hence it nests the Exponentially weighted moving average (EWMA) model in "RiskMetrics". Since the drift term ${\displaystyle ~\omega =0}$, the ZD-GARCH model is always non-stationary, and its statistical inference methods are quite different from those for the classical GARCH model. Based on the historical data, the parameters ${\displaystyle ~\alpha _{1}}$ and ${\displaystyle ~\beta _{1}}$ can be estimated by the generalized QMLE method.

Spatial GARCH processes by Otto, Schmid and Garthoff (2018) [14] are considered as the spatial equivalent to the temporal generalized autoregressive conditional heteroscedasticity (GARCH) models. In contrast to the temporal ARCH model, in which the distribution is known given the full information set for the prior periods, the distribution is not straightforward in the spatial and spatiotemporal setting due to the interdependence between neighboring spatial locations. The spatial model is given by ${\displaystyle ~\epsilon (s_{i})=~\sigma (s_{i})z(s_{i})}$ and

${\displaystyle ~\sigma (s_{i})^{2}=~\alpha _{i}+\sum _{v=1}^{n}\rho w_{iv}\epsilon (s_{v})^{2},}$

where ${\displaystyle ~s_{i}}$ denotes the ${\displaystyle i}$-th spatial location and ${\displaystyle ~w_{iv}}$ refers to the ${\displaystyle iv}$-th entry of a spatial weight matrix and ${\displaystyle w_{ii}=0}$ for ${\displaystyle ~i=1,...,n}$. The spatial weight matrix defines which locations are considered to be adjacent.