Solved – Procedure for fitting an ARMA/GARCH Model

acf-pacfarimagarchmodel selectiontime series

I want to try fitting an ARMA/GARCH model but want a methodological approach rather than fitting different models and picking the best one. However, I'm not sure how to choose my AR and MA terms for my mean equation, same thing for my variance equation. Hence I have the following queries:

  1. Are there any conventions/guidelines for choosing these by looking at the ACF/PACF of returns and squared returns?

  2. How are the coefficients estimated?Are the coefficients of the ARMA estimated first, then a GARCH fitted to the residuals?or are they estimate in parallel?

  3. Also I read on wikipedia that the Ljung-Box test should be applied to the residuals of an ARIMA model to detect the presence of heteroscedasticty, but I saw also some people applying it on squared returns. Are these two the same?If not, what's the difference between the two?

Best Answer

  1. You may look at ACF/PACF plots but this will only be practical if the data generating process is very simple, like AR($p$) or MA($q$). Once you encounter an ARMA($p,q$)+GARCH($s,r$) process where $p,q,s,r>0$, ACF/PACF will be harder to interpret.

  2. You may choose to fit an ARMA model first and then fit a GARCH model on the ARMA residuals, but this is not the preferred way. Your ARMA estimates will generally be inconsistent. (In a special case where there are only AR terms and no MA terms, the estimates will be consistent but inefficient.) This will also contaminate the GARCH estimates. Therefore the preferred way is to estimate both ARMA and GARCH models simultaneously. Statistical software is capable of doing that (see e.g. rugarch package for R).

  3. Ljung-Box test considers autocorrelation, not heteroskedasticity. Don't forget to adjust the degrees of freedom if you apply the test on model residuals rather than raw data.
    Also, Ljung-Box test assumes conditional homoskedasticity, thus you have to be careful. If you detect conditional heteroskedasticity of ARMA model residuals (or raw data) (and you can do that with an ARCH-LM test), Ljung-Box test results can no longer be trusted.
    When it comes to applying Ljung-Box test on squared residuals, this is intended for detecting ARCH effects (conditional heteroskedasticity). I would use ARCH-LM test instead since it was designed particularly for this task.

Related Question