Statistical Tests – When to Use (Non)parametric Test for Homoscedasticity Assumption

heteroscedasticitymisspecificationrvariance

If one is testing assumption of homoscedasticity, parametric (Bartlett Test of Homogeneity of Variances, bartlett.test) and non-parametric (Figner-Killeen Test of Homogeneity of Variances, fligner.test) tests are available. How to tell which kind to use? Should this depend on e.g. normality of the data?

Best Answer

It seems that the FK test is to be prefered in case of strong departure from the normality (to which the Bartlett test is sensible). Quoting the on-line help,

The Fligner-Killeen (median) test has been determined in a simulation study as one of the many tests for homogeneity of variances which is most robust against departures from normality, see Conover, Johnson & Johnson (1981).

Generally speaking, the Levene test works well in the ANOVA framework, providing there are small to moderate deviations from the normality. In this case, it outperfoms the Bartlett test. If the distribution are nearly normal, however, the Bartlett test is better. I've also heard of the Brown–Forsythe test as a non-parametric alternative to the Levene test. Basically, it relies on either the median or the trimmed mean (as compared to the mean in the Levene test). According to Brown and Forsythe (1974), a test based on the mean provided the best power for symmetric distributions with moderate tails.

In conclusion, I would say that if there is strong evidence of departure from the normality (as seen e.g., with the help of a Q-Q plot), then use a non-parametric test (FK or BF test); otherwise, use Levene or Bartlett test.

There was also a small discussion about this test for small and large samples in the R Journal, last year, asympTest: A Simple R Package for Classical Parametric Statistical Tests and Confidence Intervals in Large Samples. It seems that the FK test is also available through the coin interface for permutation tests, see the vignette.

References

Brown, M. B. and Forsythe, A. B. (1974). Robust Tests for Equality of Variances. JASA, 69, 364-367.