[Math] How to choose degree for polynomial regression

regressionregression analysisstatistics

I know how to perform polynomial regression. But is there any method to use for estimating the degree of the polynomial that is best suited? Some kind of meta-regression.

With best suited I mean the grade that has the highest probability of being the true degree of the source for the data.

For example, if we look at this picture we can easily "see" that a polynomial of degree 4 would fit nicely:

enter image description here

A more generalized question is if there is any method to determine if the source is polynomial at all or if it is exponential or something else.

Best Answer

AIC or BIC is the right path to go. These criteria helps you to determine the model that best approximates the generating mechanism. Another, more basic approach is Ramsey RESET test for model misspecification. For example, see here http://lipas.uwasa.fi/~sjp/Teaching/ecm/lectures/ecmc8.pdf

Related Question