Solved – Is there such a thing as an adjusted $R^2$ for a quantile regression model

goodness of fitquantile regressionr-squared

Having included an quantile regression model in a paper, the reviewers want me to include adjusted $R^2$ in the paper. I have calculated the pseudo-$R^2$s (from Koenker and Machado's 1999 JASA paper) for the three quantiles of interest for my study.

However, I have never heard of an adjusted $R^2$ for quantile regression and wouldn't know how to calculate it. I am asking you for either of the following:

  • preferably: a formula or approach on how to meaningfully calculate an adjusted $R^2$ for quantile regression.

  • alternatively: convincing arguments to provide to the reviewers as to why there isn't such a thing as an adjusted $R^2$ in quantile regression.

Best Answer

I think what the reviewers are asking is to take the pseudo-$R^2$-values and "unbias" them for number of samples in the quantile range, $n_Q$, and number of parameters in the model, $p$. In other words, adjusted-$R^2$ in its usual context. That is that the corrected unexplained fraction is larger than the gross unexplained fraction by a factor of $\frac{n_Q-1}{n_Q-p-1}$, i.e.,

$1-R^{2*}=\frac{n_Q-1}{n_Q-p-1}(1-R^2)$, or, $R^{2*}=1-\frac{n_Q-1}{n_Q-p-1}(1-R^2)$

I agree with you about taking things too far, because this is already a pseudo-$R^2$-value and an adjusted-pseudo-$R^2$-value might leave the reader with an impression of performing a pseudo-adjustment.

One alternative is to do the calculations and show the reviewers what the results are and NOT include them in the paper, by explaining that it goes beyond what the published methods are that you are using and you do not want the responsibility for inventing an otherwise unpublished adjusted-pseudo-$R^2$ procedure. However, you should realize that the reason that the reviewers are asking is because they want assurances that they are not seeing gibberish numbers. Now, if you can think of another way of doing exactly that, assuring the reviewer(s) that the results are reliable, then the problem should go away...

One alternative is to include more references or information about the pseudo-$R^2$ values you are using, especially if you can show robustness, or precision. For example A Lack-of-Fit Test for Quantile Regression. Are the pseudo-$R^2$ values essential to the paper, or are there other ways to accomplish the same goal?

Sometimes, just deleting the problem is the simplest thing to do. Yes, we agree with you, exalted reviewer, your majestic infallibility is worshiped, $<$grovel, grovel$>$ problem deleted.