Solved – How to calculate confidence intervals for I-squared in order to assess heterogeneity between two pooled studies

confidence intervalheterogeneitymeta-analysissmall-sample

I am conducting a meta analysis and for some of my pooled data, there are only two studies available. Based on this publication I have been calculating confidence intervals around I-squared in order to assess heterogeneity. I've used the equation provided in chapter 16 of Introduction to Meta-analysis (Borenstein, Hedges, & Higgins, 2011) page 124 and also described here.

Part of the calculation is obtaining B or SE[In(H)] then using this value to calculate the confidence intervals around I-squared. Two different calculations are used depending on whether Q > df+1 or Q =< df+1.

enter image description here

In my case, when I have calculated Q for pooled data with only two studies, Q is always below df+1 and therefore I've had to use equation 16.21. The problem is that this always leads to an error as the df is 1, and if you input this into equation 16.21 is it inevitably asking to divide 1 by 0, which leads to the error.

I've double checked my Q calculation and compared my output to the output I got from Comprehensive Meta-analysis, which were the same.
I have been able to successfully calculate CI around I-squared for all other pooled data when the number of pooled studies is more than 2.

Am I missing something? Heterogeneity was already low for the two studies (I-squared=0%) so does that mean it does not theoretically make sense to calculate CI for I-squared when there are only two studies with low heterogeneity? Is there a better way to calculate heterogeneity with only two studies?

Thanks!

Best Answer

You could try using confidence intervals established using the Q-profile method outlined by Viechtbauer in his 2007 paper "Confidence intervals for the amount of heterogeneity in meta-analysis" available here and used in his R package metafor. I have just tried a toy example with $I^2=0$ and two studies and got confidence intervals.

Related Question