Hypothesis Testing – Is Testing Interaction Effect Meaningful without Significant Main Effects?

hypothesis testinginteractionmathematical-statisticsregressionstatistical significance

Suppose we have a linear regression model with two covariates, $y = \beta_0 + \beta_1 x_1 + \beta_2 x_2$.

There are three possible scenarios:

  1. Both $\beta_1$ and $\beta_2$ are significant.
  2. Either $\beta_1$ is significant and $\beta_2$ is not, or $\beta_2$ is significant and $\beta_1$ is not.
  3. Neither $\beta_1$ nor $\beta_2$ is significant.

My question is, statistically (not theoretically), under which case (scenario) is further investigation of the interaction between $x_1$ and $x_2$ meaningful? For example, investigating a model $y = \beta_0 + \beta_1 x_1 + \beta_2 x_2 + \beta_3 x_1 x_2$. I have seen many people further investigating interaction effects under scenarios 1 and 2, but I am not sure if we should also try to evaluate the interaction effect for scenario 3.

Best Answer

Yes, it makes sense to test for interactions regardless of main effects .

b1 might have a positive slope if b2 is positive, and a negative slope if b2 is negative. That means that the average effect of b1 is 0.

Real life example: When people watch you doing something, it can increase your nervous system arousal. If it's something you're very good at, that might make you better. If it's something you're bad at, it might make you worse. An audience watching people play pool makes the good players better, and the bad players worse. On average, the effect of the audience is zero. That doesn't mean that an audience doesn't have an effect.

Related Question