Solved – Anova one way (getting different p-values in calculator and F table). Why

anova

I am resolving an anova one-way exercise. But I am doubtful because when using the F-table to get the p-value, I am getting a probability around 2.2 (an obvious error), but if I use a calculator the probability is 0.042.

I have an independent variable with 4 levels. The mean and standard deviation are this:

N         Mean         Standard Deviation
10         4.3          2.2
10         3.8          1.6
10         4.9          1.9
10         6.3          2.1

I did these calculations:

Grand mean = 4.8.

Sum of squares between groups = 35.07.

Sum of squares within groups = 138.7.

The degrees of freedom between groups is 3, the degree of freedom within groups is 36.

So with this I get a value of 3.

With this f value I check the f table for a 5% of significance level, using a degree of freedom of 3 in the numerator and 36 in the denominator and the value in the table is around 2.2. So I'm not understanding why I get 2.2 and the calculator gives 0.042. Do you have any idea?

Best Answer

The value you're looking up in the table is a critical value, not a p-value. There's no contradiction when they differ since they're not at all the same thing.

(However, at the 5% level you mention, I don't get a critical value of 2.2 when I look up an F with 3 and 36 df. Instead I get 2.866. Did you mistakenly look up the 10% critical value?)

Note that when you looked up the table your data values didn't come into what you looked up at all. Only the degrees of freedom and the significance level. What you looked up is the smallest F value that would be significant at the 5% level, which you compare your F with; if it's at least that large, you have a significant F. (That F value is 2.87. Your F value was 3.03 which was larger than it, so you would reject the null if you did it that way)

This is completely consistent with getting a p-value below 0.05:

Density for F(3,36) showing 5% critical value and calculated F, as well as the shaded area to the right of the calculated F which is the p-value of 0.042

We can see that there are two ways you can get the outcome of the hypothesis test:

(i) see if the F value is greater than the critical F from the table

(ii) see if the p-value is less than the significance level.

You can do whichever one of the two is convenient (done correctly, they give identical reject/don't reject decisions).

In general, if you have a p-value (say from computer output), you will compare that with the significance level, but if you are working "by hand" and have only tables, compare the F with the F critical value. Note that if you're using tables you often need to get values not in the table.

Related Question