Solved – Is nested ANOVA model appropriate for analysing student performance on a pre/post test

anovanested datapaired-dataraschspss

I am analyzing student performance on a pre/post test designed to assess gains for a week long high school biology curriculum on natural selection.

After comparing pre/post performance using a variety of different metrics (test score, Rasch measure, chi-square per item) between the paired samples, I conducted an ANOVA to gauge whether there were differences between teachers. Two of the (seven) teachers are significantly different from the others (their students have drastically lower mean Rash measures and did worse overall), so I'd like to account for these differences in the analysis.

Is a nested ANOVA model appropriate here? I know nested models aren't in the SPSS dialogs, but I'm not much of a programmer and thus do not know what syntax to produce.

Moreover, each teacher has a different number of students. Would a random sample (ensuring the same amount from each teacher) be useful for paired comparisons of means (like pre vs. post), or does it not matter since it's a comparison of means between groups anyway?

Apologies for any obvious questions. Education is not my original field (I'm a bio-anthropologist), and it's been a bit since I took multivariate stats in grad school.

Best Answer

I figured this out after some searching and consultation with an old stats professor.

To employ a nested model ANOVA in SPSS, some editing of the syntax must be done, and the nesting effect is determined in the /DESIGN command. In the end, my syntax looked something like this (depending on your preference of parameters and posthoc tests):

UNIANOVA

  Y  BY A B

/METHOD = SSTYPE(2)
/INTERCEPT = INCLUDE
/POSTHOC = A B ( BONFERRONI )
/EMMEANS = TABLES(A) COMPARE ADJ(BONFERRONI)
/EMMEANS = TABLES(B) COMPARE ADJ(BONFERRONI)
/PRINT = DESCRIPTIVE ETASQ
/CRITERIA = ALPHA(.05)
/DESIGN = A B(A).
Related Question