Lesson 16 Post-Hoc Tests: N MS Q HSD
Lesson 16 Post-Hoc Tests: N MS Q HSD
Lesson 16 Post-Hoc Tests: N MS Q HSD
Post-hoc Tests
Outline
Tukeys HSD Post-hoc test
-differences between means
-studentized range statistic (q)
-honestly significant difference (HSD)
Example Tukey Problem
Magnitude of the Effect
-eta-square
-omega-square
For the Tukeys post-hoc test we will first find the differences between the means of all
of our groups. We will compare this difference score to a critical value to see if the
difference is significant. The critical value in this case is the HSD (honestly significant
difference) and it must be computed. It is the point when a mean difference becomes
honestly significantly different.
MSWithin
HSD = q Note that q is a table value, and n is the number of values we are
n
dealing with in each group (not total n). The Mean Square value is from the ANOVA
you already computed. To find q or the studentized range statistic, refer to your table
on page A-32 of your text. On the table k or the number of groups is found along the
top, and degrees of freedom within is down the side. Cross index the row and column to
find the value you need to put in the formula above.
Example
This example is a continuation of the ANOVA problem we did in the last lesson. Here I
show the groups, but have computed the average or mean of each group.
We will only be concerned with the absolute difference, so, you can ignore any negative
signs. Next we compute HSD.
MSWithin 1.43
HSD = q = 3.77 =
n 5 3.77 .286 = 3.77(.53) = 1.99
Now we will compare the difference scores we computed with the HSD value. If the
difference is larger than the HSD, then we say the difference is significant.
Magnitude of the effect is the amount of variability that our independent variable can
account for in the dependent variable. The easiest measure of the effect is eta-square
(2). It measures the proportion of our between factor variability to the total variability.
If we know what proportion of variability of the total is due to our treatment, we will
have a rough idea of how strong the relationship might be.
SS Between
2 = Notice it is just a ratio of treatment effect variability to total variability
SS total
17.2
For our example: 2 = = .50 50% of the variability in rated fear of spiders is
34.4
due to the type of therapy they received.
One problem with eta-square is that it is a biased estimate and tends to overestimate the
effect. A more accurate measure of the effect is omega-square (2).
SS Between (k 1)MSWithin
2 =
SS total + MSWithin