Analysis of Variance Anova

Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

Analysis of Variance (ANOVA)

One-way ANOVA:

used to test for significant differences among sample


means

differs from t-test since more than 2 groups are tested,


simultaneously

one factor (independent variable) is analyzed, also


called the grouping variable

dependent variable should be interval or ratio but


independent variable is usually nominal
Factorial Design: - groups must be independent (i.e.,
subjects in each group are different and unrelated)
Assumptions:

data must be normally distributed or nearly

variances must be equal (i.e., homogeneity of


variance)
Examples:

Does fitness level (VO2max) depend on province


of residence? Fitness level is a ratio variable,
residence is a nominal variable.

Does statistics grade depend of highest level of


mathematics course taken?

Does hand grip strength vary with gender? (Can


be done with t-test. t-test can handle equal or
unequal variances.)

One-way ANOVA contd


An ANOVA tests whether one or more samples means are
significantly different from each other. To determine which or
how many sample means are
different requires post hoc
testing.

Two samples where


means are significantly
different.

These two sample means


are NOT significantly
different due to smaller
difference and high variability.

Even with same difference


between means, if variances are
reduced the means can be
significantly different.

One-way ANOVA contd


Step 1
H0: all sample means are equal
H1: at least one mean is different
Step 2
Find critical value from F table (Table A-5 or H).
Tables are for one-tailed test. ANOVA is always onetailed.
Step 3
Compute test value
from:

Step 4
Make decision.
If F > critical value reject H0.
Step 5
Summarize the results with ANOVA table.
All means are the same, i.e., come from the same
population or at least one mean is significantly
different.
Step 6 If a significant difference is found, perform post hoc
testing to determine which mean(s) is/are different.

ANOVA Summary Table


Source

Sums of
df
squares
Between SSB
k1
(also called Main effect)

Mean
square
SSB /(k1)=sB 2

sB 2/sW 2

Within
SSW
Nk
SSW /(Nk)=sW 2
(also called Error term)
Total
SSB +SSW
(k1)+(Nk)=N1
Examples:
One-way Factorial
Source
Sums of
squares
Between 160.13
Within
104.80
Total
264.93
Two-way Factorial
Source
Sums of
squares
Factor A 3.920
Factor B
9.690
AxB
54.080
Within
3.300
Total
70.980

df
2
12
14

df
1
1
1
4
7

Mean
square
80.07
8.73

Mean
square
3.920
9.680
65.552
0.825

F
9.17

F
4.752
11.733
79.456

P
<0.01

P
NS
<0.025
<0.005

Post Hoc Testing


Post Hoc testing

used to determine which mean or group of means is/are


significantly different from the others

many different choices depending upon research design


and research question (Bonferroni, Duncans, Scheffs,
Tukeys HSD, ...)

only done when ANOVA yields a significant F


Scheff test:

when sample sizes are unequal

when most conservative test is desired


Critical value: Use critical value from ANOVA and
multiply by k-1. k = number of groups (means)
F'critical = (k1) Fcritical

Test value:

Decision:
If Fs > F'critical, then the two means are
significantly different.
Summary:
Graph the sample means and summarize.

Post Hoc Testing contd


Bonferroni test:

used when less conservative test is desirable, i.e., more


powerful

may be used with other types of statistical tests (e.g.,


multiple t-tests)

when only some pairs of sample means are to be tested


Critical value:
Use Table A-3 or F, adjust a by dividing by
number of all possible pairings.

Test value:

Note, this is the same as taking the square root of the


Scheff test value.
Decision:
If t > tcritical, then the means are significantly
different.
Summary:
Graph the results and summarize.

Post Hoc Testing contd


Tukey HSD test:

sample sizes must be equal but a revised version permits


unequal sample sizes (i.e., Tukey-Kramer)

used when less conservative test is desirable, i.e., more


powerful

when all pairs of sample means are to be tested


Critical value:
Use Table N, where k = number of groups and
v = degrees of freedom of sW 2

Test value:

Decision:
If q > critical value, then the means are significantly
different.
Summary:
Graph the results and summarize.

You might also like