Professional Documents
Culture Documents
Lecture 10 - Factorial ANOVA & Mixed ANOVA - 1 Slide Per Page
Lecture 10 - Factorial ANOVA & Mixed ANOVA - 1 Slide Per Page
Lecture 10 - Factorial ANOVA & Mixed ANOVA - 1 Slide Per Page
• If you are working as a pair, you need to email Dr. Iankilevitch before submitting the
assignment with the name of your partner
• Only one person per pair will submit the assignment on behalf of both
individuals. Make sure to include the name of both students in your assignment.
2
Announcements
Once the assignment is submitted, you should see the following:
100
Pro tip: take a screen shot of this in Quercus – it is your receipt showing that you
submitted the work when you did!
https://community.canvaslms.com/docs/DOC-9539-421241972 3
Last Week
What is being compared?
Indep. Repeat.
Indep. Paired
1 sample
z-test samples samples
t-test
t-test t-test Between- Repeated-
subjects measures
ANOVA ANOVA 4
Last Week
What is being compared?
All
Indep. Repeat.
Indep.
Indep. Paired
1 sample
z-test samples samples
t-test
t-test t-test Between- Repeated- Between-
subjects measures subjects
ANOVA ANOVA 5
ANOVA
Last Week: Factorial ANOVA Logic
In a factorial ANOVA, we are further explaining sources of variance by including
IV2 and interaction, which come out of the error variance:
One-way ANOVA with a One-way ANOVA with a covariate Factorial ANOVA with a
between-subjects design (ANCOVA or RBD) between-subjects design
6
Last Week: Factorial ANOVA
Example Reminder: We want to examine smokers’ versus non-smokers’ dating
interest in profiles of smokers versus non-smokers. Each participant viewed
one dating profile and indicated how interested they were in going on a date
with the person in the profile.
Participants
Smokers Non-Smokers
Dating Smokers M=5 M=3
Profiles Non-Smokers M=4 M=5
Every question will have its own hypotheses to test. There are two types of hypothesis tests:
• Main effects
• Interactions 9
Factorial ANOVA – Demo
Does participants’ and profiles’ smoking status predict dating interest?
Factor B: Participants’ Smoking Status
Smokers Non-Smokers Row Means
Factor A: Profiles’ Smoking Status
3 2
6 3
Smokers 4 M=5 4 M=3 4
6 2
6 4
5 6
4 1
Non-Smokers 4 M=4 6 M=5 4.5
4 6
3 6
We found no significant main effect of profile’s smoking status, F(1,16) = 1.60, p > .05 or of
participants’ smoking status, F(1,16) = 1.60, p > .05. However, there was a significant
interaction between profiles’ and participants’ smoking status, F(1,16) = 14.42, p < .05.
*Note that we also need to include the effect sizes in these sentences. 12
We Found an Interaction
Example Graph:
Figure 1
What do we do if one or both main effects are significant and the interaction is not?
• Conduct multiple comparisons on the main effects (if necessary, i.e., if 3+ groups
compared). Do not conduct simple effects.
Overall:
• The interaction is more interesting than the main effects. Therefore, irrespective of whether
a main effect exists or not, if an interaction exists, we want to explore where the differences
are in the interaction, not the main effects. 14
Simple Effects
Simple effects = the effect of one factor/IV at individual levels of another
factor.
• We do a one-way ANOVA for one factor at each level of the other factor:
1. Profile of smoker vs. non-smoker @ smoker participants
2. Profile of smoker vs. non-smoker @ non-smoker participants
vs. vs.
15
Simple Effects
The set-up is simple and similar to a one-way ANOVA:
1. Write the hypotheses for each simple effect (no need for assumptions)
2. Calculations and source table:
Source SS df MS F
A @ B1
A @ B2
Error (Omnibus ANOVA)
Example:
Source SS df MS F
Profile @ smoker participants
Profile @ non-smoker participants
Error (Omnibus ANOVA)
16
Simple Effects - Calculations
The “new” computations is the SS – specifically, the GM.
Example:
𝟐𝟐
�𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 − 𝐺𝐺𝐺𝐺
𝑆𝑆𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = 𝑛𝑛 � 𝑥𝑥
X X
Smoking Status
Smokers X Calculate
X the
X X
new GM
X usingXthese
Non- scores
X X only
Smokers 17
X X
Simple Effects - Calculations
The “new” computations is the SS – specifically, the GM.
Example:
𝟐𝟐
�𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 − 𝐺𝐺𝐺𝐺
𝑆𝑆𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = 𝑛𝑛 � 𝑥𝑥
X X
Smoking Status
Source SS df MS F
𝑆𝑆𝑆𝑆𝐴𝐴𝐴𝐴𝐴𝐴 𝑀𝑀𝑆𝑆𝐴𝐴𝐴𝐴𝐴𝐴
A @ B1 𝑛𝑛 � 𝑥𝑥𝐴𝐴𝐴𝐴𝐴𝐴
̅ − 𝐺𝐺𝐺𝐺 𝟐𝟐
k–1 𝑑𝑑𝑑𝑑𝐴𝐴𝐴𝐴𝐴𝐴 𝑀𝑀𝑀𝑀𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
Example:
𝟐𝟐 𝑆𝑆𝑆𝑆𝐴𝐴𝐴𝐴𝐴𝐴 𝑀𝑀𝑆𝑆𝐴𝐴𝐴𝐴𝐴𝐴
A @ B2 𝑛𝑛 � 𝑥𝑥𝐴𝐴𝐴𝐴𝐴𝐴
̅ − 𝐺𝐺𝐺𝐺 k–1 𝑑𝑑𝑑𝑑𝐴𝐴𝐴𝐴𝐴𝐴 𝑀𝑀𝑀𝑀𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
3 2
6 3
Smokers 4 M=5 4 M=3
6 2
6 4
5 6
4 1
Non-
4 M=4 6 M=5
Smokers
4 6
3 6
Profile @ Smokers:
H0 = There is no simple main effect of profiles @ smokers
H1 = There is a simple main effect of profiles @ smokers
Profile @ Non-Smokers:
H0 = There is no simple main effect of profiles @ non-smokers
H1 = There is a simple main effect of profiles @ non-smokers
21
Simple Effects – Demo
Profile @ Smokers: we are comparing smoker vs. non-smoker profiles for
smoker participants
2 2
𝑆𝑆𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = 𝑛𝑛 � 𝑥𝑥̅𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 − 𝐺𝐺𝐺𝐺 = 5[ 5 − 4.5 + 4 − 4.5 2 ]
= 2.5
𝑑𝑑𝑑𝑑𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = 𝑘𝑘 − 1 = 2 − 1 = 1
𝑆𝑆𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 2.5
𝑀𝑀𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = = = 2.5
𝑑𝑑𝑑𝑑𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 1
𝑀𝑀𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 2.5
𝐹𝐹𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = = ≈3.21 22
𝑀𝑀𝑀𝑀𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 .78
Simple Effects – Demo
Profile @ Non-Smokers: we are comparing smoker vs. non-smoker profiles for
non-smoker participants
2 2
𝑆𝑆𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = 𝑛𝑛 � 𝑥𝑥̅𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 − 𝐺𝐺𝐺𝐺 = 5[ 3 − 4 + 5 − 4 2]
= 10
𝑑𝑑𝑑𝑑𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 = 𝑘𝑘 − 1 = 2 − 1 = 1
𝑆𝑆𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 10
𝑀𝑀𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑁𝑁𝑁𝑁𝑁𝑁𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆 = = = 10
𝑑𝑑𝑑𝑑𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑁𝑁𝑁𝑁𝑁𝑁𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆 1
𝑀𝑀𝑆𝑆𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃 10
𝐹𝐹𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑃𝑁𝑁𝑁𝑁𝑁𝑁𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆 = = ≈12.82 23
𝑀𝑀𝑀𝑀𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 .78
Simple Effects – Demo
Source table:
Source SS df MS F
Findings?
24
Simple Effects – Demo
Concluding Statement
25
Simple Effects
Notice that the simple effects explain the nature of the interaction.
We are calculating F again with simple effects. Therefore, simple effects tests
are still an omnibus test, meaning that, if we had 3+ groups to compare in
either Factor/IV, we would not know which means are different from which
other means.
• This could happen if we have a 3 x 2, 3 x 3, 3 x 4, 4 x 4, etc. design
When we come across this type of case, we would use all of the same
multiple comparison techniques for post hoc analyses (covered last week) as
a follow-up after conducting the simple effects tests.
• Note that we only need to do this in the case where there are 3+ groups to
compare & the simple effects test was statistically significant.
26
Decision Tree
What is being compared?
29
Mixed Design ANOVA
A mixed-design ANOVA means that some of the variables are between-
subjects and others are within-subjects (i.e., repeated measures).
30
Mixed Design Hypotheses &
Descriptives
Just like in a factorial ANOVA (from last week), we have three sets of
hypotheses: main effect of IV1, main effect of IV2, interaction
31
Mixed Design Assumptions
The assumptions are a combinations of repeated-measures ANOVA and
factorial ANOVA:
32
Mixed ANOVA Logic
The Structural Model
BS = Between-Subjects (subscript g)
WS = Within-Subjects (subscript j)
34
Mixed ANOVA Logic
The Structural Model
Apply the structural model to all participants across all cells and summate.
35
Mixed ANOVA Logic
Sum of Squares Summary
TOTAL
BETWEEN WITHIN
BS IV BS Error WS IV BS x WS WS Error
36
Mixed ANOVA Source Table
Source SS df MS F F critical
BETWEEN
BS IV
BS Error
WITHIN
WS IV
BS x WS
WS Error
TOTAL
37
Mixed ANOVA Source Table
Source SS df MS F F critical
BETWEEN
BS IV
BS Error
WITHIN
WS IV
BS x WS
WS Error
TOTAL
WS IV
𝟐𝟐
𝑛𝑛𝑛𝑛𝐵𝐵𝐵𝐵 � 𝑥𝑥𝑗𝑗̅ − 𝐺𝐺𝐺𝐺
BS Error 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 This is the same as the factorial ANOVA.
WS IV
𝟐𝟐
𝑛𝑛𝑛𝑛𝐵𝐵𝐵𝐵 � 𝑥𝑥𝑗𝑗̅ − 𝐺𝐺𝐺𝐺
𝟐𝟐
BS IV 𝑛𝑛𝑘𝑘𝑊𝑊𝑊𝑊 � 𝑥𝑥̅𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺
Remember:
BS Error 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼
(BS IV) + (BS Error) = BETWEEN
WITHIN 𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵
WS IV
𝟐𝟐
𝑛𝑛𝑛𝑛𝐵𝐵𝐵𝐵 � 𝑥𝑥𝑗𝑗̅ − 𝐺𝐺𝐺𝐺
𝟐𝟐
BS IV 𝑛𝑛𝑘𝑘𝑊𝑊𝑊𝑊 � 𝑥𝑥̅𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺
The “overall” effect of within-groups. All
BS Error 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 variability related to the within-subjects
(i.e., repeated measures) IV including
WITHIN 𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵 the effect of the condition and the error.
WS IV
𝟐𝟐
𝑛𝑛𝑛𝑛𝐵𝐵𝐵𝐵 � 𝑥𝑥𝑗𝑗̅ − 𝐺𝐺𝐺𝐺 Remember:
BETWEEN + WITHIN = TOTAL
BS x WS 𝑆𝑆𝑆𝑆𝐶𝐶𝐶𝐶𝐶𝐶𝐶𝐶𝐶𝐶 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 − 𝑆𝑆𝑆𝑆𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼
𝟐𝟐
BS IV 𝑛𝑛𝑘𝑘𝑊𝑊𝑊𝑊 � 𝑥𝑥̅𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺
BS x WS 𝑆𝑆𝑆𝑆𝐶𝐶𝐶𝐶𝐶𝐶𝐶𝐶𝐶𝐶 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 − 𝑆𝑆𝑆𝑆𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼 This is the same as factorial ANOVA.
𝟐𝟐
BS IV 𝑛𝑛𝑘𝑘𝑊𝑊𝑊𝑊 � 𝑥𝑥̅𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺
We need two steps for this.
BS Error 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵𝐵 − 𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼
𝟐𝟐
BS IV 𝑛𝑛𝑘𝑘𝑊𝑊𝑊𝑊 � 𝑥𝑥̅𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺
WS IV
𝟐𝟐
𝑛𝑛𝑛𝑛𝐵𝐵𝐵𝐵 � 𝑥𝑥𝑗𝑗̅ − 𝐺𝐺𝐺𝐺
𝟐𝟐
BS IV 𝑛𝑛𝑘𝑘𝑊𝑊𝑊𝑊 � 𝑥𝑥̅𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺
WS IV
𝟐𝟐
𝑛𝑛𝑛𝑛𝐵𝐵𝐵𝐵 � 𝑥𝑥𝑗𝑗̅ − 𝐺𝐺𝐺𝐺
BS IV 𝑘𝑘𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 − 1
WS IV 𝑘𝑘𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼 − 1
TOTAL 𝑁𝑁 − 1
50
Mixed ANOVA Calculations
Source MS
BETWEEN -
𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼
BS IV
𝑑𝑑𝑑𝑑𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼
𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
BS Error
𝑑𝑑𝑑𝑑𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
WITHIN -
𝑆𝑆𝑆𝑆𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼
WS IV
𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼
𝑆𝑆𝑆𝑆𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼
BS x WS
𝑑𝑑𝑑𝑑𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼
𝑆𝑆𝑆𝑆𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
WS Error
𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
TOTAL - 51
Mixed ANOVA Calculations
Source F F critical
BETWEEN - -
𝑀𝑀𝑆𝑆𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼
BS IV 𝑈𝑈𝑈𝑈𝑈𝑈:
𝑀𝑀𝑀𝑀𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 𝑑𝑑𝑑𝑑𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 , 𝑑𝑑𝑑𝑑𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
BS Error - -
WITHIN - -
𝑀𝑀𝑆𝑆𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼
WS IV 𝑈𝑈𝑈𝑈𝑈𝑈:
𝑀𝑀𝑀𝑀𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼 , 𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
𝑀𝑀𝑆𝑆𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼
BS x WS 𝑈𝑈𝑈𝑈𝑈𝑈:
𝑀𝑀𝑀𝑀𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 𝑑𝑑𝑑𝑑𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼𝐼 , 𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸
WS Error - -
TOTAL - - 52
Mixed ANOVA – Demo
We have devised a new treatment for people who are afraid of public speaking. We recruit 8
subjects (all of whom have this phobia) to see whether the treatment works. Four subjects
get the treatment; the other four are in a control group. We measure the degree of each
subject’s phobia repeatedly (i.e., 3 times): 1) before the treatment, 2) after the treatment,
and 3) in a follow-up test 6 months later. The subjects’ scores are provided below (higher
scores mean more phobic). Use the appropriate ANOVA to analyze these data.
Subject Group Before After Follow-Up
1 Treatment 8 4 6
2 Treatment 9 4 7
3 Treatment 6 3 5
4 Treatment 7 4 7
5 Control 9 8 7
6 Control 7 7 8
7 Control 7 6 7
8 Control 6 7 7 53
Mixed ANOVA – Demo
Descriptive information (means):
Subject Group Group Means Before After Follow-Up Subject Means
1 6
2 6.67
Treatment 5.83 7.5 3.75 6.25
4 4.67
4 6
5 8
6 7.33
Control 7.17 7.25 7 7.25
7 6.67
8 6.67
Column Means: 7.38 5.38 6.75 GM: 6.5
54
Mixed ANOVA – Demo
Step 1: Hypotheses
55
Mixed ANOVA – Demo
Step 2: Assumptions
57
Mixed ANOVA – Demo
Step 3: Calculations
First, let’s compute all the effects of the IV’s (BS IV, WS IV, & Interaction)
BS IV: 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑛𝑛𝑛𝑛 𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 ∑ 𝑥𝑥̅ 𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 − 𝐺𝐺𝐺𝐺 𝟐𝟐 = 4 3 5.83 − 6.5 2 + 7.17 − 6.5 2 =
𝟏𝟏𝟏𝟏. 𝟔𝟔𝟔𝟔
WS IV: 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑛𝑛𝑛𝑛 𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 ∑ 𝑥𝑥̅ 𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 − 𝐺𝐺𝐺𝐺 𝟐𝟐 = 4 2 [ 7.38 − 6.5 2 + 5.38 − 6.5 2 +
6.75 − 6.5 2 ] = 𝟏𝟏𝟏𝟏. 𝟕𝟕𝟕𝟕
Interaction:𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑺𝑺𝑺𝑺𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪 − 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 − 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝟒𝟒𝟒𝟒 − 𝟏𝟏𝟏𝟏. 𝟔𝟔𝟔𝟔 − 𝟏𝟏𝟏𝟏. 𝟕𝟕𝟕𝟕 = 𝟏𝟏𝟏𝟏. 𝟓𝟓𝟓𝟓
58
Mixed ANOVA – Demo
Step 3: Calculations
𝟐𝟐
Total: 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = ∑ 𝑥𝑥𝑖𝑖𝑖𝑖𝑖𝑖 − 𝐺𝐺𝐺𝐺 = [ 8 − 6.5 2 + 4 − 6.5 2 + 6 − 6.5 2 + 9 − 6.5 2 +
4 − 6.5 2 + 7 − 6.5 2 + 6 − 6.5 2 + 3 − 6.5 2 + 5 − 6.5 2 + 7 − 6.5 2 + (4 −
6.5)2 + 7 − 6.5 2 + 9 − 6.5 2 + 8 − 6.5 2 + 7 − 6.5 2 + 7 − 6.5 2 + 7 − 6.5 2 +
8 − 6.5 2 + 7 − 6.5 2 + 6 − 6.5 2 + 7 − 6.5 2 + 6 − 6.5 2 + 7 − 6.5 2 + (7 −
6.5)2 ] = 𝟓𝟓𝟓𝟓
59
Mixed ANOVA – Demo
Step 3: Calculations
WS Error: 𝑺𝑺𝑺𝑺𝑾𝑾𝑾𝑾 𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝑺𝑺𝑺𝑺𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾 − 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 − 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻 = 𝟑𝟑𝟑𝟑. 𝟑𝟑𝟑𝟑 − 𝟏𝟏𝟏𝟏. 𝟕𝟕𝟕𝟕 − 𝟏𝟏𝟏𝟏. 𝟓𝟓𝟓𝟓 = 𝟔𝟔
BS Error: 𝑺𝑺𝑺𝑺𝑩𝑩𝑩𝑩 𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝑺𝑺𝑺𝑺𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩 − 𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝟐𝟐𝟐𝟐. 𝟔𝟔𝟔𝟔 − 𝟏𝟏𝟏𝟏. 𝟔𝟔𝟔𝟔 = 𝟏𝟏𝟏𝟏
60
Mixed ANOVA – Demo
Step 3: Calculations
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑁𝑁 − 1 = 24 − 1 = 𝟐𝟐𝟐𝟐
𝒅𝒅𝒅𝒅𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩 = 𝑘𝑘𝑠𝑠𝑠𝑠𝑠𝑠 − 1 = 8 − 1 = 𝟕𝟕
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 − 1 = 2 − 1 = 𝟏𝟏
𝒅𝒅𝒅𝒅𝑩𝑩𝑩𝑩 𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝒅𝒅𝒅𝒅𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩 − 𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝟕𝟕 − 𝟏𝟏 = 𝟔𝟔
𝒅𝒅𝒅𝒅𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾 = 𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 − 𝒅𝒅𝒅𝒅𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩𝑩 = 𝟐𝟐𝟐𝟐 − 𝟕𝟕 = 𝟏𝟏𝟏𝟏
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼 − 1 = 3 − 1 = 𝟐𝟐
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘𝐵𝐵𝐵𝐵 𝐼𝐼𝐼𝐼 − 1 𝑘𝑘𝑊𝑊𝑊𝑊 𝐼𝐼𝐼𝐼 − 1 = 2 − 1 3 − 1 = 𝟐𝟐
𝒅𝒅𝒅𝒅𝑾𝑾𝑾𝑾 𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝒅𝒅𝒅𝒅𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾𝑾 − 𝒅𝒅𝒅𝒅𝑾𝑾𝑾𝑾 𝑰𝑰𝑰𝑰 − 𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻 = 𝟏𝟏𝟏𝟏 − 𝟐𝟐 − 𝟐𝟐 = 𝟏𝟏𝟏𝟏
61
Mixed ANOVA – Demo
Source SS df MS F F critical
BETWEEN 20.67 7
Treatment 10.67 1
BS Error 10 6
WITHIN 35.33 16
Time 16.75 2
Treat x Time 12.58 2
WS Error 6 12
TOTAL 56 23
62
Mixed ANOVA – Demo
Step 3: Calculations
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 10.67
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = = = 10.67 𝑀𝑀𝑀𝑀𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 10.67
𝑑𝑑𝑑𝑑𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 1 𝑭𝑭𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = = = 6.39
𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 10 𝑀𝑀𝑀𝑀𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 1.67
𝑴𝑴𝑴𝑴𝑩𝑩𝑩𝑩 𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = = = 1.67
𝑑𝑑𝑑𝑑𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 6
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 16.75 𝑀𝑀𝑀𝑀𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 8.38
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = = = 8.38 𝑭𝑭𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = = = 16.76
𝑑𝑑𝑑𝑑𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 2 𝑀𝑀𝑀𝑀𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 .5
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇 12.58 𝑀𝑀𝑀𝑀𝑇𝑇𝑇𝑇𝑇𝑇 6.29
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻 = = = 6.29 𝑭𝑭𝑻𝑻𝑻𝑻𝑻𝑻 = = = 12.58
𝑑𝑑𝑑𝑑𝑇𝑇𝑇𝑇𝑇𝑇 2 𝑀𝑀𝑀𝑀𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 .5
𝑆𝑆𝑆𝑆𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 6
𝑴𝑴𝑴𝑴𝑾𝑾𝑾𝑾 𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = = = .5
𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 12
63
Mixed ANOVA – Demo
Source SS df MS F F critical
BETWEEN 20.67 7
Treatment 10.67 1 10.67 6.39
BS Error 10 6 1.67
WITHIN 35.33 16
Time 16.75 2 8.38 16.76
Treat x Time 12.58 2 6.29 12.58
WS Error 6 12 .5
TOTAL 56 23
64
Mixed ANOVA – Demo
Step 4: Find the cut-off value
Source SS df MS F F critical
BETWEEN 20.67 7
Treatment 10.67 1 10.67 6.39 Use: 1,6
BS Error 10 6 1.67
WITHIN 35.33 16
Time 16.75 2 8.38 16.76 Use: 2,12
Treat x Time 12.58 2 6.29 12.58 Use: 2,12
WS Error 6 12 .5
TOTAL 56 23
65
Mixed ANOVA – Demo
Source SS df MS F F critical
BETWEEN 20.67 7
Treatment 10.67 1 10.67 6.39 5.99
BS Error 10 6 1.67
WITHIN 35.33 16
Time 16.75 2 8.38 16.76 3.89
Treat x Time 12.58 2 6.29 12.58 3.89
WS Error 6 12 .5
TOTAL 56 23
66
Mixed ANOVA – Demo
Step 5: Make a decision about each main effect and interaction
Source SS df MS F F critical
BETWEEN 20.67 7
Treatment 10.67 1 10.67 6.39 5.99
BS Error 10 6 1.67
WITHIN 35.33 16
Time 16.75 2 8.38 16.76 3.89
Treat x Time 12.58 2 6.29 12.58 3.89
WS Error 6 12 .5
TOTAL 56 23
67
Mixed ANOVA – Demo
Step 6: Calculate effect size (and write the complete concluding sentences).
𝑆𝑆𝑆𝑆𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒
Reminder: η2𝑝𝑝 =
𝑆𝑆𝑆𝑆𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒 +𝑆𝑆𝑆𝑆𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 10.67
Treatment: η2𝑝𝑝 = = . 52
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 +𝑆𝑆𝑆𝑆𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 10.67+10
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 16.75
Time: η2𝑝𝑝 = = = .74
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 +𝑆𝑆𝑆𝑆𝑊𝑊𝑆𝑆 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 16.75+6
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇 12.58
Interaction: η2𝑝𝑝 = = . 68
𝑆𝑆𝑆𝑆𝑇𝑇𝑇𝑇𝑇𝑇 +𝑆𝑆𝑆𝑆𝑊𝑊𝑆𝑆 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 12.58+6
68
Mixed ANOVA – Demo
Step 6: Calculate effect size (and write the complete concluding sentences).
There was a significant main effect of Treatment, F(1,6) = 6.39, p < .05,
η2𝑝𝑝 =.52. Participants in the treatment condition have significantly lower phobia
levels (Mean = 5.83) relative to participants in the control condition (Mean =
7.17). There was a significant main effect of Time, F(2,12) = 16.76, p < .05,
η2𝑝𝑝 =.74. We will not conduct multiple comparisons for this main effect because
it is qualified by a significant interaction between Treatment and Time, F(2,12) =
12.58, p < .05, η2𝑝𝑝 =.68.
69
Mixed ANOVA Simple Effects – Demo
There are two ways that we can run these simple effects analyses. In this
demo, I will show you both ways for the sake of demonstration. However, when
we conduct simple effects analyses in reality, we only choose ONE set and
never conduct both.
1st way: we will be testing the simple effect of treatment at different times:
1. Treatment vs. control @ BEFORE
2. Treatment vs. controls @ AFTER
3. Treatment vs. control @ FOLLOW-UP
70
Mixed ANOVA Simple Effects – Demo
Step 1: Hypotheses
Treatment @ BEFORE:
H0 = There is no simple main effect of treatment @ BEFORE
H1 = There is a simple main effect of treatment @ BEFORE
Treatment @ AFTER:
H0 = There is no simple main effect of treatment @ AFTER
H1 = There is a simple main effect of treatment @ AFTER
Treatment @ FOLLOW-UP:
H0 = There is no simple main effect of treatment @ FOLLOW-UP
H1 = There is a simple main effect of treatment @ FOLLOW-UP
71
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
First, we need to understand whether the variable being tested, i.e., “treatment”
in this case, is a between-subjects or within-subjects variable.
To find the error term, we need to ADD the between-subjects and the within-
subjects error terms together (both SS and df) and re-calculate MS Error.
72
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
73
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
𝟐𝟐
𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = n � 𝑥𝑥̅ 𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇 − 𝐺𝐺𝐺𝐺 = 4 (3.75 − 5.38)2 +(7 − 5.38)2 = 𝟐𝟐𝟐𝟐. 𝟏𝟏𝟏𝟏
𝟐𝟐
𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 = n � 𝑥𝑥̅ 𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇𝑇−𝑈𝑈𝑈𝑈 − 𝐺𝐺𝐺𝐺 = 4 (6.25 − 6.75)2 +(7.25 − 6.75)2
= 𝟐𝟐
74
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘 − 1 = 2 − 1 = 𝟏𝟏
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘 − 1 = 2 − 1 = 𝟏𝟏
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 = 𝑘𝑘 − 1 = 2 − 1 = 𝟏𝟏
𝒅𝒅𝒅𝒅𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝑑𝑑𝑑𝑑𝐵𝐵𝐵𝐵 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 + 𝑑𝑑𝑑𝑑𝑊𝑊𝑊𝑊 𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 = 6 + 12 = 𝟏𝟏𝟏𝟏
75
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
𝑆𝑆𝑆𝑆𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 2
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 = = = 2 𝑭𝑭𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 = 𝑀𝑀𝑀𝑀𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 = 2
𝑑𝑑𝑑𝑑𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻−𝑼𝑼𝑼𝑼 1 𝑀𝑀𝑀𝑀𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 .89
= 2.25
𝑆𝑆𝑆𝑆𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸𝐸 16
𝑴𝑴𝑴𝑴𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = = = .89
𝑑𝑑𝑑𝑑𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 18 76
Mixed ANOVA Simple Effects – Demo
Source table:
Source SS df MS F F critical
Error 16 18 .89
Source SS df MS F F critical
Error 16 18 .89
Source SS df MS F F critical
Error 16 18 .89
Source SS df MS F F critical
Error 16 18 .89
2nd way: we will be testing the simple effect of times at treatment and at control:
1. Before vs. after vs. follow-up @ TREATMENT
2. Before vs. after vs. follow-up @ CONTROL
81
Mixed ANOVA Simple Effects – Demo
Step 1: Hypotheses
Time @ TREATMENT:
H0 = There is no simple main effect of time @ TREATMENT
H1 = There is a simple main effect of time @ TREATMENT
Time @ CONTROL:
H0 = There is no simple main effect of time @ CONTROL
H1 = There is a simple main effect of time @ CONTROL
82
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
First, we need to understand whether the variable being tested, i.e., “time” in
this case, is a between-subjects or within-subjects variable.
For these analyses, we will need to calculate NEW error terms – we cannot get
them out of the omnibus ANOVA. To do this, we will treat each simple effect
analysis as its own repeated-measures ANOVA, and calculate the error term
from scratch each time (i.e., we do not borrow anything from the omnibus
83
table).
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
Let’s begin with Time @ TREATMENT:
H0 = There is no simple main effect of time @ TREATMENT
H1 = There is a simple main effect of time @ TREATMENT
If it helps, you can break down the dataset into two separate analyses:
Subject Group Before After Follow-Up
1 Treatment 8 4 6
2 Treatment 9 4 7
3 Treatment 6 3 5
4 Treatment 7 4 7
𝟐𝟐
𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = � x − 𝐺𝐺𝐺𝐺 = (8 − 5.83)2 +(9 − 5.83)2 +(6 − 5.83)2 +(7 − 5.83)2 +(4 − 5.83)2
+(4 − 5.83)2 +(3 − 5.83)2 +(4 − 5.83)2 +(6 − 5.83)2 +(7 − 5.83)2 +(5 − 5.83)2 +(7 − 5.83)2
= 𝟑𝟑𝟑𝟑. 𝟔𝟔𝟔𝟔
𝟐𝟐
𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺 = k � 𝑥𝑥𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆
̅ − 𝐺𝐺𝐺𝐺
85
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
Degrees of freedom:
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑁𝑁 − 1 = 12 − 1 = 𝟏𝟏𝟏𝟏
𝒅𝒅𝒅𝒅𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺 = 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 − 1 = 4 − 1 = 𝟑𝟑
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘 − 1 = 3 − 1 = 𝟐𝟐
𝒅𝒅𝒅𝒅𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝑁𝑁 − 𝑘𝑘 − 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 + 12 − 4 − 3 + 1 = 𝟔𝟔
MS:
𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 29.17
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = = 14.58
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 2
𝑺𝑺𝑺𝑺𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 2.17
𝑴𝑴𝑴𝑴𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = = .36
𝒅𝒅𝒅𝒅𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 6
F:
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 14.58
𝑭𝑭 = = = 40.38 86
𝑴𝑴𝑴𝑴𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 .36
Mixed ANOVA Simple Effects – Demo
Source table:
Source SS df MS F F critical
Subject 6.33 3
Total 37.67 11
Conclusion: There is a simple main effect of time for people in the treatment
group, F(2,6) = 40.51, p < .05. Multiple comparisons are necessary to
determine which of the time points (i.e., before, after, and follow-up) are
significantly different. 87
Mixed ANOVA Simple Effects – Demo
Multiple Comparisons
Given that no a priori hypotheses were stated, we will run post-hoc tests.
However, the issue is that given that the time variable is within-subjects in
nature, we will need to re-calculate the error term again for each of the three t-
tests we will run. The reason for this is because the MS error term calculated in
the simple effects ANOVA source table (i.e., .36) contains all three groups.
What we will do: post-hoc t-tests (we will use paired-samples t-tests with
Bonferroni correction, i.e., Dunn’s t table).
𝐷𝐷 − 0 3.75 − 0
𝑡𝑡 = 𝑠𝑠 = = 7.83
𝐷𝐷 .9574
𝑁𝑁𝐷𝐷 4
Given that 3 does not appear in Dunn’s table, we use the closest value (df = 5)
& we have 3 comparisons. Therefore, t critical = 3.53
Therefore, reject H0
89
Mixed ANOVA Simple Effects – Demo
Multiple Comparisons
𝐷𝐷 − 0 1.25 − 0
𝑡𝑡 = 𝑠𝑠 = = 2.61
𝐷𝐷 .9574
𝑁𝑁𝐷𝐷 4
Given that 3 does not appear in Dunn’s table, we use the closest value (df = 5)
& we have 3 comparisons. Therefore, t critical = 3.53
𝐷𝐷 − 0 2.50 − 0
𝑡𝑡 = 𝑠𝑠 = = 8.66
𝐷𝐷 .9574
𝑁𝑁𝐷𝐷 4
Given that 3 does not appear in Dunn’s table, we use the closest value (df = 5)
& we have 3 comparisons. Therefore, t critical = 3.53
Therefore, reject H0
91
Mixed ANOVA Simple Effects – Demo
Conclusion
But wait! We’re still not done! This was only time @ TREATMENT! We still
have to analyze the simple effect of time @ CONTROL!
92
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
Now we are calculating Time @ CONTROL:
H0 = There is no simple main effect of time @ CONTROL
H1 = There is a simple main effect of time @ CONTROL
If it helps, you can break down the dataset into two separate analyses:
Subject Group Before After Follow-Up
5 Control 9 8 7
6 Control 7 7 8
7 Control 7 6 7
8 Control 6 7 7
𝟐𝟐
𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = � x − 𝐺𝐺𝐺𝐺 = (9 − 7.17)2 +(8 − 7.17)2 +(7 − 7.17)2 +(7 − 7.17)2 +(7 − 7.17)2
+(8 − 7.17)2 +(7 − 7.17)2 +(6 − 7.17)2 +(7 − 7.17)2 +(6 − 7.17)2 +(7 − 7.17)2 +(7 − 7.17)2
= 𝟕𝟕. 𝟔𝟔𝟔𝟔
𝟐𝟐
𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺 = k � 𝑥𝑥𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆𝑆
̅ − 𝐺𝐺𝐺𝐺
94
Mixed ANOVA Simple Effects – Demo
Step 2: Calculations
Degrees of freedom:
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑁𝑁 − 1 = 12 − 1 = 𝟏𝟏𝟏𝟏
𝒅𝒅𝒅𝒅𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺𝑺 = 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 − 1 = 4 − 1 = 𝟑𝟑 Same as the 1st way
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = 𝑘𝑘 − 1 = 3 − 1 = 𝟐𝟐
𝒅𝒅𝒅𝒅𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 𝑁𝑁 − 𝑘𝑘 − 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 + 12 − 4 − 3 + 1 = 𝟔𝟔
MS:
𝑺𝑺𝑺𝑺𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪 = .17
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻 = = .08
𝒅𝒅𝒅𝒅𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪 = 2
𝑺𝑺𝑺𝑺𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 3.83
𝑴𝑴𝑴𝑴𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = = .64
𝒅𝒅𝒅𝒅𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 = 6
F:
𝑴𝑴𝑴𝑴𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑻𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪𝑪 .08
𝑭𝑭 = = = .13 95
𝑴𝑴𝑴𝑴𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬𝑬 .64
Mixed ANOVA Simple Effects – Demo
Source table:
Source SS df MS F F critical
Subject 3.67 3
Total 7.67 11
Conclusion: There is no a simple main effect of time for people in the control
group, F(2,6) = .13, p < .05. Multiple comparisons are not necessary to
determine which of the time points (i.e., before, after, and follow-up) are
significantly different because there are no significant differences. 96
Thank You!
Note about Distribution of Course
Materials
Lectures and lecture materials are the intellectual
property of the professor for PSYC08 at the University
of Toronto. You may not share these materials with anyone
not enrolled in this course or post them on the Internet.