Download as pdf or txt
Download as pdf or txt
You are on page 1of 62

OFFICIAL (CLOSED) \ NON-SENSITIVE

Interactive
Seminar

IO04: QUANTITATIVE RESEARCH


(PART II)
OFFICIAL (CLOSED) \ NON-SENSITIVE

Learning Outcomes

• Explain the differences between descriptive statistics


and inferential statistics

• Apply T-test and ANOVA to compare group means

• Analyse considerations in quantitative research


OFFICIAL (CLOSED) \ NON-SENSITIVE

Recap of Lesson 3

Research Design

Survey Method

Constructs and Measures

Descriptive Statistics

Sampling Methods
OFFICIAL (CLOSED) \ NON-SENSITIVE

Discussion Revisited
Your school will be embarking on a “Happiness
Project” to enhance the mental wellbeing of
students by reducing the stress level of students.

The Office of Student Welfare would like to find


out whether they should target the activities at
the general population or at specific groups of
students. Your team has been roped in to apply
the scientific method to answer this question

In the previous lesson, we discussed the following:


- research questions
- research design
- constructs to be studied
- propose measures to be used
- propose sampling method
OFFICIAL (CLOSED) \ NON-SENSITIVE

Then, in your pre-class work, you


collected stress level data from RP
students. So, what do we do with
the data to answer our question?
INFERENTIAL STATISTICS:
HYPOTHESIS TESTING (T-TEST)
Hypothesis Testing & T-test
Watch the video on T-test and answer the following questions:
https://www.youtube.com/watch?v=0zZYBALbZgg

1. What are the 5 steps in hypothesis


testing?
2. What is the alpha value that we
usually use in hypothesis testing?
3. What are the two samples in the T-
test example?
4. Hypothesis testing always apply to
sample means and not individual
observations. TRUE/FALSE

Dr Nic's Maths and Stats. (2011). Hypothesis testing: step-by-step, p-value, t-test for difference of two means - Statistics Help.
Retrieved from https://www.youtube.com/watch?v=0zZYBALbZgg
OFFICIAL (CLOSED) \ NON-SENSITIVE

Hypothesis Testing & T-test

• Compares whether two groups’


means are significantly different
(not due to random chance)

• Independent samples
– Values collected from two different groups
– Two types:
• Assuming equal variance / unequal variance
– Conduct an f-test to determine

• Paired samples
– Paired measurements taken from the same group of
people
• Samples are “related” to each other
OFFICIAL (CLOSED) \ NON-SENSITIVE

Comparing Samples
Consider this example:

You want to know if Xciting Polytechnic (XP) students are


more intelligent than Republic Polytechnic (RP) students.

You randomly selected 500 XP and 500 RP students and


administered a well-established IQ test to each of them.
The mean score for XP = 109 and RP = 100. The higher
the score, the more intelligent you are.

Why might it be inaccurate to say the XP students are more


intelligent than RP students, based on this test?
OFFICIAL (CLOSED) \ NON-SENSITIVE

The Normal Distribution


Most psychological data, when in sufficiently large numbers:
– Approximate the normal curve (or normal distribution)
where scores are concentrated in the middle and decline
in frequency further from the middle, in a fairly symmetrical
way.
– Tend to look like this when represented graphically.
Common
Outcomes

Uncommon Uncommon
Outcomes Outcomes

Rare Rare
Outcomes Outcomes

mean
OFFICIAL (CLOSED) \ NON-SENSITIVE

The Normal Distribution


The normal distribution is like any other frequency distribution,
but with a few specific properties:
• It is a symmetrically distributed with a bump in the middle
with tails to the left and right
• The values of the mean and median of the distribution are
the same and are located in the middle of the distribution

Sharma, R. (2019). Why is Normal Distribution Bell Shaped? Retrieved from


https://medium.com/@rishisharma2628/why-is-normal-distribution-bell-shaped-80a784955e92
OFFICIAL (CLOSED) \ NON-SENSITIVE

Standard Deviation
If a distribution is normal, the following empirical rules apply:
• ~ 68% of all values in the distribution lie within 1 standard deviation
of the mean
• ~ 95% of all values in the distribution lie within 2 standard deviations
of the mean
• ~ 99.7%of all values in the distribution lie within 3 standard
deviations of the mean
Standard Deviation
• It roughly describes how far
away the typical observation is
from the mean. We call the
distance of an observation
from its mean its deviation.

Sharma, R. (2019). Why is Normal Distribution Bell Shaped? Retrieved from


https://medium.com/@rishisharma2628/why-is-normal-distribution-bell-shaped-80a784955e92
OFFICIAL (CLOSED) \ NON-SENSITIVE
OFFICIAL (CLOSED) \ NON-SENSITIVE

Comparing Samples
Applying the normal distribution to the scenario:
RP
• The RP distribution will
look something like this:

• While the XP distribution will 100


look something like this: XP

109
OFFICIAL (CLOSED) \ NON-SENSITIVE

Comparing Samples
• The mean score of the XP sample in the IQ test is 109. The
diagram below shows RP’s IQ distribution, with the XP
sample’s mean IQ included.
• From this, we can see that at least 16% of all RP samples
performed above the XP mean.

RP XP
Based on the
sample, can you
conclude that XP
students are more
intelligent than RP
students?

100 109
OFFICIAL (CLOSED) \ NON-SENSITIVE

Comparing Samples
• Researchers typically use 1 – 10% as the limit
– Based on the distribution curve, what are the
chances of an RP student scoring higher or RP XP
equal to XP’s mean? Is it </= 10%?
– I.e., are the observed scores distinct
enough to assume that RP and XP
students are inherently different?

100 109

• In this case, conclude that XP students are not more intelligent than
RP students or intelligence levels between the students of RP and
XP are not significantly different.
– XP sample mean having a higher score than RP sample mean is
probably due to random error (luck of draw) into the sample.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Comparing Samples
RP XP
• Now, assume that the XP sample’s
mean IQ is within the top 2.5%
of RP’s IQ distribution.

100 109

• Conclusion: Intelligence levels between the students of RP and XP


are significantly different
– If RP and XP students have similar intelligence levels, then you would
not expect XP’s sample mean score to be so extreme, since the sample
was drawn randomly.
– Reasonable to assume that the difference in scores is so extreme
because the XP population is different from the RP population.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Hypothesis Testing & T-test


Hypothesis is a tentative statement about the
relationship between two or more variables or groups; it
is testable and can be evaluated from observable data
Null Hypothesis → always assumes that there is no
difference between 2 groups
• E.g., no difference in intelligence levels of XP and RP students

Alternative Hypothesis → what you speculate as the


outcome of a research or experiment:
• Directional hypothesis: One-tailed (e.g., greater than).
• Non-directional hypothesis: Two-tailed (e.g., difference).
OFFICIAL (CLOSED) \ NON-SENSITIVE

Hypothesis Testing & T-test


One population’s score will be lower than
the other’s (e.g., XP students are less
intelligent than RP students).
• Directional hypothesis, one-tailed

One population’s score will be higher


than the other’s (e.g., XP students are more
intelligent than RP students).
• Directional hypothesis, one-tailed

The two populations have different


scores (e.g., intelligence level of XP and RP
students are not the same).
• Non-directional hypothesis, two-tailed
OFFICIAL (CLOSED) \ NON-SENSITIVE

Discussion
We have learnt about descriptive statistics in the
previous lesson and inferential statistics today.

So what are the differences between the two?


OFFICIAL (CLOSED) \ NON-SENSITIVE

Discussion
The differences between Descriptive and Inferential statistics:

Descriptive Statistics Inferential Statistics


Statistics that summarize, Statistics used to aid the researcher
organize, and describe a in testing hypotheses and making
sample of data. inferences from sample data to a
larger sample or population.

Source: https://www.cuemath.com/data/descriptive-and-inferential-statistics/
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 1
Identify if each of the scenarios is a one-tailed or two-tailed
test and write possible hypotheses for each of them.

a) The new Minister for Transport has implemented a new train


maintenance method to replace the old method, in order to address
the problem of the frequently breaking down trains. He would like to
find out if this method does indeed reduce the number of train
breakdowns.

b) CookieMama produces cookies that are 9.2cm in diameter. A quality


control specialist regularly checks the cookies’ diameter to ensure
that the standards are maintained. On one production run, he took
a random sample of n = 20 cookies and measured their diameter.
Just for laughs!

Statisticians love
whoever they spend the
most time with; that’s
their statistically
significant other.

Source: https://datasciencedojo.com/community/jokes/
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a T-test using Excel

• Hypothesis:

– Null hypothesis H0 : There is no difference in the average


compensation between people working in construction and
people working in manufacturing.

– Alternative hypothesis H1 :There is a difference in the


average compensation between the construction sample
and manufacturing sample.

• Follow the steps in the following slides to conduct a


T-test in Microsoft Excel
Worksheet Question 2

• Step 1: Arrange data in spreadsheet for easier analysis

Label the 2 columns of data


Worksheet Question 2

• Step 2: While on the “Data” tab, click on “Data Analysis”


button.
• Follow this link if you are unable to find the “Data
Analysis” button: http://www.excel-easy.com/data-
analysis/analysis-toolpak.html
Worksheet Question 2

• Step 3: Select t-test: Two-Sample Assuming Unequal


Variances and click OK.
Worksheet Question 2

• Step 4: Click in the Variable 1 Range box and select the


range.
• Do likewise for Variable 2 Range, but selecting the other
variable instead.
Worksheet Question 2

• Step 5: Enter “0” for the “Hypothesized Mean


Difference”.
• When the hypothesized mean difference is “0”, it means
your null hypothesis is that there is no difference in
means between the groups you are comparing.
Worksheet Question 2

• Step 6: Ensure that the checkbox for “Labels” is ticked.


• Leave “Alpha” at 0.05.
• Alpha levels are usually adjusted depending on how
strict you want the test to be. The lower the Alpha, the
stricter the test.
Worksheet Question 2

• Step 7: Choose the “Output Range” option.


• Click in the “Output Range” box, and select any cell
where you would like the output to be displayed.
Worksheet Question 2

• Step 8: Click “Ok” and obtain your results.


• You should get an output similar to this.
Interpreting T-test results
• Hypothesis:
– Null hypothesis H0 : There is no difference in the average compensation
between the construction sample and manufacturing sample.
– Alternative hypothesis H1 : There is a difference in the average compensation
between the construction sample and manufacturing sample.
– Two-tailed test: no prediction made on which industry earns more

• Compare the p value against the α value that was set (since this is a two-tailed test,
we look at “P(T<=t) two-tail)”
– In this case, we observe that p < α (0.028 < 0.05)
– The null hypothesis is therefore rejected when α = 0.05

• The results suggest that there is a significant difference in the average


compensation between the construction sample and the manufacturing sample.
Interpreting T-test results How about a one-
tailed hypothesis?
• Hypothesis:
– Null hypothesis H0 : There is no difference in the average compensation (The two group
between the construction sample and manufacturing sample. means are equal.)
– Alternative hypothesis H1 : The average compensation of the (The two group
manufacturing sample if higher than that of the construction sample. means are not
– One-tailed test: there is a prediction made on that one industry earns more equal.)
than the other

• Compare the p value against the α value that was set


– In this case, we observe that p < α (0.014 < 0.05)
– The null hypothesis is therefore rejected when α = 0.05

• The results suggest that the mean


compensation of the manufacturing
sample (M = $1671.78) is
significantly higher than that of the
construction sample (M =
$1081.59), p < .05
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 3

Listed below are the amounts of money RP students (n=20)


spend on food within campus during the last week.

You have been assigned to find out whether there is a


significant difference in weekly food expenditure between
male and female RP students.
a) Null hypothesis (H0):
b) Alternative hypothesis (H1):
c) Is this a one-tailed or two-tailed statistical test?
d) Conduct a t-test in Microsoft Excel
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 3

e) Researchers typically compare the p-value against the


Alpha value (which you have set as 0.05 earlier) in
order to decide whether to reject the null hypothesis.
i. Based on your answer for 3c, which p-value should
you refer to?
ii. In this case, should the null hypothesis be
rejected?
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 3

f) The following diagram depicts the distribution of both


male and female weekly food expenditure. Label the
diagram with the appropriate tags in the column on the
right.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 3

g) Based on the results above, what is the likely


conclusion you can draw regarding the difference in
weekly food expenditure between male and female RP
students?

h) RP’s management would like to help student population


decrease their weekly expenditure on food by
incorporating more $2 meals in the canteens. Based on
the results you have obtained, what can be done as the
next step to help RP’s management with their $2 meal
initiative?
INFERENTIAL STATISTICS:
HYPOTHESIS TESTING (ANOVA)
OFFICIAL (CLOSED) \ NON-SENSITIVE

Hypothesis Testing & ANOVA

• ANOVA (Analysis of Variance)


– Compares means of multiple groups, to determine if the
difference between the groups is significant

T-Test ANOVA
The t-test is a statistical technique The ANOVA is a statistical technique
that is used to compare the means that is used to compare the means
of two groups of more than two groups

• Why ANOVA? Why not just do multiple t-tests?


– With multiple t-tests being done (since there are multiple
groups), the rate of error increases
• There is a possibility that the results you observe are purely
due to random chance for EVERY statistical test, leading to
incorrect rejection/failure to reject H0
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 4
Zac recently read that the key to happy customers is happy employees –
employees who are satisfied are more likely to improve customer relationships,
resulting in increase in sales. He decided to administer the Positive and Negative
Affect Scale (PANAS) to the employees in the three teams of the Sales
Department to find out their level of positive affect. The three teams are the Inside
Sales Team, Outside Sales Team, and the Account Executive Team. The
composite scores are attached in the excel sheet below.

You have been assigned to find out whether there is any difference in the level of
positive effect across the three teams. This can be achieved by conducting a
One-Way Analysis of Variance (ANOVA), which is a statistical test meant to
compare values across groups.

a) The Null hypothesis (H0) is:


b) The Alternative hypothesis (H1) is:
c) In lesson 3, you learnt about the t-test. Explain why the t-test is not suitable
for this scenario.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a One-Way ANOVA


d) Follow the steps below to conduct a one-way
ANOVA test in Microsoft Excel.

Step 1: While on the


“Data” tab, click
on “Data Analysis”
button.

Follow this link if


you are unable to
find the “Data
Analysis” button:
http://www.excel-
easy.com/data-
analysis/analysis-
toolpak.html
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a One-Way ANOVA

Step 2: Select Anova:


Single Factor
and click OK.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a One-Way ANOVA

Step 3: You will encounter a


familiar-looking table.
Enter the data you
are analysing under
“Input Range” (select
all 3 columns of
data).

In Grouped By,
choose columns.

Ensure that
everything is properly
filled out and click
“OK”.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a One-Way ANOVA

Step 4: You should


obtain an output
similar to this.

Step 5: Interpret the How to tell if the results are significant:


output. - If P-value (Columns) < α
OFFICIAL (CLOSED) \ NON-SENSITIVE

Interpretation of ANOVA results

• Based on the One-Way ANOVA results generated, what


is the likely conclusion you can draw regarding the level
of positive affect across the three teams?
OFFICIAL (CLOSED) \ NON-SENSITIVE

Interpretation of ANOVA results


• We observe that p < α (0.0018 < 0.05)
• The null hypothesis is therefore rejected at α = 0.05
• The one-way ANOVA results suggested that
– the level of positive affect differs significantly across the three
teams, OR
– there was a statistically significant difference in the level of positive
affect between at least two groups
OFFICIAL (CLOSED) \ NON-SENSITIVE

Worksheet Question 5
A monthly Happiness Survey was administered to a sample
of staff members monthly for the first five months this year. A
temp data entry staff has entered the composite scores into
an excel file attached below.

You have been assigned to find out whether there is any


difference in staff members’ happiness levels happiness
levels of staff members from January to May. This can be
achieved by conducting a Repeated Measures ANOVA,
which is a statistical test meant to compare repeated
measures of the same group.

a) The Null hypothesis (H0) is:


b) The Alternative hypothesis (H1) is:
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a Repeated Measures


ANOVA
c) Follow the steps below to conduct a Repeated Measures
ANOVA test in Microsoft Excel.
Step 1: While on the
“Data” tab, click
on “Data Analysis”
button.

Follow this link if


you are unable to
find the “Data
Analysis” button:
http://www.excel-
easy.com/data-
analysis/analysis-
toolpak.html
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a Repeated Measures


ANOVA

Step 2: Select Anova:


Two-Factor
without
Replication and
click OK.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a Repeated Measures


ANOVA

Step 3: You will encounter a


familiar-looking
table. Enter the data
you are analysing
under “Input Range”
(select all 6
columns of data).

Ensure that
everything is
properly filled out
and click “OK”.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conducting a Repeated Measures


ANOVA

Step 4: You should


obtain an output
similar to this.

Step 5: Interpret the How to tell if the results are significant:


output. - If P-value (Columns) < α
OFFICIAL (CLOSED) \ NON-SENSITIVE

Interpretation of ANOVA results

Based on Repeated Measures ANOVA results, what is the


likely conclusion you can draw regarding the happiness
levels among staff members across the first five months of
this year?
OFFICIAL (CLOSED) \ NON-SENSITIVE

Interpretation of ANOVA results

• We observe that p < α


• The null hypothesis is therefore
rejected at α = 0.05
• The repeated measures ANOVA
results suggested that the level of
staff members’ happiness differs
significantly across the five months

• To determine whether there was an


increase or decrease at different
time points, we can look at the
mean level of staff members’
happiness at each time point

• But can we tell which pairs of


scores are significantly different? Treatment effect
– No. We have to perform paired
analyses of the group
• T-test in Excel with correction
of error rate or
• Post-hoc multiple comparisons
in SPSS
FINAL ACTIVITY
OFFICIAL (CLOSED) \ NON-SENSITIVE

Final Activity
Part 1)

Your school will be embarking on a “Happiness


Project” to enhance the mental wellbeing of
students by reducing the stress level of students.

The Office of Student Welfare would like to find


out whether they should target the activities at
the general population or at specific groups of
students. In addition, the Office of Student
Welfare would like to know what activities to
implement.

Your team has been roped in to apply the


scientific method to answer this question.

Using appropriate statistical technique(s),


analyse the survey data and make
recommendations on the next steps.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Final Activity
Part 2)

After the “Happiness Project” was launched,


the Office of Student Welfare administered the
stress survey to students at the end of the first
semester (T1) as well as the second semester
(T2). They would like to know whether the
programme was effective at reducing students’
stress level.

Using appropriate statistical technique(s), help


the Office of Student Welfare to evaluate their
project.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Additional Resources

• What exactly is alpha value? Watch this video to find out:


https://www.youtube.com/watch?v=edzQQFNzFjM

Dr Nic's Maths and Stats (4 Feb, 2019). Type 1 and Type 2 errors - Statistics Help. Retrieved from
https://www.youtube.com/watch?v=edzQQFNzFjM
OFFICIAL (CLOSED) \ NON-SENSITIVE

Important Note: Assumptions Testing

• Every statistical method has its own set of assumptions,


which mean that your data must satisfy certain properties
for the results to be accurate

• For example, for Independent Samples T-test and ANOVA,


assumptions include:
1. Continuous
2. Normally Distributed
3. Random Sample
4. Enough Data
5. Similar Spread Between/Across Groups

StatsTest.com. (n.d.). Independent Samples T-Test. Retrieved from https://www.statstest.com/independent-samples-t-test/


StatsTest.com. (n.d.). One-Way ANOVA. Retrieved from https://www.statstest.com/one-way-anova/
OFFICIAL (CLOSED) \ NON-SENSITIVE

Conclusion

• The use of statistics is important in order to understand large


amounts of data, as it makes it into manageable forms that
allow us to draw conclusions from.
• It is a very powerful decision making tool, especially in the
area of industrial-organisational psychology, where we will
need to analyse data and suggest intervention methods.
• We will also need this to justify our interventions and analyse
if these interventions are successful in the organisations.
OFFICIAL (CLOSED) \ NON-SENSITIVE

Concept Map

Inferential Statistics

T-test ANOVA

Independent
One-Way ANOVA
Samples

Repeated Samples
Paired Samples
ANOVA
OFFICIAL (CLOSED) \ NON-SENSITIVE

References

• Cuemath (2022) Descriptive and Inferential Statistics.


https://www.cuemath.com/data/descriptive-and-inferential-statistics/
• Landy, F. J., & Conte, J. M. (2013). Work in the 21st century: An introduction
to industrial and organizational psychology (4th ed). Hoboken, NJ: John
Wiley & Sons.
• Neuman W.L (2011). Social Research Methods: Qualitative and Quantitative
Approaches (7th edition). Person Education.
• Dr Nic's Maths and Stats (4 Feb, 2019). Type 1 and Type 2 errors -
Statistics Help. Retrieved from
https://www.youtube.com/watch?v=edzQQFNzFjM

You might also like