Professional Documents
Culture Documents
Chap 3 Research Design Final
Chap 3 Research Design Final
Research Design
Research Design:
Experimental Design
1
3.1. Research Design
The research design is the master plan specifying the
methods and procedures for collecting and analyzing
the needed information.
the arrangement of conditions for collection and
analysis of data in a manner that aims to combine
relevance to the research purpose with economy in
procedure
3
Research Design
The research could have been conducted from
a study design or a survey design and it is
important to distinguish between the two.
Studies involve the investigation and testing
of a hypothesis. They can be divided into two
different types, experimental or observational.
Surveys are used to collect data through
questions and answers and are used to
gather information about the opinions,
demographics etc of the population of interest.
4
Experimental Studies
An experimental study deliberately imposes
a treatment to a group of units of the
population.
These units are referred to as experimental
units and as a group are called the
experimental or treatment group.
A comparison is made between this group
and a control group, a group of units which
have no treatment imposed.
Both groups are sufficiently large and
representative. 5
Method of data collection by Experiment:
Experimental setup
Specification of the instrument and manufacturer information required
Procedure of operation
Should be produced as manual of operation
Conditions of operation
Fixing operating parameters
6
Standardization tests
Standardization refers to methods used in gathering
and treating subjects for a specific study.
In order to compare the results of one group to the
results of a second group, we must assure that each
group receives the same opportunities to succeed.
Standardized tests, assure that each student
receives the same questions in the same order and
is given the same amount of time, the same
resources, and the same type of testing
environment.
Without standardization, we could never adequately
compare groups.
7
Observational Studies
Observation is a method of collecting data by human,
mechanical, electrical or electronic means.
There are many reasons why we cannot conduct an
experimental study.
As observational studies simply observe something as it
is found the results are more reliable than experimental
studies.
observational study it is more difficult to determine
‘cause and effect’, as nothing is controlled for and there
could be many factors at play that will determine results.
Observational studies are often found in the medical or
psychological fields where, for ethical and practical
reasons, there are strict rules regarding what can and
cannot be ‘done’ to subjects. 8
Survey Design
A written survey is called a
questionnaire;
An oral survey is called an
interview.
Although they serve similar purposes
in gaining information, each provides
unique advantages and
disadvantages to the researcher.
9
Questionnaire Design
Questionnaire design forms the central role
in the survey process
Good questionnaire design is crucial in
terms of:
encouraging the respondent to
participate in the survey; and
eliciting the required information
12
The researcher must pay attention to the following points in
constructing an appropriate and effective questionnaire or a schedule:
The researcher must keep in view the problem he is to study for it provides the
starting point for developing the Questionnaire/Schedule. He must be clear about the
various aspects of his research problem to be dealt with in the course of his research
project.
Appropriate form of questions depends on the nature of information sought, the
sampled respondents and the kind of analysis intended. The researcher must decide
whether to use closed or open-ended question. Questions should be simple and must
be constructed with a view to their forming a logical part of a well thought out
tabulation plan. The units of enumeration should also be defined precisely so that
they can ensure accurate and full information.
Rough draft of the Questionnaire/Schedule be prepared, giving due thought to the
appropriate sequence of putting questions. Questionnaires or schedules previously
drafted (if available)may as well be looked into at this stage.
Researcher must invariably re-examine, and in case of need may revise the rough
draft for a better one. Technical defects must be minutely scrutinised and removed.
Pilot study should be undertaken for pre-testing the questionnaire. The questionnaire
maybe edited in the light of the results of the pilot study.
Questionnaire must contain simple but straight forward directions for the respondents
so that they may not feel any difficulty in answering the questions.
13
Parts of research design
(a) sampling design
the method of selecting items to be observed;
(b) observational design
the conditions under which the observations are to be
made;
(c) statistical design
the question of how many items are to be observed and
how the information and data gathered are to be
analyzed;
(d) operational design
the techniques by which the procedures specified in the
sampling, statistical and observational designs can be
carried out.
14
Types of Sampling …
A. Probability (Random) Sampling …
Simple random sampling—All members have equal chance to be
selected – free of bias
This a sample drawn in such way that every individual in the population has an equal
chance of appearing in the sample.
Systematic random sampling - selection of elements from an
ordered sampling frame
Relies on arranging the target population according to some ordering
scheme and then selecting elements at regular interval through the ordered
list. In this case we choose every Nth individual e.g. every 5 th, 10th, etc., the
first one to be included should be randomly selected.
Stratified random sampling- Stratification is the process of
dividing members of the population into homogeneous subgroups
before sampling( Male, female etc). a random sample is drawn
from all the strata
In this case, we start by dividing the population into different strata according to
their characteristics (e.g. male and female, different age groups, rural and urban).
Then from each of those strata, we choose a random sample from each stratum,
the final sample is the total of the samples from different strata. 15
Types of Sampling …
A. Probability (Random) Sampling …
A. Multistage sampling- sampling is carried out in stages using
smaller and smaller sampling units at each stage
in this case the sample is taken in a series of stages.
First, start by big clusters (e.g. zones) from this draw a sample, each zone is then
divided into cities and villages, and from each of these you can choose a sample,
from each city choose a district or house by random method, and then randomly
draw a sample of families or individuals.
Snowball sampling:
It is a particular type of convenience sampling in
which the researcher net works with a small sample
of accessible participants and use them to assist in
identifying other participants with the specific trait.
18
Three basic principles of experimental designs
(1) the Principle of Replication;
(2) the Principle of Randomization;
(3) Principle of Local Control.
An experiment is valid if:
the observed change in the dependent
variable is, in fact, due to the independent
variable (internal validity)
if the results of the experiment apply to the
“real world” outside the experimental
setting (external validity)
19
Two Types of Experimental Designs
20
1. Before-and-after without control design (Pre-Experimental)
21
(b) Formal experimental designs
(i) Completely randomized design (C.R.
Design).
(ii) Randomized block design (R.B. Design).
Experimental subjects are first divided into
homogeneous blocks before they are randomly
assigned to a treatment group.
K
(iii) Factorial designs. N ni
i 1
22
Factorial design
involve two or more independent variables
with at least one independent variable
being manipulated by the researcher
two-by-one factorial design (2 cells) 2x1
two-by-two factorial design (4 cells) 2x2
two-by-three factorial design (8 cells)
2x2x2
two-by-four factorial design (16 cells)
2x2x2x2
23
Randomized block design
Principleof local control along with
other two principle of experimental
design
subjects are first divided into groups
each group the subjects are relatively
homogeneous
The number of subjects are equal in
each group
24
A true experimental research design must
essentially consist of the following three
characteristics: (Otherwise quasi-experimental)
Manipulation (treatment)
conscious control of the independent variable by the
researcher through treatment or intervention(s) to
observe its effect on dependent variable.
Randomization
it means that every subject has and equal chance of
being assigned to experimental or control group.
Control group
use of control group and controlling the effects of
extraneous/confounding variable in which
researcher is interested. 25
Sample size Design
This is the sub-population to be studied in order to
make an inference to a reference population
However, in research, because of time constraint and
budget, representative sample are normally used.
The larger the sample size the more accurate the
findings from a study.
Availability of resources sets the upper limit of the
sample size.
While the required accuracy sets the lower limit of
sample size
Therefore, an optimum sample size is an essential
component of any research.
26
SAMPLE SIZE DETERMINATION
Sample size determination is the mathematical
estimation of the number of subjects/units to be included
in a study.
When a representative sample is taken from a
population, the finding are generalized to the population.
Optimum sample size determination is required for the
following reasons:
To allow for appropriate analysis
To provide the desired level of accuracy
To allow validity of significance test.
27
PROCEDURE FOR CALCULATING
SAMPLE SIZE.
Thereare four procedures that
could be used for calculating
sample size:
Useof formulae
Readymade table
Nomograms
Computer software
28
USE OF FORMULAE FOR SAMPLE SIZE
CALCULATION
There are many formulae for calculating
sample size in different situations for
different study designs.
The appropriate sample size for population-
based study is determined largely by 3
factors
The desired level of confidence
The estimated prevalence of the variable
of interest..
The acceptable margin of error. 29
For population >10,000.
n=Z2pq/d2
n= desired sample size (when the population>10,000)
Z=standard normal deviate; usually set at 1.96(or a~2),
which correspond to 95% confidence level.
p=proportion in the target population estimated to have a
particular characteristics. If there is no reasonable
estimate, use 50%(i.e 0.5)
q=1-p(proportion in the target population not having the
particular characteristics)
d= degree of accuracy required, usually set at 0.05 level(
occasionally at 2.0) also called margin of error
30
If study population is < 10,000
nf=n/1+(n)/(N)
31
Revise the following points
from statistics
Confidence interval
Proportion
Margin of error
32