Sampling

Design,
Questionnaire Design & Data

Indraneel Bhowmik
Tripura University

@ICFAI University, 22nd Jan 2015 1

Data

Types
•  Quantitative- numerical
•  Qualitative- non numerical

Collected by
•  Individual researchers,
•  Development planners,
•  Donor agencies,
•  Any other institutions

ICFAI University, 22nd Jan 2015 2

Data Collection.....
.... is any process of preparing and
collecting data
The purpose of data collection is to-
•  obtain information
•  keep on record,
•  make decisions about important issues,
or
•  pass information on to others

Data are primarily collected to
q  provide information regarding a
specific topic
q  improve the decision-making by
focusing on objective information

I think the problem is... becomes... The data
indicate the problem is

ICFAI University, 22nd Jan 2015 3
However
Simply collecting data is not
enough- relevant/ specific data
is needed to tell what is
occurring

The key issue is not:
How do we collect data?
But:
How do we obtain useful data?

Need-

a well-defined Data Collection

process
ICFAI University, 22nd Jan 2015 4
 ISSUES TO CONSIDER

•  What is your research question?
•  What is your target population?
•  What do you know about this
population?
•  Do you have a sample frame?
•  What shape is it in?
•  Do you have an existing
Questionnaire/ Schedule?
•  By when do you need your
data?
•  How much money do you have?

ICFAI University, 22nd Jan 2015 5

 Determinants of the Mode of
Data Collection…..

Population
+
Characteristics Of The Sample
+
Types of Questions
+
Question Topic
+
Response Rate
+
Cost ₹
+
Time

ICFAI University, 22nd Jan 2015 6

 Sampling
n  Sampling or Census → to be decided by
the researcher
n  Choice → governed by the discipline
n  Social anthropologists- complete
enumeration.
n  Data from each unit of the
population- “participant-
observation”.
n  Economists prefer the sampling
n  Advantages of sampling method
n  less workload
n  better control over data collection
process
n  reduction of non-sampling errors
n  Disadvantage of sampling method
n  Sampling errors
n  However
n  Easier to control sampling errors as
compared to non-sampling errors.
n  Sampling errors are scientifically
controllable.
i t h a s a m p le
r a b l e t o w o rk w
s , i t i s p r e f e o r c o m p l e t e
T hu
r t h a n g o i n g i n f
rathe ICFAI University, 22nd Jan 2015
n .
enum e r a t i o 7
 Drawing a Sample
1.  Define the target population
keeping in view the objectives of
the study and then draw a sample
2.  The sample could be a ‘probability
sample’ or a ‘non-probability’ or
‘purposive sample’
3.  Probability sample - each member
of the population has a known
non-zero probability of being
selected.
–  E x a m p l e s : r a n d o m s a m p l i n g ,
systematic sampling, stratified
random sampling etc.
4.  Non-probability or purposive
sample - members are selected
from the population in some non-
random manner
–  Examples: Convenience sampling,
judgment sampling, quota sampling
etc.
ICFAI University, 22nd Jan 2015 8
 Probability Sample – Types
•  Random sampling - purest form
–  Each member of the population has an equal
chance
•  Systematic sampling -
–  With the sample size being determined, every
nth record is selected from the population
–  Simpler than random sampling technique
–  Frequently used to select a specified number
of records from a computer file
•  Cluster Random Sampling-
–  Divide Population into clusters
–  Randomly sample Clusters
–  Measure all units within sampled clusters
•  Stratified Random sampling – Most Common
–  Divide population into non-overlapping
groups (Strata)- N1+N2+ ….+Ni = N;
–  Yardsticks- landholdings, asset holdings,
incomes, caste, religion, occupation etc.
–  Draw sample with probabilities proportional
to size of each stratum (PPS sampling)
–  Reduces sampling error - each stratum is
homogeneous
Operational problems
v  Information necessary for stratification may
not be available at the beginning of the work.
ICFAI University, 22nd Jan 2015 9
 Non- Probability Sample
•  Convenience (Accidental or Haphazard)
sampling –
–  Often during preliminary research efforts
to get a gross estimate of the results
–  Selected because they are convenient
(Man on the street)
•  Judgment (Purposive) sampling –
–  Extension of convenience sampling
–  Selected on judgment, to serve the
purpose
–  Ex: draw the entire sample from one
"representative" village, even though the
population includes a cluster of villages
•  Expert Sampling
–  Assembling persons with known
experience and expertise (sub-case of
purposive)
•  Quota sampling –
–  Non-probability equivalent of stratified
sampling
–  Identifies the stratums and their
proportions; then convenience or
judgment sampling is used to select the
required number from each stratum
•  Snowball Sampling-
–  Identify somebody meeting the criteria,
use him/her for identifying others
ICFAI University, 22nd Jan 2015 10
Choosing -Random or Purposive
•  Sociologists and social anthropologists prefer
purposive sampling
–  May Work for studying a typical social/economic
phenomenon
–  but it does not help to obtain reliable estimates
•  Statisticians prefer random sampling as it is
free from any purposiveness or bias.
•  Economists choose between purposive &
random depending upon the nature of the
problem in hand
•  Rudra (1989) –
–  Purposive for studying a social phenomenon more
intensively, subsequently random for testing the
hypotheses for generalisation
–  method of “randomising the population rather than
randomising the sample”
–  Ex: to draw a sample of AWs -not necessary to
prepare complete village listing, just walk randomly
across village & find some labourers working or
gossiping
–  meeting them there you could fix your sample
•  Olsen (1993) –
–  method of “creative augmentation” when some
sensitive information is needed
–  find out some households/persons with the
characteristic you are looking for
–  utilise them as your informants to augment the list
ICFAI University, 22nd Jan 2015 11
 Sample Size
§  Misconception among some researchers that
larger the sample size, it is better
§  Efficiency of a sample scheme
§  does not depend on sample size alone
§  depends both on the size of sample (n) and
population variance (σ2).
§  For higher value of σ2 , higher should be n.
•  Formula for calculation of variance for
distribution of sample mean [V(m)]
–  V(m) = (σ2)/n
or, n= (σ2)/ V(m)
when , σ2 = 0; n=1 is enough
•  To know the population variance (σ2)-
–  Preliminary work and pilot surveys can help.
§  Reading past literature and/or discussions
with knowledgeable persons - very useful
§  Israel (1992, 2009, 2013)- provides a table on
the desirable sample size with respect to the
population
§  http://edis.ifas.ufl.edu/pd006
ICFAI University, 22nd Jan 2015 12
 BASIC SURVEY DESIGNS

•  Cross-Sectional Surveys: Data
are collected at one point in
time from a sample selected to
represent a larger population.

•  Longitudinal Surveys = Trend,
Cohort, and Panel
–  Trend: Surveys of sample
population at different points in
time
–  Cohort: Study of same
population each time data are
collected, although samples
studied may be different
–  Panel: Collection of data at
various time points with the
same sample of respondents.
ICFAI University, 22nd Jan 2015 13
Questionnaire and schedule are
not the same……………………

•  Questionnaire can be sent via mail
but schedule is done only personally
•  Questionnaire is cheaper method
than schedule (for schedule you
have to move everywhere)
•  Questionnaire can be returned
without answering all the questions
but, in schedule, enumerator
ensures the filling all the questions
•  Questionnaire can be filled by
anyone but schedule is always filled
by enumerator
•  Respondent should be literate & co-
operative in Questionnaire but
schedule can be used for illiterates
•  Risk of incomplete & wrong
information is more in
Questionnaire
ICFAI University, 22nd Jan 2015 14
 Questionnaire Design

One of the most critical stages of

survey research designs
Using common sense and good
grammar is a necessary condition
but not a satisfactory one…..
It is erroneous to assume that
people will understand the
questions….
They may
•  not simply know about the topic,
•  be unaware of the issue,
•  lack any interest,
•  confuse it with something else, or
•  simply refuse to answer
ICFAI University, 22nd Jan 2015 15
 So, how do we go.........
1.  Relevant- no unnecessary information
2.  Accuracy- information is reliable &valid
3.  Avoid Ambiguity, Confusion, & Vaguenes
s- use simple, understandable, unbiased,
unambiguous words; e.g- marital status
4.  No Double Barreled Query- each
question should be about one and only
one issue
5.  Avoid Leading Questions- e.g.,- ‘You,
don’t smoke, do you?
6.  Avoid Loaded Questions- e.g., Spouse
beating
7.  Do not over Tax Respondent's Memory
8.  Arrange Questions in Proper Sequence-
Start with easier things and then build up
(funnel technique)
9.  Use Filter Question, if Needed

10.  Avoid Overlapping response category

ICFAI University, 22nd Jan 2015 16
 Layout of the questionnaire
•  Two issues-
–  Physical layout of the questionnaire and
–  Format of questions and responses.
•  Number each question and put
identifying information
•  Do not cramp questions or create
confusing appearance
•  Make a cover sheet for admin
purposes
•  Time and Date is a must
•  Identity and observation of the
interviewer
•  Instructions for filling up should be in
the questionnaire, but in a different
style to enable differentiation
•  More important for mail, web
questionnaires- appearance act as the
persuader
•  Add a cover letter for mail surveys; end
with a thanks
ICFAI University, 22nd Jan 2015 17

Pilot Survey is a must because.....
•  On a small scale, carried out prior to
the main survey
•  To gain information to improve the
efficiency of the main survey
•  Test a questionnaire
•  Ascertain the time taken by field
procedure
•  Determine the most effective size of
sampling unit
•  Save financial resources because if
errors are found in the questionnaire
or interview early on, there would be a
lesser chance of unreliable results
•  Also called “Exploratory survey” in
special circumstance when little is
known about the material or domain
under inquiry.
v e - d e te r m ine
e m a in o b jecti -sc ale
Th c ting a l a r g e
e r c o n d u
wheth t h e e f f o rt
or t h
survey is w ICFAI University, 22nd Jan 2015 18
 Post Script
•  Random & Purposive Sampling are not
rivals, rather they are complementary
–  Multi-stage Sampling
•  Physical appearance of Questionnaire
has to be attractive but such case is
not necessary with schedule
•  Data collection has to be fruitful
•  A survey - as good as the questions it
asks
•  Success of Questionnaire depends on
its design but in case of Schedule it
depends on honesty & competency of
Enumerator

d o in g you a
n d e n t s a re
T h e r e s p o n d p re tend
r- rt a
Remembe on’t act over-sma
d
favour, so hat you know a lot
t
ICFAI University, 22nd Jan 2015 19
 Thanks

Comments & Criticism

welcome to
eyebees@gmail.com

ICFAI University, 22nd Jan 2015 20