Writing and Validating

Research Questionnaire

Ritchie G. Macalanda, Ph.D.

Assistant Principal II/ Professor, Graduate School
How
A B C D
Many
Squares
are E F G H
There?

I J K L

M N O P
SIXTEEN? (16)
Finding
A B C D Sixteen
Squares is
like merely
E F G H Reading or
Scanning a
Passage.
I J K L

You Find
only what is
M N O P easy to see.
TWENTY SIX? (26)
Finding
A B C D Twenty-Six
Squares is
like
E F G H Studying or
Concen-
trating on
I J K L the
Passage

M N O P
YOU FIND MUCH MORE THAN YOU
WOULD HAVE BY JUST READING,
BECAUSE YOU ARE LOOKING
MORE CLOSELY.
A B C D
How About
THIRTY?
E F G H
(30)

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
A B C D

E F G H

I J K L

M N O P
“It is not every question
that deserves an answer.”

Publius Syrus
(Roman,1st century B.C.)
QUESTIONNAIRE

•IS A FORMALIZED SET OF

QUESTIONS TO OBTAIN CERTAIN
INFORMATION FROM CERTAIN
RESPONDENTS.
DEVELOPING A GOOD
QUESTIONNAIRE IS NOT EASY!
•IT TAKES TIME, TIME, AND MORE TIME.
•YOU MAY END UP WRITING MULTIPLE DRAFTS.
•IT HELPS TO WORK WITH OTHERS WHEN
DEVELOPING A QUESTIONNAIRE.
TYPES OF QUESTIONNAIRE
SELF-ADMINISTRATED
•• COMPUTER ASSISTED AND WEB-BASED
•• PAPER AND PENCIL
INTERVIEWER ADMINISTRATED
•• FACE TO FACE
•• TELEPHONE
SELF-ADMINISTERED
QUESTIONNAIRE ADVANTAGES
•CHEAP AND EASY TO ADMINISTER
•PRESERVES CONFIDENTIALITY
•COMPLETED AT ANY TIME
•NO INFLUENCE BY INTERVIEWER
•ALLOW FOR INSTANT DATA CODING
 SELF-ADMINISTERED
QUESTIONNAIRE DISADVANTAGES

•LOW RESPONSE RATE

•QUESTIONS CAN BE MISUNDERSTOOD
•NO CONTROL BY INTERVIEWER
INTERVIEW-ADMINISTERED
ADVANTAGES

•PARTICIPATION OF ILLITERATE PEOPLE

•CLARIFICATION OF AMBIGUITY
•QUICK ANSWERS
INTERVIEW-ADMINISTERED
DISADVANTAGES
•INTERVIEWER BIAS
•NEEDS MORE RESOURCES
•ONLY SHORT QUESTIONNAIRES POSSIBLE
ESPECIALLY ON TELEPHONE
•DIFFICULT FOR SENSITIVE ISSUES
 QUESTIONNAIRE DESIGN: AN OVERVIEW OF THE
MAJOR DECISIONS
• 1. WHAT SHOULD BE ASKED
• QUESTIONNAIRE RELEVANCY
• ALL INFORMATION COLLECTED SHOULD ADDRESS A RESEARCH
QUESTION IN
• HELPING THE DECISION MAKER IN SOLVING THE CURRENT PROBLEM
• QUESTIONNAIRE ACCURACY
• INCREASING THE RELIABILITY AND VALIDITY OF RESPONDENT
INFORMATION
• 2. HOW SHOULD EACH QUESTION BE PHRASED?
• 3. IN WHAT SEQUENCE SHOULD THE QUESTIONS BE
ARRANGED?
• 4. WHAT QUESTIONNAIRE LAYOUT WILL BEST SERVE
THE RESEARCH OBJECTIVES?
Questionnaire Development
• 5. HOW SHOULD THE QUESTIONNAIRE BE
PRETESTED? DOES THE QUESTIONNAIRE NEED TO
BE REVISED?
 QUESTIONNAIRE DEVELOPMENT
• 1- FORMULATIONS OF IDEA (CONCEPTUALIZATION)
• 2- LITERATURE REVIEW
• 3- FIRST DRAFT
• 4- CONDENSED LITERATURE REVIEW
• 5- DETECT (STUDY DESIGN, POPULATION, SAMPLE SIZE,
QUESTIONNAIRE)
• 6- DESIGN QUESTIONNAIRE
• 7. A NEW DRAFT
• 8. TESTING
 TYPES OF QUESTIONS

•1- OPEN-ENDED QUESTION

•2- CLOSED-ENDED QUESTION
•3- CONTINGENCY QUESTION
WORDING OF THE QUESTION
•LOGIC FLOW OF THE QUESTIONS
•SIMPLE LANGUAGE
•MOTHER LANGUAGE IS THE BEST
•USE CONCISE AND CLEAR
WORDS
AVOID
• 1- DOUBLE-BARRELED QUESTIONS.
• 2- DOUBLE NEGATIVES.
• 3- AVOID OVERLAPPING RESPONSE CATEGORIES
• 4- LEADING QUESTIONS
• 5- OVERLOAD THE RESPONDENT’S MEMORY
• 6- LONG QUESTIONS
• 7- HYPOTHETICAL QUESTIONS
 ESTABLISHING THE CONTENT
VALIDITY OF THE QUESTIONNAIRE
• 5-
HIGHLY VALID. NO FLAWS OBSERVED; ANYTHING
MORE THAN TO BE DESIRED TO MAKE IT BETTER.
• 4- VALID. VERY LITTLE FLAWS ARE OBSERVED; MINOR
RECORDING OF FEW ITEMS NEEDED.
• 3- MODERATELY VALID. THE OVERALL USEFULNESS IS
DIMINISHED ONLY SLIGHTLY.
• 2-
FAIRLY VALID. SEVERAL FLAWS ARE OBSERVED;
OVERALL USEFULNESS IS GREATLY DIMINISHED.
• 1- NOT VALID. MAJOR REVISION IS NEEDED TO MAKE IT
USEFUL.
 RELIABILITY AND VALIDITY
• VALIDITY.
CONCERNS THE DEGREE TO
WHICH A QUESTION MEASURES WHAT IT
WAS INTENDED TO MEASURE AND NOT
SOMETHING ELSE.
• CONTENT (OR FACE) VALIDITY
• EMPIRICAL (OR PREDICTIVE) VALIDITY
• CONCURRENT VALIDITY
•RELIABILITY: CONCERNS THE
CONSISTENCY OF A MEASURE. THAT IS,
THE TENDENCY TO OBTAIN THE SAME
RESULTS IF THE MEASURE WAS TO BE
REPEATED BY USING THE SAME
SUBJECTS UNDER THE SAME
CONDITIONS.
•KAPPA COEFFICIENT
 CONTENT VALIDITY
• 1.
ALL THE DIRECTIONS IN THE INSTRUMENT ARE
CLEAR.
• 2.
EACH OF THE ITEMS/ STATEMENTS IS CLEARLY
STATED.
• 3. EACH OF THE ITEMS/ STATEMENTS IS READABLE.
• 4.
THE INSTRUMENT IS COMPREHENSIVE, E.G., IT
COVERS ALL AREAS THAT ARE IMPORTANT TO THE
STUDY.
• 5.
THE ITEMS/ STATEMENTS IN EACH CONCEPT
CORRESPOND TO THE SUBJECT MATTER/TOPIC.
• 6. THE ITEMS/ STATEMENTS IN EACH CONCEPT ARE
CONSISTENT TO REALITY.
• 7. THE ITEMS/ STATEMENTS IN EACH CONCEPT
SHOW A REASONABLE RANGE OF VARIATION.
• 8. THE ITEMS ARE FORMULATED IN ACCORDANCE TO
THE EXPLICIT/IMPLICIT OBJECTIVES OF THE STUDY
• 9. THE ITEMS ARE SYSTEMATICALLY AND
SEQUENTIALLY ARRANGED
• 10. THE ITEMS DO NOT OVERLAP WITH EACH OTHER
COVERING LETTERS AND
INTRODUCTORY PARAGRAPHS

• YOU MUST EXPLAIN THE OBJECTIVES OF THE SURVEY,

• IN AN INTERVIEW, ONE OF THE TASKS OF THE INTERVIEWER IS TO PERSUADE
THE RESPONDENT TO COOPERATE.
• IN A SELF-ADMINISTERED QUESTIONNAIRE, THE COVERING LETTER IS THE
ONLY INSTRUMENT FOR OVERCOMING RESISTANCE.
 COVERING LETTER ITEMS
• IDENTIFY THE ORGANIZATION CONDUCTING
THE STUDY.
• EXPLAIN THE PURPOSE OF THE STUDY.
• ASSURE THE RESPONDENT THAT
INFORMATION PROVIDED WILL
• BE
MANAGED IN A STRICTLY CONFIDENTIAL
MANNER.
 COVERING LETTER ITEMS
• EXPLAINWHY IT IS IMPORTANT THAT THE
RESPONDENT SHOULD COMPLETE THE
QUESTIONNAIRE.
• BRIEF DETAIL ON HOW THE RESPONDENT WAS
SELECTED (FOR EXAMPLE, ‘YOUR NAME WAS
RANDOMLY SELECTED ....’).
• EXPRESSIONOF APPRECIATION FOR THE
RESPONDENT’S HELP.
 COVERING LETTER ITEMS

•ESTIMATE OF QUESTIONNAIRE
COMPLETION TIME.
•PROVIDE THE NAME AND CONTACT
NUMBERS OF THE PRINCIPAL
RESEARCHER.
 RECOMMENDATION
PROBLEM NO. 1 FINDING NO. 1
NO. 1
 SECRET RECIPE OF A GOOD RESEARCHER

1 medium UTILITY*
2 pieces of One big EFFORT competency sliced
TECHNICAL* sliced into halves
competency
Some GUTS and
pinch of RISK
3 strips of
PATIENCE
3 slices of
LEADERSHIP*

2 3-inch diameter
of SERVICE 4 pickled CARE

Staggers, N, Gassert, CA, Curran C. (2002)

 COPY FROM ONE, IT’S
PLAGIARISM; COPY FROM TWO,
IT’S RESEARCH.
~ WILSON MIZNER
cddritchiemacalanda@gmail.com
09999761509
References
 https://www.slideshare.net/ShobiyaParamasivam/que
stionnaire-105669412?qid=b89f7c04-3eed-4f0f-b71c-
aeeca4ca7ccb&v=&b=&from_search=1
 https://www.slideshare.net/ssanand_1985/questionnai
re-design-business-research?qid=19baf270-3b0c-4b8a-
9245-2cb778d6ae69&v=&b=&from_search=11