Download as pdf or txt
Download as pdf or txt
You are on page 1of 26

Topic 1 : Introduction to Research - Management – employee attitudes and behavior, human

resource management, production operation management,


What is Research? information systems etc.
- Research - is simply the process of finding solution to a - Marketing - product image, advertising, sales promotion,
problem after a thorough study and analysis of the distribution, packaging, pricing, new product
situational factors. development etc
- Managers constantly engage themselves in studying and
analyzing issues and hence are involved in some form of Two(2) different Types of Research.
research activity before making decisions. 1. Applied Research.
- undertaken by managers to solve a current problem.
Business Research
- E.g.: Why certain product not selling well?
- Business Research – can be described as a systematic 2. Basic Research
and organized effort to investigate a specific problem
encountered in the work setting, that need a solution. - undertaken to generate a body of knowledge, to
understand how certain problems that occur can be
- A step by-step process that consists of: solved and solutions can be replicated/adapted by others.
Problem identification
- E.g.: Investigation on factors that contribute low

 Gather information
 Analyzing data participation of workers in total quality management.
 Determine factors associated with the problem
 Solve problem by taking corrective measures. Applied Research
- Research information is neither intuitive nor haphazardly - Conducted when a decision must be made about a
gathered. specific real-life problem
- Literally, research (re-search) -“search again” - Examples:
 Should McDonalds add Italian pasta dinners to its menu?
- Business research must be objective  Business research told McDonald’s it should not?
- Detached and impersonal rather than biased  Should Procter & Gamble add a high-priced home teeth
- It facilitates the managerial decision process for all bleaching kit to its product line?
aspects of a business.  Research showed Fresh and White toothpaste would sell
well at a retail price of RM4.40
Definition of Research  Advertisers conduct research to find about the impact of
An organized, systematic, data-based, critical, objective, their promotional campaign.
scientific inquiry or investigation into a specific problem  Political parties may conduct research to find out public
undertaken with the purpose of finding solutions. opinion about their policies and the likelihood voters will
(Uma Sekaran) support them in future elections.

Business research is defined as the systematic and objective Basic Research


process of generating information for aid in making business - Attempts to expand the limits of knowledge.
decisions. - Not directly involved in the solution to a pragmatic
(Zikmund) (practical) problem.
Important Research - Examples:
 Is executive success correlated with high need for
- Managers with knowledge of research have an advantage achievement?
over those without it.  Are members of highly cohesive work groups more
- To predict the futures of product performance. satisfied than members of less cohesive work groups?
- To control catastrophic outcomes.  Do consumers experience cognitive dissonance in
low-involvement situations?
- Research methods will enable managers understand,
predict and control their environment. Applied and Basic Research
- Managers who uses common sense alone to analyze and - The main distinction between applied and basic research
make a decision compared to manager who uses a is that the former is specifically aimed at solving current
scientific method (systematic inquiry). The latter has problem, whereas the latter has the broader objectives of
conducted his work systematically, diligently, critically, generating knowledge and understanding of phenomena
objectively and logically. and problems that occur in various organizational
settings.
Areas in Business Research
- Both types of research follows the same steps of
- Accounting – budget control system, practices and systematic and scientific inquiry (investigation) to arrive
procedures, inventory control methods, accelerated at solutions to problems
depreciation, transfer pricings, cash recovery rates and
taxation etc. - Applied research may have a shorter time frame than
basic research in its completion. This is due to its
- Finance – operation of financial institutions, optimum importance and/or urgency in acquiring the results of the
financial ratios, mergers and acquisitions etc. research.
Scientific Research (Investigation) 2. Preliminary Information Gathering
- Seeking information in depth to probe the source or
Eight (8) characteristic of scientific research: factors surrounding of the problem thus increasing
1. Purposive – definite aim his/her level of awareness about the situation. Collecting
2. Rigor – Careful and scrupulousness diverse view and observing reaction of people on issue at
3. Testability – can be proven quantitatively/quantitatively hand.
4. Replicability – same result when repeat research.
5. Precision and Confidence – close to reality and - Can be done by:
correctness  Talking to people, workers, client, etc.
6. Objectivity – result based on facts of actual data.  Conducting unstructured interviews.
7. Generalizability – applicability to other settings.  Library research.
8. Parsimony – simplicity in explaining phenomena.
3. Theory Formulation
Building Blocks of Sciences in Research - An attempt to integrate all information in logical manner
- Answers to issues can be found either by process of so that factors responsible for the problem can be
deduction or induction. conceptualized and tested.
- Deduction – we arrive a reasoned conclusion by logical - Critical variables are examined as to their contribution or
generalization of a known fact. influence in explaining why the problem occurs and how
 E.g. – Dean’s list student are smart and hardworking it can be solved.
student. If Samad gets a dean’s list then we can conclude - A network of association were developed and varibles
that he is a smart and hardworking student. were connected to provide a picture of the problem/issue
 E.g. - Result of analysis of data collected showed that being observed.
problems of turnover can be reduced to three important - A theory is formulated each time a problem is
factors: flexible working hours, recognition of superior investigated, disregarding previous research findings.
work performance and job enrichment.  Reason is because different studies have identified
- Induction – we observe certain phenomena and on this different variables and some hypotheses are substantiated
basis arrive at conclusions. Logically establish a general but some are not.
proposition based on observed facts.  Situations and setting are different from one to another.
 E.g. – We see that men’s occupation in Terengganu are
mostly fisherman. We therefore conclude that students 4. Hypothesizing
parent from Terengganu people are fisherman. - A process of generating educated conjectures.
 E.g. - Observing people residing at distance beyond 50  E.g.: Customer satisfaction can be greatly increased if
km from office are absent more frequently than those our salesperson greet them at the store entrance.
residing closer to office, and infers that distance is a  E.g.: Male are better managers than women in financial
factor in absenteeism. institutions.
- Hypothesis testing is also called deductive research.
- Data pertaining to each variables in the hypothesis
formulated were identified.

5. Further Scientific Data Collection


- Data with respect to each variables in the hypothesis
(theoretical framework) need to be obtained.
 E.g.: Data on current customer satisfaction level and
further data on salesperson hospitality (greetings) during
normal operation hours.
 E.g.: Data on current Male and Female managers
performance in financial institutions.
- These data form the basis for further data analysis.

6. Data Analysis
- Here, data gathered are statistically analyzed to see if the
hypotheses generated were adequately supported.
Hypothetical-Deductive Method  E.g.: Conducting correlational studies to see the
relationship between greetings and satisfaction (i.e two
1. Observation factors).
- First stage of process.  E.g.: Conducting a t-test to see the difference between
- Sensing certain changes occurring, new behavior, male and female managers performance.
attitudes and feeling surfacing in one’s environment. - Two types of data analysis:
 Eg: sales dropping, frequent production problems,  Qualitative analysis – information gathered in narrative
incorrect accounting results, low yielding investment, form through interviews and observations. Data can then
poor participation of workers, absenteeism, increase be categorized.
accident or near-miss incidents.  Quantitative analysis – information gathered in value
form of measurement such as numbers, ratios,
percentage, mean, sum etc.
7. Deduction 1.5 Research Design
- The process of arriving at conclusions by interpreting the
meaning of the results of the data analysis. Involves a series of rational decision-making choices on
 E.g.: It was found that sales assistants greetings is issues relating to:
positively correlated with customer satisfaction. 1. Purpose of the study (exploratory, descriptive,
Therefore we can deduce that customer satisfaction can hypothesis testing)
be increased by sales assistants constantly greeting 2. The study setting (location)
customer at the store entrance. 3. Type of investigation
 E.g.: It was found that there is no difference between 4. Extent of researcher interference (studying or
male and female managerial performance. Therefore we manipulation)
can conclude that men are no better than female in their 5. Time horizon
managerial ability in financial institutions. 6. Unit of analysis (individuals, groups, organizations)

Purpose of the Study - Exploratory


- Undertaken when not much is known about the situation
at hand, or no information is available on how similar
problems or research issues have been solved in the past.
- Requires extensive preliminary work to gain familiarity
with the situation, understand what is happening before
developing model and designing other rigorous
investigations.
- Undertaken to better understand the nature of the
problem because few studies have been made in this
area.
- Extensive interviews and observations (qualitative data)
were carried out to collect data thus providing enough
evidence to develop theories and hypotheses for
subsequent testing.

Purpose of the Study - Descriptive


- Undertaken to ascertain and to describe the characteristic
of the variables of interest in a situation.
- To learn and to describe the characteristic of a group of
employee (age, job status), organizations (practices,
culture), etc.
- Goal is to offer a profile or to describe relevant aspects
of phenomena of interest.
- Help researcher to:
 Understand the characteristic of a group in given
situation.
 Think systematically about aspects in given situation.
 Offer ideas for further probe and research
 Help make certain simple decisions
- Data are presented in forms such as bar charts,
frequencies, mean, mode, median, standard deviation,
etc.

Purpose of the Study – Hypothesis Testing


- To test the nature of certain relationships, or establish
differences among groups or the independence of two or
more factors in a situation, or to predict some outcomes.
- To establish cause and effect relationship among
variables of interest.
- Can be done on both qualitative as well as on
quantitative data.
- Methodological rigor (severeness) increases as we move
from an exploratory study to a hypothesis-testing study,
as well as costs incurred.
Types of Investigation: Causal vs. Correlational Unit of Analysis
- A researcher/manager should determine which study is - Unit of Analysis is the level of aggregation of the data
appropriate by viewing problems or issues at hand. collected during subsequent data analysis stage.
- To know whether a study is a causal or a correlational - Our research question determines the unit of analysis.
depends on the type of research questions asked and how  Individual u.a – Data gathered from each individual and
the problem is defined. treating each employee’s response as an individual data
- Causal Study – researcher wants to delineate (specify) source
the cause of one or more problem. E.g. Prob. Stat – What is the motivational level of our
 E.g. – Does smoking cause cancer? Variable x causes employees?
variable y.  Dyad u.a – data gathered from two person in a group and
treating each group’s response as separate data source.
- Correlational Study – researcher interested delineating E.g. Prob. Stat – how to raise supervisor-subordinate
the important variables associated with the problem. relationship at work?
 E.g. – Are smoking and cancer related? Or Are smoking,  Group u.a - data gathered from different group and
drinking, and chewing tobacco associated with cancer? If treating each group’s response as separate data source.
so which one contributes most to variance in the E.g. Prob. Stat – is there a difference among children of
dependent variable? different age group in their attitude towards learning?
Extent of Researcher Interference - Individuals do not have the same characteristic as groups
(e.g. structure, cohesiveness) and group do not have the
- Extent of researcher’s interference with the study has a same characteristics as individual (e.g. IQ, stamina)
direct impact on the type of investigation (causal or
correlational). - It is necessary to decide on the unit of analysis when we
formulate the research question because data collection
- Correlational study – conducted when minimal methods, sample size, and variable used may depend on
interference with normal flow of work. the unit of analysis used.
- Causal – conducted when researcher tries to manipulate
(deliberately change) certain variables to see its effect on Time Horizon
dependent variable of interest. - Cross-Sectional Studies – a study where data are
- Read example in textbook pg.128-129 gathered just once, over a period or days/weeks/months
 6.12 for minimal interference in order to answer a research questions.
 6.13 for moderate interference  E.g. data taken for a period between April - June last
 6.14 for excessive interference year to study it behavior during slowdown phase.
 E.g. a one time survey done to determine the effect of
Study Setting: Contrived and Non-Contrived certain advertising campaign by some companies.
- Correlational studies are normally done in non-contrived - Longitudinal Studies – studying people or phenomena at
(natural) settings whereas most rigorous causal studies more than one point in time in order to answer a research
are conducted in contrived (designed) environment. question.
- Field studies - correlational studies done in organizations.  E.g. data taken before and after a change in top
(minimal researcher interference) management to study its effect on employee loyalty
 E.g. analyzing secondary data relationship, distributing towards organization.
questionnaire, interviewing, observing without  E.g. data taken between April – June from year 2005 –
interfering with normal activity. 2009 to study its trend during mid year stock evaluation.
- Field experiments – cause and effect studies done in
same natural environment. (moderate researcher
interference)
 E.g. increasing pay and analyze the effect of employee
performance in normal work condition.
- Lab experiments – cause and effect studies done beyond
the possibility of the least doubt in an artificial, contrived
environment in which all extraneous (foreign) factors are
strictly controlled. (maximum researcher interference)
 E.g. Putting subjects in 3 group with 3 different setting,
and giving each of them different stimuli, to test their
reaction or behavioral change.
- Read example in textbook pg.130-131.
Topic 2 : Problem Identification – Broad Problem Area Problem Definition
- A process of narrowing down the problem from its
Preliminary Data Collection original broad base to defining the issue more clearly
Three (3) categories of information required by researchers (unambiguously identified).
are:
1. Background information of the organization (Secondary - A problem does not necessarily mean that something is
data)). seriously wrong with a current situation that need
immediate rectification. A problem could simply indicate
- Obtained from published records, company’s website an interest in an issue where finding the right answer
2. Managerial philosophy, company policies, procedure, might help to improve existing situation.
rule and other structural aspects. (Secondary data)
- It is a situation where a gap exist between the actual and
- Obtained from company’s records and documents. the desired ideal status.
3. Perception, attitude, and behavioral responses of  Eg: we want zero defect in production, high sales
organizational members and client systems. (Primary turnover, and high employee morale, high quality of life,
data) highly qualified engineers, etc.
4. Observation, interview, administering questionnaire at
actual site/event. - Problem definition could encompass both existing
problem in current setting, as well as the quest for
(1) Background information on the organization idealistic states in organizations.
Researchers need to collect information pertaining to: - Managers must not mistakenly observe symptom as a
1. The origin and history of the company/organization, problem. Finding ‘right’ answers to the ‘wrong’ problem
growth rate, ownership etc. definition is wasteful. Symptoms are consequence (effect)
2. Size in term of employees, assets or both. to a problem (central issue).
3. Charter – purpose and ideology  Eg: productivity and motivation.
4. Location – regional, national or other.
5. Resources – human and others. Problem Definition or Problem Statement
6. Interdependent relationship with other institutions and - Often referred to: a clear, precise and succinct (summary)
external environment. statement of the question or issue to be investigated with
7. Financial position during previous 5 – 10 years and the goal of finding an answer or solution.
relevant financial data.
- Problem statement could relate to:
1. Existing business problem that managers require
(2) Information on Structural Factors and Management
solution.
Philosophy
2. No current problem but situation requires improvement.
- Information on company policies, management 3. Area requiring clearer concept clarity for better theory
philosophy etc can be obtained by asking directly from building.
the management. 4. Situation researcher want to answer a research question
- Information on structural factor are as follows: empirically because of interest.
 Roles and position in the organization and the number of
employees at each job level.
 Extent of specialization
 Communication channels
 Control systems
 Coordination and span of control.
 Reward systems.
 Workflow system etc

(3) Perception, Attitudes, and Behavioral Responses


Attitudinal factors comprise of people’s belief about and
reaction to:
1. Nature of work.
2. Wok flow inter dependencies.
3. Superiors in the organization.
4. Participation in decision making.
5. Client systems.
6. Co-workers.
7. Rewards provided by the organization.
8. Opportunities for advancement.
9. Organization’s attitudes toward employees’ family
responsibilities.
10. Company’s involvement with community.
11. Company’s tolerance of employees’ taking time off from
job.
Topic 3 : Literature Survey Conducting Literature Survey
- Literature review need to be done on variables identified
Problem identification during the interview process.
After completing this topic, you should be able to:
1. Develop relevant and comprehensive bibliographies for - Steps taken consists of:
any organizational research topic. 1. Identifying relevant sources - various publish &
2. Write a literature review on any given topic, unpublished materials.
documenting the references in the prescribe manner. 2. Gathering/extracting relevant information via library or
online sources
Literature Survey 3. Writing up the literature review.
- The documentation of a comprehensive review of the Identify relevant sources
published and unpublished work from secondary sources
of data in the areas of specific interest to the researcher. - Global business information, published articles in
newspapers and periodicals, and conference proceeding
- Sources of literature are from: books, journals, are all now available on computerized databases,
newspapers, magazines, conference proceedings, CD-ROM and on the internet.
doctoral dissertation, master’s theses, government
publications, financial, marketing reports etc. - Three(3) form of databases helps literature reviews:
1. Bibliographic databases – display only bibliographic
- Literature survey must be started even before citation
information from unstructured and structured interviews Name of author, the title of the article (or book), source
is being gathered. of publication, year, volume and page number.
- Literature surveys helps researchers focus further 2. The abstract databases – which in addition provide an
interviews more meaningfully on certain aspects found abstract or summary of the articles.
to be important in the published studies. 3. The full-text databases, which provide full text article.

Reason for literature survey Extracting relevant information


- To ensure no important variable found repeatedly in past - While reading articles, detailed information on the
researches bearing upon the problem being ignored. problem that was researched, the design details of the
- To prevent researcher from spending considerable time study (such as sample size and data collection methods),
and effort to discover something that has already been and the ultimate findings can be systemically noted in
researched. (reinventing the wheel) some convenient format, which facilitate the writing up
of the literature with minimum disruption and maximum
- Facilitates creative integration of information gathered efficiency.
from structured and unstructured interviews with what is
found in previous studies. - Discover other factors closely related to the problem.
- To provide foundation for developing a comprehensive - Articles considered relevant to the current study can be
theoretical framework from which hypotheses can be listed as references.
developed for testing.
Writing up literature review
A good literature survey ensures that : - Also called literature survey.
- Important variables that are likely to influence the - A process of documentation of the relevant studies by
problem situation are not left out of the study. citing (mentioning) the author and year of the study.
- A clearer image as to what variable would be most - Present clear and logical facts and elaboration on the
important to consider (parsimony), why it’s important research work done thus far.
and how it should be investigated. - Bringing together all relevant information in a cogent
- Problem statement can be made with precision and (powerful) and logical manner.
clarity. - Cite references using quotation.
- Te-stability and replicability of the findings are - A distinction must be made between bibliography and
improved. references.
- Avoid “reinventing the wheel”. Less risk of duplicating  Bibliography – listing of the work that is relevant to the
research. main topic of interest arranged in the alphabetical order
- Problem investigated is perceived by the scientific of the last name of the authors.
community as relevant and significant.  Reference list – is a subset of the bibliography, which
include details of all the citation used in the literature
- Becomes a basis for the discussion of the findings with survey and elsewhere in the paper, arranged again, in the
the previous research. alphabetical order of the last name of the authors.
 3 modes of referencing – APA Format, Chicago Manual
of Style, and Turabian Style. Refer your textbook page
80 – 84 for discussions.
Tips how an article should be read Topic 4 : Development of Theoretical Framework
1. Read the abstract or summary first. This tells whether the
article is worth reading in its entirety. Stating The Research Question
2. Read the bibliographic data.  Research questions are derived from the problem
3. Take note on the article concentrating on the following statement.
points:  E.g. a company made the following statement to define a
a) Problem statement. State it clearly training problem:
b) Hypothesis or Objective. List them exactly as stated in 1. How familiar are employees with the various software
the article. application for personal computer?
c) Procedures. List the research methodology used (survey, 2. What attitude do employees have towards these software
experiment, case study, etc), the number of subjects and packages?
how they are selected, the kind of instrument used 3. Is there any difference in the computer knowledge
(questionnaire, observation, etc) between male and female users?
d) Findings. List major findings. Indicate whether the 4. Is there any difference in the computer usage between
objectives of the study were obtained or the hypothesis user in various departments?
were supported.
e) Conclusions. Describe the author’s conclusions. Note Theoretical Framework
your disagreement with the author, and the reason of  A conceptual model of how one theorizes or makes
such disagreement. Note the strength and weaknesses of logical sense of the relationships among several factors
the study that make the results particularly applicable or (variables) that have been identified as important to the
limited with regard to your research question. problem.
 It discusses the interrelationships among the variables
that are deemed to be integral to the dynamics of the
situation being investigated.
 Help researcher postulate/hypothesize and test certain
relationship to improve understanding of situation.
 The entire research rests on the basis of the theoretical
framework.
 Developing a good theoretical framework is central to
examining the problem under investigation.

The Relationship Between Literature Review (LR) and


Theoretical Framework (TF)
 Literature Review
- Identifies the variables that might be important as
determined by previous research finding.
- This, in addition to other logical connections that can be
conceptualized, forms the basis for the theoretical model.
 Theoretical Framework
- Elaborates the relationship among variables.
- It explains the theory underlying the relations.
- It describe the and direction of the relationship.
- A good TF identifies and label the important variables in
the situation that are relevant to the problem defined.
- Elaboration of variables in the TF addresses the issues of
why or how we expect certain relationship to exist and
the nature and direction of the relationship among the
variables of interest

Variables
 A variable is anything that can take on differing or
varying values. The values can differ at various times for
the same object/person, or at the same time for different
object/person.
 Examples:
- Production units: One worker can varying unit of output
per minute.
- Absenteeism: The number of absent worker can vary
each day.
- Motivation: Level of workers’ motivation varies among
them.
Types of Variables
Four (4) main types:
1. Dependent variable (Criterion)
 Variable of primary interest to the researcher.
 Researcher wants to understand and describe or explain
it’s variability or predict the dependent variable.
 The researcher will be interested in quantifying and
measuring the dependent variable, as well as the other
variables that influence it.
 Refer to textbook (pg. 88) for example and exercise.

2. Independent variable (Predictor)


 Variable(s) that influence the dependent variable either
positively or negatively. 4. Intervening variable
 Dependent (y) will present only if Independent (x) also  This variable appear between the time the independent
present. variable starts operating to influence the dependent
variable and the time their impact is felt on it.
- Positive way: increase x => increase y  Act as a function of the independent variable(s)
- Negative way: increase x => decrease y operating in any situation, and help to conceptualize and
 Refer to textbook (pg. 89-91) for discussion explain the influence of the independent variable(s) on
the dependent variable.
 The independent variables (intelligence, prep. hrs)
influence the dependent variable (exam result), the
intervening variable (learning skill) appear as a function
of intelligence and prep hrs interaction facilitated by the
3. Moderating variable moderating variable.
 A 3rd variable that has a strong contingent effect on the
independent variable-dependent variable relationship.
 The presence of this variable modifies the original
relationship between the independent and dependent
variables.
 The relationship between the dependent variable and the
independent variable is dependent on the other
(moderating) variable  Lecturer’s expertise moderates the relationship between
 Refer to textbook (pg. 91-92) for discussion IVs and learning skills.
 Learning skill will not appear from the IVs unless
lecturers are able to synergize his classroom diversity in
teaching and learning for his students.
 The IV helps to explain the variance in the DV, the
intervening variable surfaces at t2 as a function of the
IVs, which help to conceptualize the relationship
between the IVs and DV; and the MV has a contingent
effect on the relationship between IVs and DV.
The intervening variable does not add to the variance
Difference between Independent, Moderating, and

already explained by the IVs. The MV has an interaction


Dependent Variable
effect with the IV in explaining the variance.
 It is sometimes difficult to identify which variable
belong to which category.
 The decision to label them dependent, independent, or
moderating variable depends on how they affect one
another.
Component of Theoretical Framework Some examples of Hypotheses
1. The variables considered relevant to the study must be Ho : There is no relationship between Gender and College
clearly identified and label in the discussions.
2. Discussion must state how 2 or more variables are HA : There is a relationship between Gender and College
related to one another, especially important relationship.
3. Discuss if the direction of the relationship would be Ho : There is no difference in perception towards distribution
positive or negative based on previous research. system between type of customer
4. Give clear explanation on why we expect a relationship HA : There is a difference in perception towards distribution
to exist. Argument drawn from previous research system between type of customer (Non-Directional
findings. Hypothesis)
5. Present schematic diagram of the theoretical framework
so people can see and easily understand the theorized OR
relationship
HA :Vendor rated higher than agent on their perception
SCHEMATIC DIAGRAM OF THE THEORETICAL towards distribution system (Directional Hypothesis)
FRAMEWORK

Hypothesis Development
 Definition of Hypothesis – a logically conjectured
(theorized) relationship between two or more variables
expressed in the form of a testable statement.
 Formulating testable statement is called hypotheses
development.
 Statement in a form of If - then.
- E.g. Student who read more frequently will score a better
grade: If student read more frequently, then they will
score a better grade.
 Directional and Non-directional Hypotheses
- Directional : Men are better financial analyst than
women.
- Non-directional: Men financial analysis are different (or
same) the women financial analyst.

Null and Alternate Hypotheses


Null Hypothesis (Ho)– a statement of no relationship
between variables.
 Statement of equality (no difference…., no
relationship…)
 Refers to the population
 Implied statement
Alternate Hypothesis (H1) or (HA)– a definite statement of
the relationship between two variables.
 Also known as the Research Hypothesis.
 Statement of inequality (a difference…, a
relationship….)
 Explicit statement
 Always refers to the sample
 Takes two form:
- Directional : e.g. ‘more than, less than (direction
specified)
- Non-directional: e.g. different from (direction not
specified)
Topic 5 : Research Design Purpose of the Study – Hypothesis Testing
- To test the nature of certain relationships, or establish
The research Design differences among groups or the independence of two or
Involves a series of rational decision-making choices on more factors in a situation, or to predict some outcomes.
issues relating to:
1. Purpose of the study (exploratory, descriptive, - To establish cause and effect relationship among
hypothesis testing) variables of interest.
2. The study setting (location) - Can be done on both qualitative as well as on
3. Type of investigation quantitative data.
4. Extent of researcher interference (studying or - Methodological rigor (severe ness) increases as we move
manipulation) from an exploratory study to a hypothesis-testing study,
5. Time horizon as well as costs incurred.
6. Unit of analysis (individuals, groups, organizations)
Types of Investigation: Causal vs. Correlational
- A researcher/manager should determine which study is
appropriate by viewing problems or issues at hand.
- To know whether a study is a causal or a correlational
depends on the type of research questions asked and how
the problem is defined.
- Causal Study – researcher wants to delineate (specify)
the cause of one or more problem.
 E.g. – Does smoking cause cancer? Variable x
causes variable y.
- Correlational Study – researcher interested delineating
the important variables associated with the problem.
 E.g. – Are smoking and cancer related? Or Are
smoking, drinking, and chewing tobacco associated
Purpose of the Study - Exploratory
with cancer? If so which one contributes most to
- Undertaken when not much is known about the situation variance in the dependent variable?
at hand, or no information is available on how similar
problems or research issues have been solved in the past. Extent of Researcher Interference
- Requires extensive preliminary work to gain familiarity - Extent of researcher’s interference with the study has a
with the situation, understand what is happening before direct impact on the type of investigation (causal or
developing model and designing other rigorous correlational).
investigations.
- Correlational study – conducted when minimal
- Undertaken to better understand the nature of the interference with normal flow of work.
problem because few studies have been made in this
- Causal – conducted when researcher tries to manipulate
area.
(deliberately change) certain variables to see its effect on
- Extensive interviews and observations (qualitative data) dependent variable of interest.
were carried out to collect data thus providing enough
- Read example in textbook pg.128-129
evidence to develop theories and hypotheses for
6.12 for minimal interference
subsequent testing.
6.13 for moderate interference
6.14 for excessive interference
Purpose of the Study - Descriptive
- Undertaken to ascertain and to describe the characteristic Study Setting: Contrived and Non-Contrived
of the variables of interest in a situation.
- Correlational studies are normally done in non-contrived
- To learn and to describe the characteristic of a group of (natural) settings whereas most rigorous causal studies
employee (age, job status), organizations (practices, are conducted in contrived (designed) environment.
culture), etc.
- Field studies - correlational studies done in organizations.
- Goal is to offer a profile or to describe relevant aspects (minimal researcher interference)
of phenomena of interest.  E.g. analyzing secondary data relationship,
- Help researcher to: distributing questionnaire, interviewing, observing
- Understand the characteristic of a group in given without interfering with normal activity.
situation. - Field experiments – cause and effect studies done in
- Think systematically about aspects in given situation. same natural environment. (moderate researcher
interference)
- Offer ideas for further probe and research  E.g. increasing pay and analyze the effect of
- Help make certain simple decisions employee performance in normal work condition.
- Data are presented in forms such as bar charts, - Lab experiments – cause and effect studies done beyond
frequencies, mean, mode, median, standard deviation, the possibility of the least doubt in an artificial, contrived
etc. environment in which all extraneous (foreign) factors are
strictly controlled. (maximum researcher interference)
 E.g. Putting subjects in 3 group with 3 different Topic 7 : Research sampling
setting, and giving each of them different stimuli, to
test their reaction or behavioral change.
- Read example in textbook pg.130-131.

Unit of Analysis
- Unit of Analysis is the level of aggregation of the data
collected during subsequent data analysis stage.
- Our research question determines the unit of analysis.
 Individual u.a – Data gathered from each individual
and treating each employee’s response as an
individual data source
 E.g. Prob. Stat – What is the motivational level of
our employees?
 Dyad u.a – data gathered from two person in a
group and treating each group’s response as Population, Element, Population Frame, Sample and
separate data source. Subject
 E.g. Prob. Stat – how to raise - Population – refers to the group of people, events, or
supervisor-subordinate relationship at work? things of interest that the researcher wishes to
 Group u.a - data gathered from different group and investigate.
treating each group’s response as separate data  E.g. computer firms in Silicon valley, all blue-collar
source. workers in the mining industry in the country etc.
 E.g. Prob. Stat – is there a difference among
children of different age group in their attitude - Elements – a single member of the population.
towards learning?  E.g. each blue-collar worker in the mining industry.
- Individuals do not have the same characteristic as groups - Population Frame – a listing of all the elements in the
(e.g. structure, cohesiveness) and group do not have the population from which the sample is drawn.
same characteristics as individual (e.g. IQ, stamina)  E.g. payroll list, student list, list of computer firms
etc.
- It is necessary to decide on the unit of analysis when we
formulate the research question because data collection - Sample – a subset of the population, i.e. some but not all
methods, sample size, and variable used may depend on element from the population being studied.
the unit of analysis used.  E.g. 200 person from 1000 blue-collar worker in a
firm.
Time horizon - Subject – a single member of the sample.
- Cross-Sectional Studies – a study where data are  E.g. each person in the sample of 200 blue-collar
gathered just once, over a period or days/weeks/months worker.
in order to answer a research questions.
 E.g. data taken for a period between April - June Sampling
last year to study it behavior during slowdown - Sampling is a process of selecting a sufficient number of
phase. elements from the population, so that a study of the
 E.g. a one time survey done to determine the effect sample and an understanding of its properties or
of certain advertising campaign by some characteristics would make us possible to generalize the
companies. population’s elements.
- Longitudinal Studies – studying people or phenomena at - The characteristic of the population such as µ
more than one point in time in order to answer a research (population mean), σ (population standard deviation),
question. and σ2 (population variances) are referred to as its
 E.g. data taken before and after a change in top parameters.
management to study its effect on employee loyalty - All conclusions drawn about the sample under study are
towards organization. generalized to the population.
 E.g. data taken between April – June from year
2005 – 2009 to study its trend during mid year - Sample statistic X (sample mean), S (standard deviation),
stock evaluation. and S2 (variation in the sample) are used as estimates of
the population parameter.

Reasons for sampling


- Practically impossible to collect data, or test, or examine
from every element of the population being studied.
- Less time (quicker), less cost (cheaper than studying
whole population), and human resource limitations.
- Studying samples rather than the population likely to 4. Area sampling, and
produce more reliable results. 5. Double sampling.
- Reducing fatigue, less error in collecting data especially
when a large number of elements is involved. Systematic Sampling
- Systematic sampling design involves drawing the nth
Representativeness of Samples element in the population starting with randomly chosen
- Rarely sample will be an exact replica of the population element between 1 and n.
form which it is drawn.  E.g. sampling 35 household from 260 houses. We
sample every 7th house (7, 14, 21..) until we get 35
- Sample statistic (X, S, S2) ≠ Population parameter (µ, σ, sample size.
σ2 ).
- The possibility of drawing incorrect conclusion from
- Choosing sample in a scientific way can help bringing these data is high due to systematic bias.
the sample statistic closer to the population parameter,
making the sample a representative of the population. - Researcher must carefully plan before appropriate
systematic sampling is employed.
- Suitable for market surveys, consumer attitude,
behavioral studies etc.

Stratified Random Sampling


- A process of stratifying or grouping of elements within a
population and then proceed with random selection of
Sampling Methods – Probability and Non-Probability subjects from each stratum (group).
Sampling - In a population there may exist sub-groups that differ in
- Probability Sampling – elements in the population have its parameter on a variable of interest of the researcher.
some known chance or probability of being selected as  E.g. in an organization there are top managers,
sample subjects. middle managers and clerks that responded
 Used when the representativeness of the sample is differently in training given to them.
important for wider generalization.  Help researcher identify or focus the actual group
requiring for solutions/attention.
- Non-probability Sampling – elements do not have a
known or predetermined chance of being selected as - Stratification ensures homogeneity (similarity) within
subjects. each stratum and provides heterogeneity (differences)
 Used when time and other factor are more between strata (group).
important rather than generalizability. - Stratification is an efficient research sampling design as
it provide more information in a given sample size.
Sub-group can be analyzed.
 Stratification of the population can be made by:
geographical areas, market segment, age, gender,
department, job type, etc….

Probability sampling
Simple Random Sampling (SRS) – every element in the
population has a known and equal chance of being selected
as a subject.
- E.g. lucky draw 1st of 1000, 2nd of 999, 3rd of
998……
- SRS has the least bias and offer the most
generalizability.
- Sometime become cumbersome, expensive and not the
most efficient design.
Complex Random Sampling – similar to SRS but offer a viable
and more efficient approach. Five most common complex
probability sampling:
1. Systematic sampling,
2. Stratified sampling,
3. Cluster sampling,
Cluster sampling Purpose sampling
- Not very common sampling technique in organizational - Process of obtaining sampling from specific target group
research. or from those who have the specific information, or may
- Takes cluster or chunks of elements that have have certain criteria set by the researcher.
heterogeneity (differences) among members within each - Two major types of purposive sampling:
group that are chosen for study. 1. Judgment Sampling
- Cluster samples offer more heterogeneity (differences) 2. Quota Sampling
within group and more homogeneity (similarity) among
group – the reverse of stratified random sampling. Judgement sampling
- Expose to greater biases and the least generalizable of all - Involves the choice of subjects who are most
probability sampling design, because most naturally advantageously placed or in the best position to provide
occurring cluster in the organizational context do not the information required.
contain heterogeneous elements.  E.g. what it takes for student to achieve dean’s list
in their academic performance. The sample would
- The only advantage is lower cost and convenience in be those students who have achieved dean’s list in
sampling. their examination results for few semesters.
- It does not offer much efficiency in terms of precision - Judgment sampling demands special effort to locate and
and confidence in the results. gain access to the individuals who have the requisite
information.
Area sampling
- Used when limited number or category of people have
- A form of cluster sampling within an area. the information we want.
- Area sampling constitutes geographical clusters such as - Results are not generalizable to the population being
countries, city blocks, or a particular boundaries within a studied.
locality.
 E.g. sampling the needs of people in Dungun before Quota sampling
opening a fast food restaurant to gather information
on taste, attitudes or behavior. - This sampling ensures that certain groups are adequately
represented in the study via assignment of quota.
- Less expensive than most other probability sampling and
not dependent on a population frame. - Quota is fixed based on the total number of each group
 E.g. using city/town maps to allow researcher to in the population.
sample areas/blocks in obtaining data about - A form of proportionate stratified sampling based on a
residents. convenience basis (non-random).
- Saves time, cost and effort for researcher to conduct
Double sampling research.
- Undertake when further information is needed from a - Ensures that all subgroups in the population are
subset of the group from which some information has adequately represented in the sample.
already been collected for the same study.
- Results are not generalizable to the population being
- 1st sample taken for preliminary studies then subsample studied, but can be used effectively as a preliminary
of this primary sample is used to examine matters in research before in-depth research being undertaken or
more detail. vice-versa.
Non-probability sampling
- Elements in population do not have any probability
attached to their being chosen as sample subjects.
- Findings from the study of the sample cannot be
confidently generalized to the population.
- Can only be employed only if researcher is less
concerned with generalizability.
- Two categories of non-probability sampling:
- Convenience Sampling
- Purposive Sampling

Convenience sampling
- Collection of information from members of the
population who are conveniently available.
- E.g. distributing questionnaire at a shopping mall asking
shoppers opinion / preferences about product X over
product Y.
- Mostly used during exploratory phase of a research
project to get basic information quickly and efficiently.
Determining sample size - The level of confidence can range from 0 to 100%.
- The second aspect of sampling design is estimating the - A 95% confidence is the conveniently accepted level for
sample size. most business research.
- It is a question of how big is the sample required that we - This is expressed by denoting significance level as p
will be able to precisely (accurately) generalize our < .05
findings to the population with confidence (less doubt).
- A reliable and valid sample should enable us to Sample Data, precision and confidence in esmation
generalize the findings from the sample to the population - When we use sample data to draw inferences about the
under investigation. population, we hope to be fairly “on target” (precision
 The sample statistic should be reliable estimates and confidence) and have some idea on the extent of
and reflect the population parameters. possible error.
 In reality it is impossible to have a sample x closely
reflecting the population µ. - Because a point estimation provides no measure of
possible error, we do an interval estimation to ensure a
- Therefore to obtain confidence we need to set an interval relatively accurate estimation of the population
estimates within where the µ will lie, with probabilities parameter.
attached to it.
- E.g. sample of 64 customers taken via systematic
Precision sampling. x=105, S=10, x is the sample mean to estimate
µ, we could construct a confidence interval around x to
- Precision refers to how close our estimate is to the true estimate range which µ will fall.
population characteristic.
- The standard error Sx and the level of confidence will be
- Usually, we would estimate the population parameter to used to determine the width of the interval using the
fall within a range, based on sample estimate. following formula: µ=X + KSx where K is the t
- Precision is a function of the range of variability in the statistic for level of confidence required
sampling distribution of the sample mean.
- Different samples taken from a single population will
provide different mean of each sample, but are normally
distributed and have a dispersion attached to it.
- The smaller this dispersion (variability), the greater the
probability that the sample mean (x) will be closer to the
population mean (µ).
- This variability is called the standard error, denoted by
Sx
- The standard error is calculated by the formula:
- The width of the interval has increased and now we are
- S - is the standard deviation
less precise in the estimation of the population, but we
- n - is the sample size are now a lot more confident about our estimation.
- Sx - is the standard error or extent of precision - If we want to maintain our original precision while
offered by the sample. increasing confidence, or maintain confidence while
- The standard error (Sx) varies inversely with the square increasing precision, or to increase both, we need to have
root of the sample size (√n). The larger the n the lesser a larger sample size.
the standard error. Therefore if we want to reduce the
standard error we need to increase the sample size. The sample size , n, is a function of:
- Note that the smaller the variation in the population, the - The variability in the population
smaller is the standard error which implies that the - Precision or accuracy needed
sample size need not be large i.e. low variability in the
- Confidence level desired
population requires a smaller sample size.
- Type sampling plan – SRS vs. Stratified RS
- To summarize, the closer we want our sample results to
the population characteristic, the greater will be the
precision we would aim at. The greater the precision we
require, the larger is the sample size that we must collect.

Confidence
- Confidence denotes how certain are we that our
estimates will really hold true for the population.
- In the previous example we have more confidence on the
How to Determine The Sample Size
40 – 60 range than the 45 – 55 range.
Example : A manager wants to be 95% confident the expected
- The narrower the range the lower the confidence. There monthly withdrawals in a bank will be within a confident
is a trade-off between precision and confidence. interval of +RM500. S = RM3,500. What is the sample size he
- Confidence reflects the level of certainty with which we need?
can state that our estimates of the population parameters,
based on our sample statistics, will hold true.
Topic 8 : Measurement of variable

How variable are measured


- Objects that can be physically measured by some
calibrated instruments pose no measure problem.
 E.g. – Length, width, height of a rectangular table
using a measuring tape or a ruler.
- Demographic characteristic can also be measured by
simple asking question such as:
 E.g. – length of job service, duration of task, job
Importance of Sampling Design and Sample Size title, marital status, and gender etc..
- Sampling design and size are both important to establish - What about measuring subjective elements such as
the representativeness for generalizibility. feelings, behavior, perceptions, attitudes etc?
- Large sample size is useless if wrong sampling design is  To measure these we must reduce the abstract
employed. notions, or concepts such as motivations,
satisfactions etc into observable behavior and
- Good sampling design will not support the research if characteristics
sample size is inadequate (does not offer precision and  E.g. thirst – we cannot see thirst but we can assess
confidence). by the number of glasses a person drinks at one
- Roscoe (1975) proposes the rule of thumb for time.
determining sample size:  Reduction of abstract concept into measurable
1. Sample sizes larger than 30 and less than 500 are tangible way is called ‘operationalizing’ the
appropriate for most research. concepts
2. Sub-samples (male/female, etc ) a minimum sample size
of 30 for each category is necessary. Operational Definition: Dimension and Elements
3. In multivariate research, the sample size should be - Operationalizing, or operationally defining a concept to
several times (>10 times) as larger as the number of make it measurable is done by looking at the behavioral
variables in the study. dimensions, facets (aspects) or properties indicated by
4. For simple experimental research with tight experimental the concept.
controls, successful research is possible with only 10 –
20 samples - It is a statement of the specific dimension and elements
through which a concept will become measurable.
- These concepts are then transformed into observable and
measurable elements so as to develop an index of
measurement of the concept.
- Refer to Example 8.1 and 8.3 in your textbook for further
examination and discussions.
Scales - Measure of central tendency: arithmetic mean or
- After operationalizing the concepts into dimensions and geometric mean, measuring dispersion using standard
elements, the next task is to measure them in some deviation or variance, or coefficient of variation.
manner.
- A scale is a tool or mechanism by which individuals are
distinguished as to how they differ form one another on
the variables of interest to our study.
- Four basic types of scales:
1. Nominal
2. Ordinal
3. Interval and
4. Ratio

Nominal scales
- A measurement that allows researcher to assign certain
categories or groups which are mutually exclusive (i.e.
no 3rd category which respondent would normally fall Topic 9 : Measurement scales
 E.g. Gender: (1) Male/ (2)Female.
 E.g. Race: (1) Malay (2) Chinese (3) Indian Rating scales
- Normally displayed in frequencies and measured in Rating scales often used in organizational research:
percentages. - Dichotomous scale
- Category scale
Ordinal scale
- Likert scale
- Categories of variable in such a way to denote
differences among the various categories, it also - Numerical scales
rank-orders the categories in some meaningful way. - Semantic differential scale
 E.g. ranking preference from best to worst or first - Itemized rating scale
to last by assigning numbers 1,2,3…to each level.
- Fixed or constant rating scale
- Ordinal scale provides more information than nominal
scale by distinguishing categories by rank-ordering them. - Stapel rating scale
- However it does not give any indication about the - Graphic rating scale
magnitude of the differences among the ranks…i.e. - Consensus scale
difference between ranking 1-2 is not the same as
difference between rank 3-4. Dichotomous scale
- Is used to elicit a Yes or No answer.
Interval scale
- A nominal scale is used to elicit a response.
- Interval scale allows certain arithmetical operation to be
performed on data collected from respondents. - E.g. Do you own a car?
Yes ____ No _____
- It let us measure the distance between any two points on

a scale.
Category Scale
- Consists of categories of a variable (nominal) arranged in
order (ordinal) and measures the magnitude of the - Uses multiple items to elicit a single response.
differences among individual. - Also nominal scale is used to elicit a response.
- It provide an indication about the magnitude of the - E.g. What is your race?
differences among the scale. i.e. difference between  Malay ____
point 1-2 is the same as difference between point 3-4.  Chinese ____
- A more powerful scale than the nominal, and ordinal  Indian ____
scale and can measure central tendency (mean), the  African ____
dispersion (range), standard deviation and variance.  European ____
 Others ____
Ratio scale
Likert scale
- Ratio scale not only measures the magnitude of the
difference between point on a scale but also taps the - Designed to examine how strongly subject agree or
proportions in the differences. disagree with a statement on a 5-point scale.
- Most powerful of the four scales because it has a unique - This is an interval scale and the differences between any
zero origin and combine all the properties of the other two points on the scale remain the same.
three scales. - Conducted over a summated of several items measuring
 E.g. a person weighing 200 kg is twice as heavy as a particular concept or
one who weigh 100 kg. (Note multiplying or response
dividing both this number by any number given
number will still preserve the ratio 2:1)
 E.g. age, income, height, distance etc
Semantic Differential Scale
- Several bipolar attributes are identified at the extremes of
the scale and a respondent are asked to indicate their
attitude.
- Bipolar adjectives used: Good-Bad, Strong-Weak,
Hot-Cold etc.

Responsive ___ ___ ___ ___ ___ ___ Unresponsive Graphic Rating Scale
Beautiful ___ ___ ___ ___ ___ ___ Ugly - A graphical representation helps the respondents to
Courageous ___ ___ ___ ___ ___ ___ Timid indicate on this scale their answer to a particular question
by placing a mark at the appropriate point on the line.
Numerical scale - This is an ordinal scale.
Similar to semantic differential scale, with a difference that
number on a 5-point or 7-point scale are provided, with
bipolar adjectives at both ends.

Itemized rating scale


- A 5-point or 7-point scale with anchors (High/Low,
Satisfied/Unsatisfied), as needed, is provided for each
item and the respondent states the appropriate number on Ranking scales
the side of each item, or circle the relevant number
against each item. - Ranking scales may not give definitive clues to some of
the answers sought.
- The responses to the item are then summated.
- E.g. In choosing which product line preferred by
- Balanced rating scale with a neutral point customer: 35% product 1, 25% product 2, 20% product 3
and 4. manager cannot say customer prefer product line 1
when 65 % did not choose this product!
- Alternative methods used in ranking scales : paired
- Unbalanced rating scale without a neutral point
comparisons, forced choice, and comparative scale.

Pired comparison

Forced choice
Fixed or constant sum scale - Paired comparison scale is used when, among a small
- Here, respondents are required to distribute a given number of objects, respondents are asked to choose
number of points across various items. between two objects at a time.
- Very much like an ordinal scale - Paired sample comparison is good method if the number
of stimuli is small.
- E.g. In choosing a car, indicate the importance you attach
to each of the following five aspects by allotting points - Forced choice enables respondents to rank objects
for each to total 100 in all. relative to one another.
Safety ___ - Easier for respondents, if the number of choice to be
Power ___ ranked is limited in number. E.g. Rank 1 most preferred,
Brand name ___ 5 for least preferred.
Design ___ - Utusan Melayu ___
Color ___
- New Straits Times ___
Total points 100
- Berita Harian ___
Stapel scale - Harian Metro ___
- This scale simultaneously measures both the direction - Malay Mail ___
and intensity of the attitude toward the items under
study. Comparative scale
- The characteristic of interest to the study is placed at the - Comparative scale provides a benchmark or a point of
center with a numerical scale ranging, say +3 to -3, on reference to assess attitudes toward the current object,
either side of the item. event, or situation under study.
- Does not have a zero point and is an interval scale. - E.g. In a volatile financial environment, compared to
- E.g. Assessing leadership in organizations stocks, how wise or useful is it to invest in Treasury
bond? Please circle the appropriate response.
Goodness of measures Parrallel Form Reliability
- It is important or make sure that the instrument the we - Occurs when responses on two comparable sets of
develop to measure a particular concept is accurately measures tapping the same construct are highly
measuring the variable, and that in fact, we are actually correlated.
measuring the concept we really want measure. - Both forms have similar items and the same response
- Scale develop could often be imperfect, and errors are format, the only changes being the wordings and the
prone to occur in the measurement of attitudinal order or sequence of the questions.
variables. - If the forms are highly correlated (say .8 and above) we
- We need to assess the “goodness” of measures we may fairly certain that the measure are reasonable
develop so we can be reasonably sure that the instrument reliable.
we use in our research is valid (logical) and reliable
(dependable). Consistency of measures
- To ensure measures developed are reasonably good we - The internal consistency of measures is indicative of the
need to begin with item analysis first, and subsequently homogeneity of the items in the measure that tap the
establishing the reliability and validity of these measures. construct.
 Items should “hang together as a set” and be
Item analysis capable of independently measuring the same
- Item analysis is done to see if the items in the concept so that the respondents attach the same
instruments belong there or not. overall meaning to each of the items.
 Each item is examined for its ability to discriminate - Two test of reliability:
(separate) between those subjects whose total 1. Interitem Consistency Reliability
scores are high, and those with low scores. 2. Split-Half Reliability
- Reliability tests how consistently a measuring instrument
measures whatever concept it is measuring. Interitem reliability
 Concern with stability and consistency of - A test of the consistency of respondents’ answers to all
measurement. the items in a measure.
- Validity tests how well an instrument that is developed - The most popular test of interitem consistency reliability
measures the particular concept it is intended to measure. is the:
 Concern with whether we measure the right 1. Cronbach’s coefficient alpha (Cronbach’s alpha), which
concept. is used for multipoint-scaled items, and
2. Kuder-Richardson formulas, used for dichotomous
Reliability items.
- Reliability of a measure indicate the extent to which it is - The higher the coefficient, the better the measuring
without a bias (error free) and hence ensures consistent instrument.
measures across time and across the various item in the
instrument. Split Half reliability
- Reliability of a measure is an indication of the stability - Split-half reliability reflects the correlations between two
and consistency with which the instrument measures the halves of an instrument.
concept and helps to assess the “goodness” of a measure. - The estimates would vary depending on how the items in
the measure are split into two halves
Stability of measures
- The ability of a measure to remain the same over time – Validity
despite uncontrollable testing condition or the state of the - Reliability is necessary but not sufficient condition of the
respondents themselves – is indicative of its stability and test of goodness of a measure.
vulnerability to change in the situation.
- Validity ensures the ability of a scale to measure the
- Two test of stability: intended concept.
1. Test-Retest Reliability
2. Parallel-Form Reliability - When we ask a set of questions (i.e., develop a
measuring instrument) with the hope that we are tapping
Test-Retest Reliability the concept, how can we be reasonably certain that we
are measuring the concept we intended to measure and
- The reliability coefficient obtained with a repetition of something else?
the same measure on a second occasion.
- Several types of validity tests:
- A set of similar survey questionnaire were distributed 1. Content Validity
now, and then the second time (several weeks to 6 2. Criterion-Related Validity
months apart) on to the same group of respondents, to 3. Construct Validity
assess its correlation scores.
- If the coefficient is high, thus the better the test-retest Content validity
reliability, and consequently, the stability of the - Content validity ensures that the measures includes an
measures across time. adequate and representative set of items that tap the
concept.
 The more the scale items represent the domain or Topic 10 : Questionnaire
universe of the concept being measured, the greater
the content validity. Questionnaire
- A panel of judges (i.e. experts, professionals) can attest - Definition: A questionnaire is a preformulated written
(testify) to the content validity of the instruments. sets of questions to which respondents record their
answers, usually within rather closely defined
Criterion - related validity alternatives.
- Criterion-related validity is established when the When to use a questionnaire:
measure differentiate (distinguish) individuals on a - When researcher knows precisely what information is
criterion it is expected to predict. needed.
- This is done by establishing concurrent validity or - When large numbers of people are to be reached in
predictive validity. different geographical region.
 Concurrent validity - is established when the scale - When groups of people can be assembled in conference
discriminating individuals who are known to be room to whom questionnaire can be administered, and
different; that is, they should score differently on collected immediately.
the instrument. Advantage of questionnaires
 Predictive validity - indicates the ability of the
measuring instrument to differentiate among - Helps researcher obtain data fairly easy.
individuals with reference to a future criterion. - Information from questionnaires is easily coded.
- See example 9.12 in textbook. - Benefits the scientific community if the measures are
well validated and are reliable.
Constrict validity - Often is a catharsis for respondents.
- Construct validity testifies (shows) to how well the
results obtained from the use of the measure fit the Administering Questionnaire
theories around which the test is designed. Questionnaire can be administered:
- This is assessed through convergent and discriminant - Personally face-to-face individually or in group.
validity. - Mailed to respondents
 Convergent validity – is established when the
- Electronically distributed
scores obtained with two different instrument
measuring the same concept are highly correlated.
Personally Administered Questionnaire
 Discriminant validity – is established when, based
Questionnaire can be personally distributed when:
on theory, two variable are predicted to be
uncorrelated, and the scores obtained by measuring - The survey is confined to a local area,
them are indeed empirically found to be so. - The organization is willing and able to assemble groups
of employees to respond to the questionnaires at the
Testing Goodness of Measures: Forms of Reliability and work place.
Validity Advantage:
- Completed questionnaire can be collected quickly form
respondents,
- Any doubts on any questions in the questionnaire can be
clarified on the spot.
- Researcher can introduce the research topic and motivate
respondent to offer frank response.
- Less expensive and save time when conducted in large
group of respondent at the same time.
- Does not require much skill to administer the
questionnaire compared to interviews.

Mail Questionnaire
Advantage:
- Main advantage is a wide geographical area can be
covered in the survey.
- Respondents can complete the questionnaire at their
convenience, at their homes, and at their own pace.
Disadvantage:
- Low return rate of questionnaires.
- Any doubts cannot be clarified.
- Very low return rate make it difficult to establish
representative ness of the sample because those
responding to the survey may not at all represent the
population they are supposed to.
Ways to improve response rate: Open-Ended vs. Closed Questions
- Send follow-up letters. Open ended question allows respondents to answer them in
any way they choose.
- Enclosing some token or monetary incentives with the
questionnaire. - E.g. What are the things that you like about your
supervisor?
- Provide the respondent with self-address, stamped return
envelope. - E.g. Comment on the performance of this portfolio
investment.
- Keep the questionnaire as brief as possible.
- Closed ended question ask respondent to make choices
- Notify respondent in advance, introductory letter using a among a set of alternatives given by the researcher .
reputed research organization
- Any item in a questionnaire using nominal, ordinal, or
Principle of wording refers to: Likert or ratio scale are considered closed ended.
- The appropriateness of the content of the questions, - E.g. Which age group do you belong to.
1) 21 to 30
- How questions are worded and the level of sophistication 2) 31 to 40
of the language, 3) 41 – 50
- The type and form of questions asked, 4) 51 – 60
- The sequencing of the questions and, 5) above 61
- The personal data sought from the respondents. - E.g. Female are more hardworking than male student.
1-Strongly Agree, 2-Agree, 3-Undecided, 4-Disagree,
Content and purpose of the questions 5-Strongly Disagree
- The nature of the variable tapped – subjective feelings or
Positively and Negatively Worded Questions
objective fact will determine what kind of questions will
be asked. - A good questionnaire should include both positively
 Subjective nature (feelings) - such as satisfaction, and negatively worded questions
involvement where respondent’s beliefs, perception - Phrasing questions positively and negatively will
and attitudes are to be measured, the questions minimize respondent’s tendency from mechanically
should tap the dimension and elements of the circle the points towards one end of the scale.
concept - E.g. - Measuring Achievement
 E.g. 5 point Likert scale for 4 – 6 item 1. I normally accomplishes completing many task on time
(questions) given to me by my lecturer. (positive)
 Objective measure – such as age, and education 2. I have occasionally failed to complete my assignments
level of respondents are tapped, a single direct on time. (negative)
question preferably one that has ordinal scaled set
of categories would be appropriate
 E.g. 1- PMR, 2 – SPM, 3-STPM, 4-Diploma,
5-Bachelor, 6-Masters

Language and wordings of the questionnaire Double-Barreled Questions


- Language should approximate (suitable) to the - Double-barreled question - A question that lends itself to
respondents level. different possible response to its subparts which will
- Use words that the respondent truly and generally confuse the respondent and eventually obtain ambiguous
understand. responses.
 Choice of words should depend on their education  E.g. Do you think that coupling is bad and that that
level, usage of terms and idioms in the culture, and student must avoid this kind of behavior?
the frames of reference of the respondent.  Do you think that coupling is bad (1st question) and
that that student must avoid (2nd question) this
- Do not use word that will let respondent misinterpret kind of behavior?
them into some other meaning.
- Avoid double barreled question. Break up this question
- Hence, the language used and the wordings should be into two so that each question focuses one subject, per
appropriate to tap respondents’ attitude, perceptions, and question.
feelings.
Ambiguous Questions
Type and forms of questions
- Avoid using ambiguous sentences as it will create biases
- Type of question refers to whether the question will be (misinterpretation) which will result in inaccurate answer
open-ended or closed ended. by the respondent.
- Form refers to positively or negatively worded questions.  E.g. “To what extent would you say you are happy?”
– the respondent may think differently from the
researchers intention about happiness.
 E.g. “To what extent would you say you are happy
in your daily life? – this is better as it identify the
scope of happiness felt by the respondent.
Recall-Dependent Questions Classification Data (Personal Information)
- Avoid question that demand respondent to recall his past - Personal Information – age, educational level, marital
experience that are hazy in their memory. status, income etc.
- E.g. During your primary schooldays, do you involved - Avoid asking the name of the respondent unless
yourself in a verbal fight with your classmates? (hazy extremely necessary. This is to ensure anonymity of
memory) respondent.
- E.g. 30 years ago when your started working, what were - Researcher has a choice either to place these personal
your first department and for how long? (this data can be information in the beginning or at the end of the
obtained form the company’s record) questionnaire.
- Question seeking details of income or other highly
Leading Question sensitive information are best placed at the very end of
- Avoid phrasing question the lead the respondent to give the questionnaire.
responses that the researcher would like or want them to - Use range of choices rather than asking a direct
give. figure/fact to prevent respondent avoidance from
- E.g. Many student felt that PTPTN loan were insufficient answering truthfully.
to help ease their financial obligation in university,
therefore these amount must be increased. – (respondent
would be thrilled to answer ‘yes’)
- E.g. To what extent that your agree that PTPTN loan to
university student should be raised? – (this allows
respondent experiencing insufficient loan amount to
answer ‘Strongly Agree’ and those having no problem
answer ‘Strongly Disagree’).

Loaded Questions
- Avoid phrasing question in an emotionally charged
manner.
- E.g. To what extent do you think that management is
likely to be vindictive if the Union decides to go on
strike?

Social Desirability
- Avoid wording question that elicit socially desirable
responses.
- E.g. Do you think that HIV infected person should be
separated from the society?
- E.g. To what extent do think that HIV infected person be
given fair treatment anywhere?

Length of Questions
- Ask simple questions than a too long ones.
- Rule of thumb, a question or a statement in the
questionnaire should not exceed 20 words, or exceed one
full line in print.

Sequencing pf Questions
- The funnel approach.
- Sequence from general to specific question.
 Ask organizational questions and then to
departmental and job related questions.
- From relatively easy to progressively more difficult
questions.
 Ask routine question and then gradually proceed to
more analytical and problem solving questions.
- Do not place contiguously (side by side) a positively
worded and a negatively worded question tapping the
same element or dimension or concept.
 E.g. Learning is the most difficult thing to do.
 E.g. Learning is not the most difficult thing to do.
- Reword them differently and place them distant apart in
the questionnaire.
Topic 11 : Data Collection: Fieldwork
Unstructured interviews
Data Collection: Fieldwork - Interviewer enter the interview setting with an a
unplanned sequence of questions to be asked of the
Sources of Data respondent.
- Data can be obtained from primary or secondary sources. - Used to identify broad problem area (explore and probe)
- Primary data – refers to information obtained firsthand by interviewing all levels of employee (respondent).
by the researcher on the variables of interest for the - Objective is to bring some preliminary issues to the
specific purpose of the study. surface so that the researcher can determine what
- E.g. individuals, focus groups, panel of respondents, variables need further in-depth investigation.
internet questionnaire. - The type and nature of the question asked might vary
- Secondary data – refers to information gathered from according to the job level and type of work done by
sources already processed by other means or existing in them.
records and reports.  Broad and open-ended question were asked to get initial
- E.g. company records or archives, government views about the situation and narrowed down after
publication, industry analysis offered by the media, web getting good responses or commitment by the
sites, Internet etc. respondent.
- Researcher must politely encourage /motivate respondent
Data collection method to answer questions.
- Data can be collected in a variety of ways, in different - Researcher listens carefully and take note or detect
settings, field or lab and from different sources. important messages respondent might convey.
- The choice of data collection methods depend on the
facilities available, the degree of accuracy required, the Structured Interviews
expertise of the researcher, the time span of the study, - Interviews conducted when it is known at the outset
and other associated costs (start) what information is needed.
- Three (3) main data collection in survey research: - Largely used in qualitative research.
Interviews: (Structured and Has the advantage of - Questions developed were obtained from information
Unstructured) flexibility in terms of collected during unstructured interviews.
- Face to face adapting, adopting and
- Question are likely to focus on factor that have surfaced
changing questions as the
- Telephone researcher proceed with the
during unstructured interview which are relevant to the
- Computer assisted problem.
interview.
- Electronic media - The interviewer has a list of predetermined questions to
Questionnaires: Has the advantage of be asked of the respondents either personally, through
obtaining data more telephone, or internet PC.
- Personally administered
efficiently in term of the - Based on respondent’s answers, an experienced
- Sent by mail researcher time, energy and researcher may ask other relevant questions not on the
- Electronically administered costs. interview protocol to identify or reinforce new factors
Observation; Has the advantage of and get deeper understanding of the research variables.
- Individual and events with accuracy of data.
or without videotaping
/audio recording.

Bias in Interviews
- Information gathered during interviews should be as free Topic 12 : Data Processing and Analysis
as possible of bias (errors, inaccuracies in the data).
Preliminary Step Before Data Analysis
- Bias can come from interviewer, interviewee, or the To ensure that we get reasonably good and quality data, four
situation. (4) preliminary steps need to taken before data analysis:
 From Interviewer: 1. Getting data ready for analysis.
- When no trust or rapport not establish with the 2. Getting a feel for the data.
interviewee 3. Testing the goodness of the data.
- When responses either misinterpreted or distorted. 4. Testing the hypotheses.
- When interviewer unintentionally encourage/discourage
certain types of response through gestures and facial
expressions.
 From Interviewee:
- Didn’t give true opinion but provide information they
think what the interviewer like to hear.
- Didn’t understand the question and feel difficult/hesitant
to seek clarification.
- Personal likes and dislikes (dress or interviewer,
manners etc)
- Answer in socially acceptable manner, rather than true
sentiments
Getting Data Ready for Analysis
 From Situation:
- Nonparticipants – unwillingness or inability of the Editing Data
interviewee to participate in the study.
- Data need to be edited after they were collected through,
- Trust levels and rapport established – no sincerity, questionnaires, interview and observation (primary
unsuitable location/place of interview. source) or through secondary sources.
- Insufficient / unavailability of time - Editing should be done preferable the very same day the
- Inconsistency of question/wording among respondent to data are collected so that the respondents can be
respondent. contacted for further information or clarifications to
avoid confusion.
Ways to Minimize Bias - Incoming mail responses should be checked for
- Establish credibility and rapport, and motivating incompleteness and inconsistencies.
individuals to respond. - By scanning through certain question the researcher can
- Question technique - Funneling approach help to complete some related unanswered question.
- Ask unbiased questions – leading, loaded, expression Handling Blank Responses
etc. - Not all respondents answer every item in the
- Clarifying issues – restate or rephrase important questionnaire, probably, because respondent fail to
information given by respondent understand the question, did not know the answer, not
willing to answer, or simply indifferent to the need to
- Help respondent to think through the issues. – ask respond to the entire questionnaire.
question in simpler way, rephrase, respond, remind, or
give examples as guidance. - If 25% and above blank responses, advisable to exclude
this questionnaire and report the number of questionnaire
- Take notes – make written notes while interviewing and being rejected due to excessive missing data in the final
immediately after the interview. Record interview on report submitted to sponsor.
tape if the respondent allows, however this can cause
bias in response. - If few (2-3 items) out of 30 items not answered in an
interval-scaled item with a mid-point would be:
1. Assign mid-point to that particular item missing (most
common), or
2. Allow computer to ignore the blank responses during
data analysis (most common), or
3. Assign to the item the mean value of the responses of all
those who have responded to that particular item, or
4. Give the item the mean of the responses of this particular
respondent to all other questions measuring this variable,
or
5. Give a random number within the range for that scale.
Coding, Categorization and Entering Data Types of Data Measurement
- Please proceed to SPSS in class data analysis workshop. - Please refer to the questionnaire developed by you.
- Have your laptop in ready mode with SPSS software - Identify the measurement in each question of the
installed. questionnaire.
- Make sure you bring along your filled questionnaire  Nominal
form with data collected for your survey project.  Ordinal
 Interval
Data analysis  Scale / ratio

Objectives: Term used in SPSS


Getting a feel for the data. - Data – pieces of organized information about elements
- To get preliminary ideas of how good scales are. in a population. E.g.: color, height, weight, name etc.
- How well the coding and entering data have been done, - Data Set – contains information on people. E.g.:
etc. Detecting coding or data entering error. telephone surveys, questions concerning attitudes,
Testing the goodness of the data, behavior and belief, demographic information etc.
- Submitting data for factor analysis - Case – the individual record being studied e.g. a
person’s height, weight, job, opinion, attitude, responses
- Conducting reliability measures using Cronbach’s alpha
etc.
or split half.
Testing hypotheses developed for the research. - Variables – contain information about each case and
structured in a way that makes one case comparable to
- Conducting statistical test such as Correlation, t-test,
another.
ANNOVA, Chi-Square, Regression.
- Coding – the process of transforming data from original
What is SPSS form into a format that SPSS can read.
SPSS (Statistical Package for Social Science) is a - Eg:
computerized statistical software package used widely in the - Gender : 1 – Male, 2 – Female or
natural and social sciences. It is a user-friendly tool to help
you organize and analyze your data. - Opinion : 1 – Disagree, 2 – Fair, 3 - Agree

Purpose of Using SPSS Layout of SPSS


- To compute and analyze statistical data collected through - SPSS Data Editor window – this screen looks and
 surveys and assessment and operates like spreadsheet programs.
 other primary/secondary sources. - Menu Bar – contains organized paths to the most
- Examples such as published company data, order forms, commonly requested procedures such as opening files,
work order, reservations, bills, invoice etc. performing statistical operations, and constructing
graphs.
Types of variables and measurement - Tool bar – works like the menu and it includes a number
Categorical Variables – of handy devices the refine the analyses.
- Nominal : - e.g. Gender (Male, Female), Race (Malay, - Data View – screen for user to input data codes from
Chinese, Indians), identified sources.
- Ordinal :- e.g. Student level : 1st yr , 2nd yr, 3rd yr, - Variable View – screen for user to construct variables
Size : small, medium, large. Behavioral: Strongly Agree, (data formats and measurement)
Agree Fair, Disagree, Strongly Disagree
Numerical Variables (Scale) – Data Coding
- Count (whole number) :- e.g. Number of subjects student - Data Coding in (Variable View)
takes per semester: 5 to 7 classes but not 5.5 classes. - Now its your turn to construct the code for every
- Continuous (Interval/scale/ratio) - e.g. height, age, question in the questionnaire into the SPSS software.
weight, temperature, lengths, mileage, speed, years of - Once finished….. click save….
education…… contains decimal points. E.g. : 30.45 oC,
12.5 km, 14 ½ yrs Data Cleaning
Select (3 - RFC Data Clean. sav) file >> Double click to
Data/Variables launch the file.
- Reason: Error in keying in data e.g. wrong coding, no
entry, no response (blank entry).
- To perform data cleaning go to (Data View)
Analyze
Descriptive Statistics
Frequencies...>> (select all variables ‘Ctrl A’ on the left
side and place in the variable box on the right).
Click OK
- Look for strange data codes and abnormalities in every
frequency tables
- Record separately all error codes found question by
question

Searching and Correcting Error Data Entry


- Click to select the top column variable to be searched
- To find data for cleansing
Edit
Find>>> (type the error code that need to be corrected)
- Review questionnaire id number and make
corrections….replace the wrong codes with the correct
ones.
- For this exercise use code number ‘4’ to replace all error
codes.
- 15 min.
- Once finished click >> save
- Run frequency analysis again to verify entries.
- Exit

Cronbach’s Alpha Reliability Testing


- Reliability coefficient that indicates how well the items
in a set are positively correlated to one another

Reliability Test
- Reason: To identify the stability and consistency of
variables (questions) and its measurement used in the
questionnaire.
- Applicable for Ordinal and Scale/Interval/Ratio data of
identical measurement only.
- To perform data recoding go to (Variable/Data View)
Analyze
Scale
Reliability Analysis...>> (scroll all variables with
identical measurement on the left side and place in the
Items: box on the right).
….follow lecturer’s guide ………. Click OK
- Try testing other variables
- 10 mins

You might also like