Professional Documents
Culture Documents
PED323A MIDTERM Reviewer
PED323A MIDTERM Reviewer
Sample
- A sample can be defined as a group of a
relatively smaller number of people selected
from a population for investigation
purposes.
- The members of the sample are called as
participants.
Sampling and its Purpose
- The process through which a sample is
extracted from a population is called
- Although philosophical ideas remain largely sampling.
hidden in research (Slife & Williams, 1995), - In investigation it is impossible to assess
they still influence the practice of research every single element of a population so a
and need to be identified. group of people (smaller in number than the
population) is selected for the assessment.
SAMPLING TECHNIQUES - The more the sample is representative of
the population, the higher the accuracy of
Population the inferences and the better the results
- Target population refers to all the members generalizable.
who meet the particular criterion specified - A sample is said to be representative when
for a research investigation. the characteristics of the elements selected
- For example a population of schools in are similar to those of the entire target
Canada means all the schools built under population.
the boundary of the country. - The results are said to be generalizable
- A population of OCD means all the people when the findings obtained from sample are
have a clinical diagnosis of the disorder. equally true for the entire target population.
- The sampling process may encounter the - The sample is selected from each stratum
problem of systematic errors and sampling randomly.
biases. - Common criteria used for stratification are
- Systematic errors can be defined as gender, age, ethnicity, and socioeconomic
incorrect or false representations of the status.
sample. 4. Cluster Sampling
- Sampling bias is said to occur when the - The group of elements residing in one
selected sample does not truly reflect the geographical region is called as cluster.
characteristics of the population. - And sampling of clusters is called cluster
sampling.
TYPES OF SAMPLING - This sampling technique is used when the
Probability Sampling Methods elements of the population are spread over a
- Some form of random selection is used. wide geographical area.
Non-Probability Sampling Methods - For instance, the population spread over a
- Probability sampling is also called a country is clustered up into cities, the
judgment or non-random sampling. population spread over a city is clustered up
- Every unit of the population does not get an into towns etc.
equal chance to participate in the 5. Multistage Sampling
investigation. - It is a sampling technique where two or more
- The selection of the sample is made based probability techniques are combined.
on subjective judgment of the investigator.
VARIOUS TYPES OF NON-PROBABILITY
VARIOUS TYPES OF PROBABILITY SAMPLING METHOD
SAMPLING METHOD 1. Volunteer Sampling
1. Simple Random Sampling - The members of the sample self-select
- In this type of sampling each element of the themselves to be part of the study.
population has an equal chance of being 2. Convenient Sampling
selected in the sample. - The researcher includes those participants who
2. Systematic Random Sampling are easy or convenient to approach.
- Unlike simple random sampling, there is not - The technique is useful where the target
an equal probability of every element being population is defined in terms of a very broad
included. category.
- In this type of sampling the elements are 3. Purposive Sampling
selected at a regular interval. - In purposive sampling, the sample is approached
- The interval may be in terms of time, space, having a prior purpose in mind.
or order. - The criteria of the elements who are to include in
- For instance, an element appearing after the study is predefined.
every 30 minutes, or present at a distance of 4. Quota Sampling
two meters, or every 5th element present on a - This type of sampling method is used when
list. population is heterogeneous i.e. every element of
3. Stratified Random Sampling population does not matches all the characteristics
- This type of sampling method is used when of the predefined criteria.
the population is heterogeneous. i.e. every - The participants are selected non-randomly from
element of the population does not match all each sub group on the basis of some fixed quota.
the characteristics of the predefined criteria. 5. Snowball Sampling
- So, the sub-groups are formed that are - It is also called chain sampling.
homogenous i.e. all the elements within a - One element of the population is approached at
group contain the same kind of characteristics. a time and then is asked to refer the investigator to
- The sub groups are called as strata (single the other elements of the population.
stratum). 6. Matched Sampling
- This technique is used in experimental research. - In education and the social sciences,
- The main purpose of this sampling is to take a quantitative research frequently involves
control group to assess the effects of an using various instruments or tools to collect
intervention. and analyze data.
- Two groups of elements that resemble a variety - Surveys, questionnaires, tests, and
of variables are selected observations are examples of such
- Intervention is introduced in only one group. instruments (Bryman, 2016; Creswell &
- The other group is used to compare with the first Creswell, 2018; Fraenkel et al., 2018;
one to see what impacts the intervention Leedy & Ormrod, 2016).
produced. - Researchers can look through academic
and commercial databases to check if an
DATA INSTRUMENTATION appropriate instrument is available.
- Instrumentation refers to the tools, - However, before utilizing an instrument in a
methods, or procedures used to collect data research project, it must be validated and
in research (Babbie, 2016; Creswell, 2014; evaluated for reliability and validity.
Johnson & Christensen, 2014; Neuman, - Additionally, permission from the original
2013). authors or copyright holders may be
- In quantitative research, instrumentation required before the researchers utilize the
is a critical aspect of the research process, instrument.
as it directly affects the validity and - If it is determined that no instruments exist
reliability of the data collected. that accurately measure the variables in a
study, there are several stages for
CHARACTERISTICS OF A GOOD constructing an instrument that accurately
RESEARCH INSTRUMENT measures the variables of interest –
- Valid and reliable planning, construction, and evaluation
- Based on a conceptual framework, or the (Creswell, 2014; DeVellis, 2017; Streiner et
researcher's understanding of how the al., 2014).
particular variables in the study connect PLANNING
with each other. - ✓During the planning stage, researchers
- Must gather data suitable for and relevant must define the construct(s) or variable(s)
to the research topic. of interest and develop a conceptual
- Able to test hypothesis and/or answer framework that outlines how the variables
proposed research questions under are related to each other (DeVellis, 2017;
investigation. Hair et al., 2014).
- Free of bias and appropriate for the context, - They should also consider the type of data
culture, and diversity of the study site. that needs to be collected, such as nominal,
- Contains clear and definite instructions to ordinal, interval, or ratio, and choose the
use the instrument. most appropriate measurement methods for
QUANTITATIVE DATA INSTRUMENTATION each variable.
- Using inappropriate or poorly designed CONSTRUCTION
instruments can result in inaccurate or - ✓ In the construction stage, researchers
unreliable data, compromising the quality of develop the instrument and conduct a pilot
the research findings and limiting the study to evaluate its psychometric
research’s usefulness. properties (Dillman et al., 2014; Fowler,
- The choice of research instrument depends 2013).
on the research question, the nature of the - This includes assessing the reliability and
phenomenon being studied, and the validity of the instrument.
available resources (Bryman, 2016; - Reliability refers to the consistency of the
Creswell, 2014; Dörnyei, 2007; Hair et al., instrument’s measurements, while validity
2014). refers to “the extent to which the instrument
measures what it is intended to measure” procedure. Rather than writing a detailed
(Heale & Twycross, 2015; Leedy & Ormrod, description of all behaviors observed,
2016). researchers code observed behaviors
- Pilot testing may involve administering the according to a previously agreed upon
instrument to a small sample of participants scale.
and analyzing the data to identify potential Naturalistic Observation: The study the
problems with the instrument’s items or spontaneous behavior of participants in
response options. natural surroundings. The researcher
EVALUATION simply records what they see in whatever
- This includes assessing the instrument’s way they see it.
internal consistency, which measures the Participant Observation: A variation on
degree to which the items on the instrument natural observations where the researcher
are interrelated, and its construct validity, joins in and becomes part of the group they
which measures the extent to which the are studying to get a deeper insight into
instrument measures the intended their lives.
construct(s) or variable(s).
AVOID INSTRUMENTATION BIAS
QUALITATIVE DATA INSTRUMENTATION - Researchers can further minimize bias in
- Interviews or the interaction where verbal their surveys or questionnaires and ensure
questions are posed by an interviewer to that the data collected is accurate and
elicit verbal responses from an interviewee. unbiased.
- Structured Interview - Use clear and concise language: Employ
A formal set of questions posed to each easy-to-understand language and avoid
interviewee and recorded using a technical jargon or complicated terms
standardized procedure. (Dillman et al., 2014). This will help ensure
- Unstructured Interview that participants can understand the
A less formal set of questions; the questions and respond accurately.
interviewer modifies the sequence and - Avoid leading or loaded questions: Avoid
wording of questions. questions designed to elicit a specific
- Non-Directive Interview response or bias the participant’s answer
An unguided interview, including open- (Diersch & Walther, 2016). For example,
ended questions and the use of instead of asking, “Don’t you think that
spontaneous engagement. education is important?”, ask, “How
- Focus Interview important do you think education is?”.
An emphasis on the interviewee's - Use various question types: Use various
subjective and personal responses where question types, such as multiple-choice,
the interviewer engages to elicit more Likert scale, or openended questions, to
information. reduce response bias (Dillman et al., 2014).
- Focus Group Interview This will help ensure that participants can
A group of selected participants are asked express their opinions or thoughts most
about their opinions or perceptions comfortably and accurately.
concerning a particular topic. - Avoid social desirability bias: Social
- Observation desirability bias is when participants
(watching what people do) is a type of respond in a socially acceptable or
correlational (non-experimental) method desirable way rather than providing their
where researchers observe ongoing true opinions or experiences (Tourangeau &
behavior. Yan, 2007). To avoid this, reassure
Structured Observations: Research participants that their responses are
conducted at a specific place, time, where confidential and anonymous, and avoid
participants are observed in a standardized
asking questions that may elicit socially - The experts review the research
desirable responses. instrumentation for clarity, completeness,
- Pilot-test the survey or questionnaire: and relevance to the research question and
Pilot-test the survey or questionnaire with a may also provide feedback on the format
small sample of participants to identify any and structure of the instrument.
issues or areas of potential bias (Dillman et - If the research instrument is a test designed
al., 2014), regardless of whether it is to measure reading comprehension in
adopted or adapted [modified] from elementary school students, it would be
previously published scholarly publications validated by experts in reading instruction,
or developed by the researcher. This will such as literacy coaches or reading
allow the researcher to make any specialists.
necessary modifications before
administering the survey or questionnaire to TOOLS
a larger sample. - Informed Consent
- Consider cultural or linguistic - Content Validity: Validation/ Confirmability
differences: when designing the survey or Tool
questionnaire. Make sure that the questions - Reliability Analysis (for quantitative)
are appropriate and relevant for the - Consolidated Comments of the Experts
population being studied, and consider VALIDATION OF INSTRUMENTS
translating the survey or questionnaire into - Face Validity
different languages if necessary. - Content Validity
- Monitor for bias: Continuously monitor for Face Validity
bias throughout the instrument’s planning, - Face validity, rather than a true
construction, and validation. psychometrician assessment technique,
Note: When conducting research, it is nearly has been defined as validity conferred by
difficult to eliminate biases that can potentially the lay person’s acceptance.
influence the data and, consequently, the - It also includes validity by assumption and
findings reached. Good researchers display validity by definition.
integrity by recognizing that biases may have - It is not quantifiable.
influenced their findings. In survey research, for Content Validity
example, the percentages of those who - Content validity is the determination of the
consented and refused to participate, such as content representativeness or content
those who agreed and refused to be relevance of the items of an instrument by
interviewed or those who did not return the application of two-stage process.
questionnaires, should always be mentioned
(Leedy & Ormrod, 2016). Upon completing
their study, the researchers must indicate such
concerns in the limitations section.
EXPERT VALIDATION
- Validation of research instruments in
educational research is performed by
For individual items (Item-CVI):
experts (academics, practitioners, or
▪ This formula is used to assess the agreement
professionals) in the field of education or
among experts on the relevance (I-CVI(R)) or
the specific topic area being studied
clarity (I-CVI(C)) of each item in the instrument.
(Beaton et al.,2000; DeVellis, 2017; Streiner
▪ I-CVI = Nr / N
et al., 2014).
Where:
- This helps ensure that the results obtained
* Nr is the number of experts who rated the
using the instrument are accurate and
item as relevant/clear (typically a score of 3 or
reliable.
4 on a 4-point scale).
* N is the total number of experts involved in
the content validity assessment.
DATA COLLECTION
- Data collection is the process of gathering
and measuring information on variables
of interest, in an established systematic
fashion that enables one to answer stated
research questions, test hypotheses, and
evaluate outcomes.
IMPORTANCE!
- Regardless of the field of study or
preference for defining data (quantitative,
qualitative), accurate data collection is
essential to maintaining the integrity of
research.
- Consequences from improperly collected
data include:
-inability to answer research questions
accurately.
-inability to repeat and validate the study.
-distorted findings resulting in wasted
resources.
-misleading other researchers to pursue
fruitless avenues of investigation.
-compromising decisions for public policy.
-causing harm to human participants and
animal subjects.
DIFFERENT DATA COLLECTION METHODS
1. Primary Data Collection
- direct interaction with the respondents. (e.g.
surveys and questionnaires, interviews,
observations, experiments, and focus groups.)
2. Secondary Data Collection
- using existing data collected by someone else for
a purpose different from the original intent. (e.g.
published sources, online databases, government
and institutional records, publicly available data,
past research studies).