EUGELIO "AMANG" RODRIGUEZ INSTITUTE OF SCIENCE AND TECHNOLOGY

Nagtahan St. Sampaloc, Manila

GRADUATE SCHOOL

METHODOLOGY OF
RESEARCH
FS 102

DR. MARGIE R. ATIZARDO

DISCUSSANT PROFESSOR
TOPIC:
VALIDITY AND
RELIABILITY OF A
RESEARCH
5.5 Triangulation
5.6 Reliability
5.7 Reliability in
Quantitative Research and
Qualitative Research
5.8 Validity and Reliability
in Interviews, Experiments,
Questionnaires,
Observations, Test, Life
Histories and Case Studies.
TRIANGULATION
It is the application and combination of several research methodologies in the
study of the same phenomenon

• Can be quantitative and qualitative studies

• It is a method appropriate strategy of enhancing the credibility of
qualitative analysis.
• Also an alternative to traditional criteria like reliability and validity
TRIANGULATION
Triangulation in research means using multiple datasets,
methods, theories, and/or investigators to address a
research question.

It’s a research strategy that can help you enhance the validity and
credibility of our findings and mitigate the presence of any
research biases in your work.
TRIANGULATION
It is the method used to increase the credibility and validity of a research
findings

Credibility refers to trustworthiness and how believable a study is;

Validity is concerned with the extent to which a study accurately

reflects or evaluates the concept or ideas being investigated.
TRIANGULATION
Triangulation is mainly used in qualitative research, but it’s also
commonly applied in quantitative research.

If you decide on mixed methods research, you’ll always use

methodological triangulation.
TRIANGULATION
Triangulation in different types of research
 Qualitative research: We conduct in-depth interviews with
different groups of stakeholders, such as parents, teachers, and
children.
 Quantitative research: We run an eye-tracking experiment and
involve three researchers in analyzing the data.
 Mixed methods research: We conduct a quantitative survey,
followed by a few (qualitative) structured interviews.
TRIANGULATION
Types of triangulation in research

1. Data triangulation
2. Investigator triangulation
3. Theory triangulation
4. Methodological triangulation
TRIANGULATION
Data Triangulation
Data triangulation involves collecting data from multiple sources or using
multiple methods to collect data.
This allows for a more complete picture of the phenomenon being studied.

Data triangulation is the process of using multiple data sources to

corroborate or refute findings. This allows for a more holistic understanding
of the evidence, and can help to identify problems or inconsistencies in the
data.
Data triangulation is a valuable tool for research, as it allows for a more
comprehensive understanding of the evidence. However, it is important to
ensure that the data sources are reliable and that the findings are
consistent across all sources.
TRIANGULATION
Investigator Triangulation

In research, investigator triangulation is the use of multiple

researchers to collect and analyze data. This approach is used to
increase the validity and reliability of findings.
Two or more researchers looking at the same phenomenon from
various study perspectives.
Benefits of Investigator Triangulation
There are several benefits to using investigator triangulation.
• First, it allows for different perspectives to be considered when
analyzing data.
• Second, it can help identify errors in data collection or
interpretation.
• Third, it can provide a check on the biases of individual
researchers.
TRIANGULATION
Investigator triangulation can be used in a variety of research
contexts, including qualitative and quantitative studies.
In some cases, investigators may work independently but share their
data with each other for analysis. In other cases, investigators may
work together from start to finish on a research project.
Investigators should take care to ensure that
their data are compatible.
their analysis methods are complementary.
TRIANGULATION
Theory Triangulation

Theoretical triangulation involves using multiple theories to explain

a phenomenon. This can help to identify gaps in current knowledge
and create new ways of understanding the phenomenon.
Theoretical triangulation is the use of multiple theoretical
perspectives to analyze data.
TRIANGULATION
Theory Triangulation
This approach can be used in qualitative or quantitative research, and it
has a number of advantages.
One advantage of theoretical triangulation is that it can help researchers
to understand complex phenomena. By using multiple theories,
researchers can develop a more nuanced understanding of the issues
under study.
Another advantage of this approach is that it can help to reduce bias in
research findings. By considering data from multiple perspectives,
researchers can avoid coming to premature conclusions based on one
theory or perspective.
TRIANGULATION
Theory Triangulation

Finally, theoretical triangulation can also help to build consensus

among researchers who may have different theoretical orientations.
By considering data from multiple perspectives, researchers can
arrive at a shared understanding of the phenomenon under study.
TRIANGULATION
Methodological Triangulation
Methodological triangulation involves using multiple methods to
study the same phenomenon. This can provide different
perspectives on the phenomenon and help to validate findings.
Methodological triangulation is a research methodology that uses
multiple methods to examine a phenomenon. This methodology can
be used to increase the validity and reliability of research findings.
Methodological triangulation can be used to investigate a variety of
research questions.
Benefits of Methodological
Triangulation
There are several reasons why methodological triangulation
may be used.
 First, it can help to confirm or disconfirm results from a single
method.
 Second, it can provide insights that would not be possible
with just one method.
 And third, it can help to build trust in the findings, by
providing multiple lines of evidence.
TRIANGULATION

There are several ways to achieve methodological

triangulation.

 One is to use multiple data sources, such as surveys and

interviews.
 Another is to use different methods of data collection, such
as observation and document analysis.
What is the purpose of Triangulation?
Pros and Cons in Triangular Research
Pros in Triangular Research
 It allows for the collection of data from multiple sources. This
can be helpful in providing a more complete picture of the
research topic.
 It can help to verify results. If data from two different sources
match up, this lends credibility to the findings.
 It can help ensure that findings are not due to chance or error.
 It can provide a more complete picture of the phenomenon
being studied.
 It can increase the credibility of findings by providing
converging evidence from different sources.
Pros and Cons in Triangular Research
Cons in Triangular Research
Despite above benefits, triangulation is not without its critics. There
are also some cons associated with triangulation. Some argue that it
can be time-consuming and expensive, and that it can lead to
confusing and contradictory results. Others argue that it is not always
necessary, and that researchers should focus on using the best
methodology for their particular study.
• time-consuming to collect data from multiple sources
• requires access to different types of resources, which may not
always be available.
• can sometimes be seen as unnecessary if results from one source
are considered to be reliable.
When to use triangulation ?
What is research reliability?
Research reliability refers to whether research methods can
reproduce the same results multiple times. If our research
methods can produce consistent results, then the methods are
likely reliable and not influenced by external factors. This valuable
information can help us determine if our research methods are
accurately gathering data we can use to support the following
work in our field:
 Studies
 Reviews
 Experiments
RELIABILITY
 Is an umbrella term for dependability, consistency and
replicability over time, over instruments and over groups of
respondents.
 Can we believe the result?
 Can we trust the results?
 Is concerned with precision and accuracy
 Is concerned with consistency
How do we assess reliability in
research?

 Using the same test on different groups of

people
 Using different tests on the same group of
people.
4 Ways to assess
reliability in research
1. Test-retest reliability
 involves giving a group of people the same test more
than once.
 If the results of the test are similar each time we give it
to the sample group, that shows our research method is
likely reliable and not influenced by external factors.
2. Parallel forms reliability
 This strategy involves giving the same group of people
multiple types of tests to determine if the results stay the
same when using different research methods. If they do,
this means the methods are likely reliable because,
otherwise, the participants in the sample group may behave
differently and change the results.
3. Inter-rater reliability
The inter-rater reliability testing involves multiple researchers
assessing a sample group and comparing their results. This can
help them avoid influencing factors related to the assessor,
including:
 Personal bias
 Mood
 Human error
4. Internal consistency reliability
Checking for internal consistency in research
involves making sure your internal research
methods or parts of research methods deliver
the same results. There are two typical ways to
make this determination:
4. Internal consistency reliability
a.) Split-half reliability test: You can perform this test
by splitting a research method, like a survey or test, in
half, delivering both halves separately to a sample
group, then comparing the results to ensure the
method can produce consistent results. If the results
are consistent, then the results of the research method
are likely reliable.
4. Internal consistency reliability
b. ) Inter-item reliability test: With this assessment,
you administer sample groups multiple testing items,
like with parallel forms reliability testing, and calculate
the correlation between the results of each of the
method results. With this information, you calculate
the average and use the number to determine if the
results are reliable.
Reliability vs. validity in research
Reliability and validity can both help researchers assess
the quality of a project. While similar, these two concepts
measure slightly different things:
Reliability: Reliability measures the consistency of a set of
research measures.
Validity: Validity focuses on the accuracy of a set of
research measures.
Reliability vs. validity in research
Reliability and validity can both help researchers assess
the quality of a project. While similar, these two concepts
measure slightly different things:
Reliability: Reliability measures the consistency of a set of
research measures.
Validity: Validity focuses on the accuracy of a set of
research measures.
DIFFERENCE BETWEEN
QUALITATIVE METHOD
AND QUANTITATIVE
METHOD
QUALITATIVE METHOD QUANTITATIVE METHOD
 (Numerical Data) used to measure  (Opinion) finding-out what people
how many people feel, think or think and feel. It seeks to
act in a particular way. Collected understand an individual
through surveys and consumer’s action and
questionnaires-closed questions. motivation.
 Must convince the reader that  Provides the reader with a
procedures have been followed depiction in enough detail to
faithfully because vey little show that the author’s
concrete description of what conclusion…..make sense
anyone does provided.
QUALITATIVE METHOD
• Methods includes focus groups, in • Surveys
depth interviews and reviews
• Primary inductive process used to
formulate theory
• More subjective: describes a
problem or condition from the
point of view of those
experiencing it
• Text-based
QUANTITATIVE METHOD
• Primarily deductive process used
to test pre-specified concepts,
constructs, and hypotheses that
make up a theory
• More objective: provides
observed effects (interpreted by
researchers) of a program on a
problem or condition
• Number-based
QUALITATIVE METHOD
• More in depth-information on a
few cases.
• Unstructured or semi-structured
response options
• No statistical tests
• Can be valid and reliable: largely
depends on skill and rigor of the
researcher
QUANTITATIVE METHOD
• Less in-depths but more breadth
of information across a large
number of cases.
• Fixed response options
• Statistical tests are used for
analysis
• Can be valid and reliable: largely
depends on the measurement
device or instrument used
QUALITATIVE METHOD
• Time expenditure lighter on the
planning end and heavier during
the analysis phase.
• Less generalizable
QUANTITATIVE METHOD
• Time expenditure heavier on the
planning phase and lighter on the
analysis phase
• More geberalizable
Validity and Reliability
in Interviews, Experiments,
Questionnaires, Observations,
Test, Life Histories and Case Studies.
 Valid = real thoughts, feelings, and behaviour.

If a researcher is observing natural behaviour,

Reliable = repeatable. asking opinions, or conducts their experiment in
a natural setting, it would be considered valid.
If another researcher did the same
experiment and got similar/same results it
would be reliable.
So why is reliability and validity so important?

If research is going to be of any use, the results can’t just be a fluke. We expect that if we
repeated a study, we could get the same results.

Research needs to be reliable.

RELIABLE: concerns the consistency of a measurement. Every time a thing is

measured the result should be the same.

We also expect that the study actually represent what people do in their everyday lives, not
just in a laboratory.

Research needs to be valid.

VALIDITY: concerns whether a result is ‘true’. Valid research represents something

that is real. We want the study to represent everyday life.
 Reliability
Some important information about reliability:
Reliable = repeatable. If you can repeat something and get the same or similar results, you
could say that it is reliable. It is consistent across time.
Experiments – Lab experiments tend to be the most reliable because you can control your
variables and standardise procedures.
Interviews & Questionnaires – If the same person answers same questions in the same
way then it would be reliable.
Observations – Observers watches the same people at the same time and get the
same/similar results. (We will look at this in more detail). (Interobserver reliability)

Quantitative methods (data in numbers) tends to be more reliable than qualitative methods
(data in words).
References
https://mimlearnovate.com/triangulation-research/amp/#Exa
mple-3
https://www.indeed.com/career-advice/career-development/r
eliability-in-research
References
ites.education.miami.edu/statsu/2020/09/22/how-is-
reliability-and-validity-realized-in-qualitative-research/
#:~:text=Reliability%20in%20qualitative%20research
%20refers,terms%20than%20in%20q
validity/https://ebn.bmj.com/content/18/3/66
ites.education.miami.edu/statsu/2020/09/22/how-is-

reliability-and-validity-realized-in-qualitative-research/
#:~:text=Reliability%20in%20qualitative%20research
%20refers,terms%20than%20in%20q
Thank you for
listening…….