HOW TO CRITIQUE AN ARTICLE?

Our group is tasked to critique a research study using TIME-SERIES ANALYSIS.

What is a time series analysis?
 It is a statistical methodology appropriate for longitudinal research design that
involved single subject or research units that are measured repeatedly at
regular intervals over time.

INTRODUCTION:

 The title of our chosen article is TIME-SERIES ANALYSIS: ASSESSING THE

EFFECTS OF MULTIPLE EDUCATIONAL INTERVENTIONS IN A SMALL
ENROLLMENT COURSE. This is authored by Aaron R. Warren

 THE CORE IDEA OF THE AUTHOR:

This study is an alternative to pretest-posttest methods. It uses the

Time-series analysis particularly ARIMA to test for and measure
changes in each series. In particular, it seeks to answer the following
questions:
1. How can we identify and measure the effects of specific
interventions (lectures, labs, homework, assignment) on student’s
performance in a small number environment?
2. How can we determine whether the effects of specific interventions
vary according to some intrinsic factors such as students’ gender or
major?

CRITIQUE:

 Strong Points:

1. We learned that there is another way of having pretest-posttest method. It

is a unique design wherein having small respondents could be possible.
It’s really an eye-opener to us.

2. This study would provide a powerful feedback mechanism for the

improvement of instruction for a certain course.

3. The model presented in the study underwent a diagnostic to determine its

suitability. It assesses the benefits of improving the goodness of fit versus
the cost of adding additional parameters.

 Weak Points

1. Though the study exquisitely describes the results of the different forecast,
shifts and confidence ranges; it failed to identify the reasons of
 interferences in each figure. It requires a qualitative study in determining
the underlying interference and to propose ways to minimize it.
2. This study offers an idea with the given results but not tangible enough to
establish a certain fact. It needs another study to employ justifications.

CONCLUSION:

ARIMA time-series analysis provides a method for detecting and measuring

the effects of multiple educational interventions, even in small-enrollment courses
where standard study designs are impossible. Although performance decays are
removed by practice effects, peaks and interferences can be observed. Moreover,
cluster analysis can also be employed to test whether factors intrinsic to the students
modulate the effects of specific interventions