Data Collection

Action Research Workshop

July 25, 2006
Prepared by Margarida Southard, Ph.D
Data Collection
„ This section will help you to
determine what data is needed and
how to develop a data collection
plan for your action research.
Three Important Qualities

„ Validity

„ Reliability

„ Generalizability
Triangulation
„ Collect data from more
than one source, at
more than one point in
time.
„ Using three sources of
data to paint a picture
about whatever you are
studying is called
triangulation.
Steps in Data Collection
„ Determine what data is needed

„ Select data sources and/or

techniques for gathering data

„ Identify key performance

targets (dependent variable)

„ Develop data collection plan

 Key questions for selecting
data sources
„ Does it suit the research question you
have in mind?
„ Can you afford the time to gather,
record, and reflect using this technique?
„ Will a different source provide more
appropriate data?
„ Will the data be available on time?
 DATA SOURCES
Attendance rates
Weekly assessments
Tests, quizzes, homework
Observational notes
Rubrics/scales/checklists
Student, staff, parent surveys
Discipline incidents
Focus Group findings
Report card/Grade Book
Lesson Plans
Interviews
Student participation rates
Performance assessment results
Student’ portfolio of daily work
Student projects
Referral Rates
Diaries/journal
Logs (meetings, excursion).
Photography/Videotape
Time-on-task analysis
 Rating Scales/Rubrics
„ Checklists: To indicate the absence or
presence of a particular behavior or
product.
„ Numerical Scale: The rater uses a
numerical scale, such as 1 to 5 to judge
specific traits of a performance, process,
or program.
 Rating Scale/Rubrics
„ Qualitative Scale: Rely on description
rather than numbers to interpret
performance of a student. These scales
vary from a single word summary to
detailed categorical descriptions.

Example: Poor, Acceptable, Good,

Excellent
Achievement Tests
„ Norm-referenced tests (FCAT NRT,
SAT/10).
„ Criterion-referenced tests (FCAT SSS,
Writes Upon Request).
„ Tests developed by teachers.
„ Tests developed by publishers
(Compass, Success Pearson, STAR,
Accelerated Reader, DIBELS).
Written Surveys
„ Favorite data-gathering technique
for action research.

„ Used to collect information to

describe, compare, and explain
knowledge, attitudes, perceptions
or behavior.
Survey Questions
You must ask questions that are:

„ valid and reliable

„ understandable
„ quick to complete
„ able to get the first response from the
respondent
„ Consider disaggregation and confidentiality
issues
Surveys: Helpful hints in
Developing the Questions

„ Remember your survey’s purpose

„ Keep your questions simple

„ Place easy items at the beginning

„ Difficult items in the middle

„ Sensitive items in the middle

„ Avoid leading questions

More on writing good survey
questions ..
„ Avoid double barreled items (items
with two questions in one item)
„ Avoid jargon or complex words

„ Consider using open questions

„ Consider a “Don’t Know” response

„ Provide a meaningful scale

Some Bad Items and
Interesting Responses
„ Where were you born? In a
hospital
„ Are you a natural born citizen
of the U.S? no cesarean
„ What was your length of
residence in your hometown?
about 40 feet
„ Would you use a bathroom
sanitizer? Yes we need sanity
in the bathroom
 Interviews
Advantages over questionnaires
„ Permits greater depth.

„ Permits probing.

„ Make it possible to establish

rapport.
„ Appropriate for children.

Disadvantages
Time consuming and expensive.
Focus Group
„ Focus group is a prompted discussion
that provides a method of data-
collection in which ten to twelve
participants gather together to discuss
issues with which they are familiar.

„ Advantage of focus groups over

one-to-one interviews
Sampling
„ Process by which subjects/cases are selected
for study.

„ Involves selecting small group (sample) of

cases from a large group of cases
(population).

„ One way to insure that the sample will be

representative of the larger population is to
draw a random sample.
Preparing the Data Collection
Plan: The 6 W’s
„ WHY are we collecting this data?
„ WHAT exactly are we collecting?
„ WHO are the subjects?
„ WHERE will we collect the data?
„ WHEN are we going to collect?
„ WHO is going to collect?