Questions and Answers About The Redesign: Bureau of Justice Statistics

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

Bureau of Justice Statistics

National Crime Victimization Survey

Questions and Answers about the Redesign


The National Crime Victimization Survey (NCVS) extensive, detailed cues to help respondents
is one of two Justice Department measures of recall and report incidents. These new questions
crime in the United States. A pioneering effort and cues jog memories of the respondents and
when it was begun in 1972, the survey was in- let them know that the survey is interested in a
tended to complement what is known about crime broad spectrum of incidents, not just those involv-
from the FBI's annual compilation of information ing weapons, severe violence, or strangers. Be-
reported to law enforcement agencies. The sur- cause of these changes, substantial increases
vey provides a detailed picture of crime incidents, occur in the extent to which victims tell the inter-
victims, and trends from the victim's perspective. viewers about simple assault (defined as assault
This year the survey results will reflect major without a weapon, resulting in minor injury) and
improvements in the methods used to measure sexual crimes.
victimization. These changes are the product of:
a decade-long technical review and testing of Domestic violence
the survey's design
Multiple questions and cues on crimes committed
consultation with criminal justice experts and vic-
by family members, intimates, and acquaintances
tim advocacy groups on the survey's content and
have been added. The survey also encourages
procedures.
respondents to report incidents even if they are
not sure whether a crime has been committed.
Among the most important changes to the ques-
The survey staff review these reported incidents
tionnaire were:
using standardized definitions of crimes. Thus,
additional cues to help survey participants recall within the categories of violent crime measured by
incidents the NCVS, the redesign will produce fuller report-
questions encouraging respondents to report ing of those incidents that involved intimates or
victimizations that they themselves may not define other family members. An upcoming BJS Special
as crimes Report will highlight these new domestic
more direct questions on rape, sexual assault, violence data.
and other sexual crimes
new material to measure victimizations by non- Sexual crimes
strangers, including domestic violence.
The new NCVS broadens the scope of covered
sexual incidents beyond the categories of rape
These improvements result in more complete re-
and attempted rape. These include:
porting of the number and nature of victimizations,
particularly for the crimes of simple assault, rape, sexual assault (other than rape)
and other sexual assault. At the same time, an- verbal threats of rape or sexual assault
nual data collected with the redesigned question- unwanted sexual contact without force but in-
naire indicate that year-to-year trends continue volving threats or other harm to the victim.
relatively unchanged: little change in violent crime
and a slight decline in property crime. These new categories, broadened coverage, and
more extensive questions on sexual victimizations
Major redesign changes have elicited information on about 3 to 4 times as
many sexual crime victimizations as in the past.
All crimes
Following are questions and answers on the char-
A new screening questionnaire (to determine acteristics of the National Crime Victimization Sur-
whether the respondent has been the victim of vey and on why and how it was redesigned.
any crime within the scope of the survey) uses

October 30, 1994 NCJ-151171


Background
How does the Federal Government measure Property
crime? burglary
theft
The U.S. Department of Justice administers two
national-level data series: motor vehicle theft.
the Uniform Crime Reports (UCR), begun in
In addition to estimating the number of victimiza-
1929 and administered by the Federal Bureau of
tions, the NCVS gathers details on each incident.
Investigation
These include:
the National Crime Victimization Survey, admin-
the month, time, and location of the crime
istered by the Bureau of Justice Statistics. NCVS
data were first published in 1973. the relationship between victim and offender
characteristics of the offender
These data series gather crime data from different self-protective actions taken by the victim during
sources. The UCR is based on crimes reported to an incident and results of those actions
State and local law enforcement agencies. The
consequences of the victimization, including any
NCVS is based on a household survey of individu-
injury or property loss
als' experiences with crime victimization, whether
or not the incidents were reported to police. The whether the crime was reported to police and
NCVS consistently shows victimization levels reasons for reporting or not reporting
higher than the those of the UCR. Besides that offender use of weapons, drugs, and alcohol.
missing information, the NCVS provides more
detail from the victim's perspective, as a comple- Whom does the NCVS interview?
ment to UCR information. The UCR program is
being expanded through the National Incident- The survey collects its data from a nationally re-
Based Reporting System, which collects more presentative sample of individuals age 12 or older
detail about arrestees and police responses than living in U. S. households. Basic demographic in-
does the NCVS. formation, such as age, race, sex, and income, is
collected to enable analysis of victimizations of
What is the National Crime Victimization various subpopulations. Interviews are translated
Survey? for non-English speaking respondents. The NCVS
does not cover individuals living in institutions.
The NCVS is the Nation's second-largest ongoing
household survey. It collects victimization data How are survey participants selected?
from a nationally representative sample of about
100,000 individuals living in about 50,000 Each month the U.S. Bureau of the Census
households. selects respondents for the NCVS using a "rotat-
ing panel" design. Households are randomly se-
The survey categorizes crimes as personal or lected, and all age-eligible individuals in a
property  selected household become part of the panel.
Once in the sample, respondents are interviewed
Personal every 6 months for a total of seven interviews over
rape and sexual assault a 3-year period. The first and fifth interviews are
face-to-face; the rest are by telephone when pos-
robbery sible. After the seventh interview the household
simple and aggravated assault leaves the panel and a new household is rotated
purse snatching/pocket picking into the sample. The interview takes about 1/2
hour. The NCVS has consistently obtained a re-
sponse rate of about 95%.

2
How do you get people to participate How are NCVS data used?
in a survey about such private matters?
NCVS data have informed a wide audience
Over 95% of the selected households participate. concerned with crime and crime prevention.
Respondents, both victims and nonvictims, gener- Researchers at academic, government, private,
ally understand how their information is important and nonprofit research institutions use NCVS data
for knowledge about crime victimization. to prepare reports, policy recommendations,
scholarly publications, testimony before Congress,
How does the questionnaire work? and documentation for use in courts. Community
groups and Government agencies use the data
The NCVS questionnaire does more than simply to develop neighborhood watch and victim asis-
ask participants if they have been victimized by tance and compensation programs. Law
crime. A screening section provides respondents enforcement agencies use NCVS findings for
with a series of detailed questions and cues on training. The data appear in public service
victimizations and the situations within which announcements on crime prevention and crime
crimes may take place. If any screening question documentaries. Finally, print and broadcast media
elicits a positive response to a crime within the regularly cite NCVS findings when reporting on a
scope of the survey, interviewers collect details host of crime-related topics.
about the victimization in an incident report. The
screening section describes crimes in simple lan- How are NCVS data made available to the
guage, avoiding technical and legal terms such as public?
aggravated assault. Attempting to elicit an accu-
rate account, interviewers provide Annual data on victimization levels and rates are
respondents with detailed features that may char- normally published in a preliminary report in the
acterize a criminal incident, such as offender be- spring, a Bulletin with final data in the fall, and a
havior, crime location, and whether the offender full report of comprehensive findings the following
was a stranger, acquaintance or relative. If a fea- spring. The first Bulletin using redesigned data is
ture produces a positive response, details on the Criminal Victimization, 1993, published in May,
incident are gathered. 1995, NCJ-157657. Crime and the Nation's
Households, also published annually, is a report
When is an incident actually counted on the proportion of U.S. households in which
as a crime? members have been victimized. Special Reports,
Crime Data Briefs, and Bulletins on topical crime
When NCVS data are processed, incident report issues are published throughout the year. Sub-
data are classified by elements necessary to jects include school crime, violence against
define the incident as a crime. If an incident does women, crimes against the elderly, handgun vio-
not satisfy these criteria, it is not counted as a lence, and carjacking. NCVS reports are available
crime. from the BJS Clearinghouse. Data files are pre-
pared for public use and are made available on
computer tapes and CD-ROM. In 1994 no spring
report was issued, since the redesigned survey
data were being processed for the first time.

3
The redesign
Why was the NCVS changed at this time? to improve data collection techniques by adopt-
ing computer-assisted telephone interviewing for
In the mid-1970's the National Academy of some segments of survey participants
Sciences evaluated the NCVS for accuracy and to improve measures of rape and sexual attack
usefulness. While the survey was found to be an by asking respondents directly about these crimes
effective instrument for measuring crime, review-
to provide better measures of domestic violence.
ers identified aspects of the methodology and
scope of the NCVS that could be improved. They
What changes were made to improve the cov-
proposed research to investigate the following:
erage of crime?
an enhanced screening section that would better
stimulate respondents' recall of victimizations Screening questions were changed to provide a
screening questions that would sharpen the more complete, structured description of criminal
concepts of criminal victimization and diminish the incidents within the scope of the survey. The
effects of subjective interpretations of the survey screening section was also enhanced with short
questions cues  examples of specific places, people, ob-
additional questions on the nature and conse- jects, and actions that may have been associated
quences of victimizations that would yield useful with a victimization  to trigger recall of incidents.
data for analysis Cues on routine activities such as work, school,
shopping, entertainment, and transportation were
enhanced questions and inquiries about domes-
added to the beginning of the survey to encour-
tic violence, rape, and sexual attack to get better
age respondents to think of these typical settings
estimates of these hard-to-measure victimizations.
when responding to questions on whether a vic-
timization had occurred. Finally, questions were
Who was consulted in planning and
added to encourage respondents to report inci-
executing the redesign?
dents even if the perpetrators were people they
knew, like friends, relatives, and coworkers.
A consortium of experts in criminology, survey
design, and statistics conducted a detailed study
What was changed to improve measurement
and testing of the survey during 1979-85 to design
of rape and sexual assault?
an improved NCVS. This work received guidance
from an advisory panel that included criminal
At the inception of the NCVS in the early 1970's,
justice practitioners, policymakers, and represen-
it was deemed inappropriate for a government-
tatives from victims' groups. In addition, a panel
sponsored survey to ask respondents directly
of experts in problems of sexual assault and
about rape. Reports of rape and attempted rape
domestic violence recommended ways to improve
were obtained only if the respondent volunteered
NCVS measures for these crimes that are
this information in response to questions about
inherently difficult to detect.
assault and attacks. The new survey asks directly
about rape and attempted rape. It also distin-
What were the objectives of the redesign?
guishes among sex crimes by asking directly
about sexual attack, coerced and unwanted sex-
The overall objectives of the redesign were
ual activity (with and without force), and verbal
to increase reporting of crime victimization and
threats of rape or sexual attack. These new ques-
to provide additional details on individual crime
tions elicit more reports of rape and attempted
incidents. Specific objectives were:
rape, and the new questionnaire yields estimates
to develop improved screening questions, for related sexual crimes not previously measured.
thereby stimulating recall of incidents
to sharpen concepts of victimization for survey
respondents by providing a more thorough de-
scription of criminal incidents, thus diminishing
effects of cognitive and subcultural differences
among respondents

4
Questions about the improved measurement How has the measurement of domestic
violence been improved?
If a victim does not herself define an incident
as rape (for example, if the rape is committed Respondents may be reluctant to report acts
by her husband, and she does not consider this of domestic violence as crimes, particularly if the
a rape), does the NCVS still detect and measure offender is present during the interview. In addi-
this as a rape? tion, victims may not perceive domestic violence
as discrete criminal acts but as a pattern of abuse.
It is not necessary for the respondent to use Though these issues still pose measurement
the word rape for the NCVS to count it. Items in problems, the redesigned screening section
the questionnaire use descriptive language that includes explicit questions about incidents involv-
allows the victim and the interviewer to clarify what ing family members, friends, and acquaintances.
happened. This detail is later reviewed and clas- Screening questions also include multiple refer-
sified appropriately by computer or by trained ences to acts of domestic violence to encourage
coders. respondents to report such incidents even if they
do not define these acts as crimes. Finally, sev-
Why is sexual violence undercounted and how eral new questions on series crimes (see below)
does the NCVS attempt to reduce the gather information on the perpetrator and location
undercount? of the incidents, similarity of incidents to each
other, and persistence of the problem.
Sensitive material by definition is difficult to talk
about, and no voluntary study can claim that all What new information will the redesign
eligible participants have provided full information. provide?
However, the NCVS was redesigned to make
reporting of this kind of information easier for The revised NCVS will provide greatly enhanced
victims. Five of seven NCVS interviews are gen- data on the criminal incident itself. The new sur-
erally conducted over the phone. Many NCVS vey includes detail on:
items can be answered with a simple "yes" or interaction between victim and offender
"no." These two features make it difficult for
victim's crime deterrence efforts
anyone overhearing a phone interview to follow
what is being described, thereby giving the perceived effectiveness of crime deterrence
respondent a measure of privacy. Respondents efforts
are allowed to break off and reschedule, if their bystander behavior
privacy is violated during an interview. The perceived alcohol and drug use by the offender;
questionnaire has also been redesigned to allow
suspected gang involvement by the offender.
multiple opportunities for reluctant respondents
to report sensitive information.
To broaden the scope of crimes covered by the
NCVS, vandalism has been added as a new type
Does the survey provide information on stalking? of property crime. Finally, supplements on topical
issues like school crime will be a regular feature
Some of these incidents may be detected, but of the new NCVS.
only if there has been harm or a threat of harm to
the victim. The new crime screener provides addi-
tional encouragement for victims to report threats
and attacks by people they know.

5
Has the redesign produced any changes How has automated data collection improved
in crime definitions? quality?

Theft In CATI, the computer automatically presents the


interviewer with the appropriate next question.
Previously theft was defined as either a personal The computer allows for automated internal con-
or household crime, based on location of the inci- sistency checks and fewer transcribing errors.
dent. If an object was stolen from the grounds of CATI's centralization also improves data quality
a home, it was considered a household theft; if the because interviewers can be monitored, fostering
same object was stolen from someplace away adherence to standardized techniques.
from the home, it was considered a personal theft.
Using location to distinguish between personal What is the effect of these changes on the
and household theft came to be regarded as extent of reporting by crime victims?
potentially misleading. The NCVS now classifies
all thefts as property crimes, unless there was For most types of crime, the new methods elicit
contact between victim and offender. Thefts that more reports of victimizations. The NCVS sample
involved personal contact are classified as purse of households was divided into two halves for an
snatching and pocket-picking. 18-month period in 1992-93, and each half was
administered the original or the redesigned ver-
Series crimes sion of the questionnaire. Comparisons of data
indicate that the redesign elicits more reports of
In the original NCVS, a series crime was defined crime for most categories. However, the effect is
as three or more similar incidents occurring over not uniform across all types of crime and sub-
the past 6 months, for which the victim could not populations. For example, some crime categories,
recall dates and details well enough to report such as assault, are affected more by the redes-
them as discrete incidents. Counting and describ- ign than others. In-depth study of these overlap
ing incidents in the series are difficult, since data will guide interpretation of the effect of the re-
respondents are usually uncertain how many design on special populations and types of crime.
times the incident occurred, and often the details Other effects of the redesign include
are insufficient to classify the incident in the improved estimates of certain hard to enumerate
appropriate crime category. crimes such as domestic violence, rape, and
sexual attack.
Testing on series crimes has shown that the
threshold of three incidents may be too low  that Will it be possible to compare old and new
with an improved questionnaire respondents could estimates?
often recall details of up to five similar incidents.
The new NCVS methodology raises the series Statisticians who are experts on this particular sur-
crime threshold to six incidents. This revision vey will be able to compare victimization trends
makes it possible to count and categorize more in- under the old and new methods. Techniques to
cidents accurately, even if multiple incidents bear extend historical trends with estimates from the
a resemblance to each other. new methods will be developed. Technical reports
analyzing effects of the new methods on subpopu-
How is the NCVS being automated? lations will be published in the future.

Originally field interviewers around the country


conducted face-to-face and telephone interviews,
recording responses in pencil on a printed ques-
tionnaire. With computer-assisted telephone inter-
viewing (CATI), interviewers in centralized
telephone facilities read questions from a
computer screen and enter responses directly
into a computer. Under the redesign about 30%
of NCVS interviews are completed with CATI.

6
Where can I go for more information? Sources

All Bureau of Justice Statistics reports, including Bachman, Ronet, and Bruce Taylor, "The Measurement
Technical and Special Reports relevant to the of Rape and Family Violence by the Redesigned National
Crime Victimization Survey," Justice Quarterly, 1994.
redesign, can be obtained through the BJS Clear-
inghouse, P.O. Box 179, Dept. BJS, Annapolis Cahoon, Lawrence, and Gregory Russell, "Effects of
Junction, MD 20701-0179. For telephone Computer-Assisted Telephone Interviewing on Estimates
requests call 800-732-3277. Data tapes are From Demographic Surveys Conducted by the Bureau of
the Census," Joint Census Advisory Committee Meeting,
available through the National Archive of Criminal Alexandria, VA, 1991.
Justice Data, Inter-University Consortium for
Political and Social Research (ICPSR), P.O. Box Dodge, Richard W., Series Crimes: Report of a Field Test,
1248, Ann Arbor, MI 48106-1248. Phone numbers Bureau of Justice Statistics, 1987.
for the archive are 800-999-0960 or Hubble, David L., "National Crime Survey New Questionnaire
313-763-5011. Phase-In Research: Preliminary Results," International
Conference on Measurement Errors in Surveys, Tucson, AZ,
Who contributed to the redesign effort? 1990.

Taylor, Bruce, Redesign of the National Crime Survey,


Individuals who contributed to the research and Bureau of Justice Statistics, 1989.
implementation of the NCVS redesign are too nu-
merous to list. The Bureau of Social Science Re- Taylor, Bruce, New Directions for the National Crime Survey,
search served as the lead agency on the redesign Bureau of Justice Statistics Technical Report, 1989.
and coordinated efforts of staff members and con-
sultants from the following organizations:
Bureau of the Census
Bureau of Justice Statistics
Carnegie-Mellon University
National Crime Survey Redesign
Advisory Panel
National Opinion Research Center,
University of Chicago
Northwestern University
Research Triangle Institute,
North Carolina
Rutgers University
Survey Research Center,
University of Michigan
Westat, Inc.
Yale University.

You might also like