Download as pdf or txt
Download as pdf or txt
You are on page 1of 61

Surveillance 59

level (and to a lesser degree the national level), surveillance data are used to detect
epidemics that lead to control and prevention activities.

Test Hypotheses

In the day-to-day monitoring of health problems in a community, you often cannot


wait to do special studies. The data that are available must be analyzed. Although
the information might not be ideal for analysis, it can often be used to test certain
hypotheses. For example, the impact of laws specifying when children enter
school in the United States was expected to change the patterns of reported cases
of certain diseases by age. Indeed, the peak incidence of measles changed. Before
the widespread adoption of these laws in 1980, the peak incidence occurred among
children 10 to 14 years of age. Within two years, the peak incidence occurred
among children less than five years of age (Fig. 3–2).11

Identify and Evaluate Control Measures

Surveillance data are used to quantify the impact of intervention programs. For
example, decreases in poliomyelitis rates occurred following the introduction
of both the inactivated and oral polio vaccines (Fig. 3–3).12 In other examples,

Figure 3–2. Estimated rate (cases per 100,000 population) of measles, by age
group—United States, 1980–1982. Rates were estimated by extrapolating age
from the records of case-patients. [Source: CDC, 1983.]
60 Background

100
Inactivated vaccine

10
Rates (Logarithmic scale)

Oral vaccine

0.1

0.01

0.001

0.001
1951 1956 1965 1966 1971 1976 1981 1986 1991 1996 2001
Year

Figure 3–3. Rate (reported cases per 100,000 population) of paralytic poliomy-
elitis—United States, 1951–2004. [Source: CDC, 2006.]

broad-based community interventions such as increased legal age of driving and


safety-belt laws have had demonstrable effects on mortality.

Monitor Changes in Infectious Agents

In hospital and health department laboratories, various infectious agents are


monitored for changes in bacterial resistance to antibiotics or antigenic compo-
sition. The detection of penicillinase-producing Neisseria gonorrhoeae in the
United States has provided critical information for the proper treatment of
gonorrhea (Fig. 3–4).13 The National Nosocomial Infection Surveillance
System monitors the occurrence of hospital-acquired infections, including
changes in antibiotic resistance. Another example has been the detection of the
continual change in the influenza virus structure, information vital to vaccine
formulation.

Monitor Isolation Activities

The traditional use of surveillance was to quarantine persons infected with or


exposed to a particular disease and to monitor their health status. Although this
measure is used rarely today, isolation and surveillance are performed on patients
with multidrug-resistant tuberculosis and those suspected of having serious,
imported diseases such as the hemorrhagic fevers.
Surveillance 61

9
8
7
6
Percent

5
4
3
2
1
0
1980 1982 1984 1986 1988 1990
Year

Figure 3–4. Percentage of reported cases of gonorrhea caused by antibiotic-


resistant strains of Neisseria gonorrhoeae—United States, 1980–1990. [Source:
CDC, 1990.]

Detect Changes in Health Practices

Surveillance has been used to monitor health practices such as vaccinations, hys-
terectomy, caesarean delivery, mammography, and tubal sterilization. The surveil-
lance of such practices and health-care technologies has been increasing in public
health practice in recent years.14

EVALUATION OF A SURVEILLANCE SYSTEM

This chapter describes the essentials of a surveillance system and how to start and
maintain one. It is important to understand the basic levels of evaluation of such
systems. They should be evaluated at three levels: (1) the public health importance
of the health event; (2) the usefulness and cost of the surveillance system (e.g.,
whether it is meeting its goals and at what cost); and (3) the explicit attributes of
the quality of the surveillance system, including sensitivity, specificity, represent-
ativeness, timeliness, simplicity, flexibility, and acceptability.15, 16
The decision to establish, maintain, or deemphasize a surveillance system
should be guided by assessments based on these criteria. Ultimately, the decision
rests on whether a health event under surveillance is a public health priority and
whether the surveillance system is useful and cost-effective.
62 Background

SUMMARY

Public health surveillance is a basic tool of the field epidemiologist, providing the
scientific and factual database essential to informed decision-making and to the
conduct of public health prevention and control programs. Surveillance is based
on morbidity, mortality, and risk factor data, often from multiple sources. Some
data, such as vital statistics, are collected primarily for other uses; other data, such
as behavioral risk factors, are collected specifically for the surveillance system.
Surveillance systems are established by the field epidemiologist for specific
outcomes, such as a disease or injury, and must have clearly expressed goals.
Explicit case definitions are at the core of a surveillance system. The initiation and
maintenance of any successful surveillance system will reflect recognition of the
human element in surveillance practice: data collection, analysis, and data dis-
semination. Insensitivity to the persons involved in such a system dooms it to
failure.
Surveillance data have many uses but, in general, are needed to assess the
health status of a population, to set public health priorities, and to determine
appropriate actions. Effective systems of public health surveillance are evaluated
regularly on the basis of their usefulness in public health practice.

REFERENCES

1. Thacker, S.B., Berkelman, R.L. (1988). Public health surveillance in the United States.
Epidemiol Rev 10, 164–90.
2. Thacker, S.B., Stroup, D.F. (1992). Future directions for comprehensive public health
surveillance and health information systems in the United States. Am J Epidemiol 140,
383–97.
3. Langmuir, A.D. (1963). The surveillance of communicable diseases of national impor-
tance. N Engl J Med 268, 182–92.
4. Koo, D., Parrish, R.G., II. (2000). The changing health-care information infrastructure
in the United States: opportunities for a new approach to public health surveillance. In
S.M. Teutsch, R.E. Churchill (eds.), Principles and Practice of Public Health
Surveillance, vol. 1, pp. 76–94. Oxford University Press, New York.
5. Centers for Disease Control and Prevention (1997). Case definitions for public health
surveillance. Morb Mortal Wkly Rep 46, (RR-10) 1–55.
6. Centers for Disease Control and Prevention (2005). Progress in improving state and
local disease surveillance—United States, 2000–2005. Morb Mortal Wkly Rep 54,
822–5.
7. Bender, J.B., Hedberg, C.W., Besser, J.M., et al. (1997). Surveillance for Escherichia
coli 0157:H7 infections in Minnesota by molecular subtyping. N Engl J Med 337(6),
338–94.
8. Roush, S., Birkhead, G., Koo, D., et al. (1999). Mandatory reporting of diseases and
conditions by healthcare professionals and laboratories. JAMA, 282, 164–70.
Surveillance 63

9. Centers for Disease Control and Prevention (2006).Assessing capacity for surveil-
lance, prevention, and control of West Nile virus infection—United States, 1999 and
2004. Morb Mortal Wkly Rep 55, 150–3.
10. Centers for Disease Control and Prevention (1999). Summary of notifiable diseases,
United States, 1998. Morb Mortal Wkly Rep 47, 47.
11. Centers for Disease Control and Prevention (1983). Annual Summary 1983: Reported
morbidity and mortality in the United States. Morb Mortal Wkly Rep 32, 33.
12. Centers for Disease Control and Prevention (1999). Summary of notifiable diseases,
United States, 1998. Morb Mortal Wkly Rep 47, 54.
13. Centers for Disease Control and Prevention (1990). Sexually Transmitted Disease
Surveillance Morbidity Report.
14. Thacker, S.B., Berkelman, R.L. (1986). Surveillance of medical technologies. J Public
Health Policy 7, 353–77.
15. Romaguera, R.A., German, R.R., Klaucke, D.N. (2000). Evaluating public health
surveillance. In S.M. Teutsch, RE. Churchill (eds.), Principles and Practice
of Public Health Surveillance, 2nd ed., pp. 176–93. Oxford University Press,
New York.
16. Centers for Disease Control and Prevention (2001). Updated guidelines for evaluating
public health surveillance systems: recommendations from the guidelines working
group. Morb Mortal Wkly Rep 50(No. RR-13).

APPENDIX 3–1 INTERNET SITES FOR THE FIELD


EPIDEMIOLOGIST

DATA SETS

• Behavioral Risk Factor Surveillance System (BRFSS) Available: http://


www2.cdc.gov/nccdphp/brfss2/publications/index.asp#search
• National Mortality Follow-back Survey
• Available: http://www.cdc.gov/nchs/about/major/nmfs/nmfs.htm
• National Ambulatory Medical Care Survey (NAMCS)
• Available: http://www.cdc.gov/nchs/about/major/ahcd/ahcd1.htm
• National Hospital Ambulatory Medical Care Survey: 1997 Outpatient
Department Summary
• Available: http://www.cdc.gov/nchs/about/major/ahcd/ahcd1.htm
• National Health and Nutrition Examination Survey (NHANES/NCHS)
• Available: http:www.cdc.gov/nchs/nhanes.htm
• National Health Interview Survey (NHIS/NCHS)
• Available: http://www.cdc.gov/nchs/nhis.htm
• National Hospital Discharge Survey
• Available: http://www.cdc.gov/nchs/about/major/hdasd/nhds.htm
• National Nosocomial Infections Surveillance (NNIS)System
• Available: http://www.cdc.gov/ncidod/dhap/nnis/.html
64 Background

• National Disease and Therapeutic Index (IMS Health) Not Available on


the Internet. This item is available for purchase through IMS Health North
America
• (http://us.imshealth.com/intersite/default.asp) No price listed.
• National Birth Defects Prevention Network
• Available: http://www.nbdpn.org/
• Surveillance Epidemiology and End Results (SEER) System- National
Cancer Institute
• Available: http://seer.cancer.gov/Publications/CSR7393/index.html
• National Electronic Injury Surveillance System (NEISS)—CPSC
• Available: http://www.cpsc.gov/library/neiss.html
• Fatality Analysis Reporting System (FARS)—NHTSA
• Available: http://www.nhtsa.dot.gov/people/ncsa/fars.html
• National Automotive Sampling System—NHTSA
• Available: http://www.nhtsa.dot.gov/people/ncsa/nass_ges.html
• National Fire Incident Reporting System USFA/FEMA
• Available: http://www.nfirs.fema.gov/
• National Weather Service
• Available: http://www.nws.noaa.gov/
• Web-based Injury Statistics Query and Reporting System (WISQARS)
• Available: http://www.cdc.gov/ncipc/osp/data.htm

INSTITUTIONS AND OTHER ORGANIZATIONS

• Centers for Disease Control and Prevention


• Available: http://www.cdc.gov
• Morbidity and Mortality Weekly Report (MMWR)
• Available: http://www.cdc.gov/mmwr/
• Council of State and Territorial Epidemiologists
• Available: http:/www.cste.org
• Bureau of the Census
• Available: http://www.census.gov
II
THE FIELD INVESTIGATION
This page intentionally left blank
4
OPERATIONAL ASPECTS OF EPIDEMIOLOGIC
FIELD INVESTIGATIONS

R i c h a r d A . Go o d ma n
Ja me s L. H ad l e r
D uc J . Vug i a

An epidemiologic field investigation entails considerably more effort than simply


following the recommended, scientifically oriented steps as enumerated and
described in Chapter 5. Besides the necessary collection, tabulation, and analy-
ses of the data, there are numerous operational issues that must be addressed.
This chapter describes certain critical operational and management principles
that apply before, during, and after the field work. These principles encompass
the basic steps of: determining whether additional persons from outside the juris-
diction should be invited in; initiating an invitation; evaluating and responding to
an invitation; preparing for the investigation through collaboration and consulta-
tion; developing and issuing basic administrative instructions prior to departure
to the field; and initiating, implementing, and addressing the aftermath of the
field investigation. Finally, the chapter concludes with a brief discussion of
selected emerging developments in the operational approach to field investiga-
tions. The operational considerations addressed in this chapter extend far beyond
the scientific work of the investigators. However, if these considerations are
not addressed, the field investigation may encounter great difficulty, or may
even fail.
This chapter largely addresses work that the invited field investigator may
have to perform. However, most of the same operational concerns apply to field
investigators within a jurisdiction. In addition, it is critical that local and state

67
68 The Field Investigation

jurisdiction personnel in positions to call for assistance are able to understand the
perspective of those they invite in to assist.

DETERMINATION OF THE NEED FOR ASSISTANCE

In the United States, the responsibility for public health rests primarily with the
state and local agencies. While many investigations may be carried out with local
resources, sometimes they require additional assistance. Additional staff and/or
expertise may be necessary to fully investigate and respond to complex, large or
multijurisdictional problems. When additional help is needed, a process and
discussion follow to extend an invitation and define the relative roles of all
involved.

THE INVITATION

An essential consideration is the need to have a formal request for assistance from
an official who is authorized to request help. In the United States, usually the state
epidemiologist has the authority and responsibility for major epidemiologic field
investigations of acute public health problems and for making decisions about
whether to investigate independently or to seek help elsewhere. Other persons or
organizations may be involved in generating a request, including persons in insti-
tutional settings (e.g., nursing homes, hospitals, and businesses), as well as organ-
izational entities with special jurisdiction or authority (e.g., prisons, military
facilities, cruise ships, and reservations for Native Americans). For international
problems, determining who possesses authority to extend a request may be
considerably more complicated and may involve, for example, ministries of
health or multinational organizations such as the World Health Organization
(see Chapter 21).
The relations between larger and smaller health jurisdictions vary from
state to state (or province to province) within countries, as well as from country
to country. In general, the larger health jurisdictions help serve the smaller in
time of need. Yet the sensitivities between these jurisdictional levels are often
delicate, particularly as they relate to perceived competence, local scope of
responsibility, and ultimate authority. The health officials of the jurisdiction
providing assistance must decide—on the basis of prevailing local–state
agreements, as well as their best judgment—what is the most appropriate
response.
At the time of the initial request for assistance, the invited field epidemiolo-
gists should attempt to determine the answers to three questions.
Operational Aspects of Epidemiologic Field Investigations 69

• First, what is the purpose of the investigation?


– Is the health department simply requesting more help to perform or com-
plete the investigation?
– Has the health department been unable to determine the nature or source
of the disease or the mode of spread?
– Does the health department want to share the responsibility of the investi-
gation with others in order to be relieved of political or scientific pressure?
– When an epidemic is declared or announced by health officials or citizens,
is assistance being requested to publicize perceived adverse health condi-
tions, to awaken state or national health leaders, or even to secure funds?
• Second, and clearly related to the first, what specifically is the investiga-
tion expected to accomplish? The team may be asked to confirm
the findings already collected; collect new or different data for local
analysis; or perform an entirely new investigation, including analysis
and recommendations.
• Third, can you confirm that the requestor is authorized to invite assistance?
Occasionally field studies have been aborted simply because those request-
ing assistance had no authority to do so, or national teams were investigat-
ing without state (or local) permission.

PRELIMINARY DETERMINATION OF RESPONSIBILITIES

As noted in Chapter 1, there are several reasons why field investigations should be
done, if not encouraged. These include, but are not limited to, the need to:

• Control and prevent the occurrence of further disease;


• Provide agreed-upon or statutorily mandated services.
• Increase understanding of the natural history, clinical presentation, and/or
epidemiology of the problem under investigation;
• Strengthen surveillance through assessment of its quality; and
• Provide training opportunities in field epidemiology.

During preliminary discussions with the public health official(s) who are
requesting assistance with an investigation, the assignment of the following roles
and responsibilities should be addressed:

• What resources (including personnel) will be available locally within the


jurisdiction requesting assistance?
• What resources will be provided by the visiting team responding to the
request?
70 The Field Investigation

• Who will direct the day-to-day investigation?


• Who will be the media point person for the investigation team?
• Who will provide overall supervision and ultimately be responsible for the
investigation?
• How will the data be shared and who will be responsible for their analysis?
• Will a report of the findings be written? Who will write it, and to whom
will it be submitted or circulated?
• If the results of the field investigation warrant publication in a peer-review
journal or presentation in another scientific venue, who will be the senior
author of the scientific paper?

These are extremely critical issues, some of which cannot be totally resolved
before the investigative team arrives on the scene. However, they must be
addressed, discussed openly, and agreed upon as soon as possible.

PREPARATION

Collaboration and Consultation

Many field investigations require support by a competent laboratory. Even if local


laboratories are capable of processing and identifying the nature of specimens,
you should immediately, upon being informed of the proposed investigation, con-
tact your counterparts within your support laboratories. The laboratory scientists
should be requested to provide any needed guidance and laboratory assistance.
Now is the time to obtain assurance of cooperation and commitment rather than
during the field investigation or near the end after specimens have already been
collected. Not only must the laboratory staff schedule the processing of speci-
mens, they should also be asked to recommend what kinds of specimens should
be collected and how they should be collected and processed (see Chapter 24).
There also may be substantive basic or applied research questions that could
be appropriately addressed and answered during the field investigation. Discuss
these issues in detail with these professionals, and make every effort to enlist
their interest and support.
Advice on statistical methods also may be sought at this time. The same
consideration applies to contacting other health professionals—such as veterinar-
ians, mammalogists, entomologists and vector-control specialists, environmental
health specialists, and infection-control practitioners—whose expertise can be
crucial to a successful field investigation. Moreover, give consideration to includ-
ing such professionals on the investigative team. Determine whether they should
be part of the initial team so that appropriate data and, particularly, specimens can
Operational Aspects of Epidemiologic Field Investigations 71

be collected at the same time as other relevant epidemiologic information.


Information specialists can also be extremely important in the overall manage-
ment of a field investigation (see Chapter 13): because large outbreaks are likely
to attract moderate local or regional attention in the media, the presence of an
experienced and knowledgeable public information officer (PIO) who can respond
to public inquiries and meet the media on a regular basis can be invaluable. In the
United States, the inviting local or state health department often has its own PIO
who can serve as the media point person for the investigation. Finally, consider
including secretarial and/or administrative personnel on the investigating team,
both to use their services and to expose them to a real-life situation that will, in
turn, enhance their abilities to support future field investigations.

Basic Administrative Instructions and Notification

Once the field team has been chosen, certain key measures should be taken.

• Identify the team leader and the senior staff to whom s/he should report
regularly at the “home base.”
• Hold a meeting of all proposed field team members with home-based staff
to review known details of the public health problem, the nature of the
request for assistance, current knowledge of any suspected pathogen or
disease, goals and objectives for the field investigation, and preliminarily
agreed-upon roles and responsibilities.
• Try to arrange in advance an initial meeting with the requestor (e.g., the
state epidemiologist) or persons either designated or identified by the
requestor (e.g., local disease-control director or other official). This will
ensure that local authorities are not surprised by an unexpected arrival. In
addition, this step underscores for all parties the need for advance planning
and orderliness in the investigation—in essence, it sets a tone for the
conduct of the investigation.
• Before leaving for the field, a senior member of the team should write a
memorandum to the record and/or to relevant key officials. It should sum-
marize how and when the request was made, what information was pro-
vided by the requesting health agency, what is the agreed-upon purpose of
the investigation, what are the commitments of both the visiting team and
the requesting health officials, who is on the field team, and when the latter
is expected to arrive in the field. This memorandum should be distributed
to key personnel in the offices of the visiting team and the requesting, host
agency, and to others who need to know. This kind of communication
will serve not only as notification to all concerned, but as a method of pre-
venting redundant responses (i.e., to avoid “crossing wires”). It will also
72 The Field Investigation

identify expertise and resources from other programs that may contribute
to the investigation. Basic programmatic jurisdictions and interests must
also be respected, and some programs and staff simply want to or need to
know as a courtesy. Even when a problem does not directly involve a state
(for example, as in the case of prison or military facility), a wide array of
state and local officials are generally notified because of possible ramifica-
tions of the problem for populations in surrounding communities.
• Lastly, before departing for the field, each member of the investigative
team should review a basic checklist to ensure they have materials and aids
essential for field operations, and have covered fundamental travel and
logistical considerations. Such items include, for example, background
journal articles, statistical references, laptop computers (already loaded
with essential software, such as Epi Info), digital cameras, portable voice
recorders, credit cards, and travel and lodging reservations. Finally, each
member also should review the need for any necessary personal protective
measures, including vaccinations, anti-malarial prophylaxis, antimicrobi-
als or antivirals for post-exposure prophylaxis, and personal protective
equipment such as face masks, gloves, and gowns.

INITIATION OF THE INVESTIGATION

A key concept and philosophy for the field investigation team to keep in mind is
the importance of the role of “consultant/collaborator,” and what that implies. In
general, the guiding principle should be that the team is there to provide help, not
simply to “take charge.” Equally important is the need to balance the focus of the
investigation with the competing priorities in the locality of the requesting juris-
diction. While the immediate problem is the team’s sole concern, local health
officials must continue to address myriad other priorities and ongoing problems.
This dichotomy can be appreciated if the team tries to take the local point of view
early in the investigation.
Once on site, the team should meet promptly with the official who requested
assistance—usually the state, provincial, or local epidemiologist or a program
director. At this meeting, essential steps include the needs to:

• Review and update the status of the problem;


• Identify and review who are the primary contacts;
• Identify a principal collaborator who also can serve as a “guardian angel”
during the investigation;
• Identify local resources (e.g., office space, clerical support, assistance for
surveys, and laboratory support);
Operational Aspects of Epidemiologic Field Investigations 73

• Create a method and schedule for providing updates to local officials and
headquarters;
• Review sensitivities, including potential problems with institutions and
individuals (e.g., hospitals, administrators, practitioners, and local public
health staff) likely to be encountered during the investigation. Ideally, the
team initially should take the time to meet the requesting official—so that
key “doors” will be opened—rather than spend valuable time later in the
investigation mending bridges.

During the initial meeting between local staff and the visiting team, an appro-
priate local person should be identified to speak for the entire investigative team.
In general, the visiting team should try to avoid direct contact with the news media
and should always defer to local health officials (see Chapter 13). The field team
is essentially working at the request and under the aegis of the local health offi-
cials. Therefore, it is the local officials who not only know and appreciate the local
situation but also are the appropriate persons to comment on the investigation. In
the most practical sense, the less the media make contact with the visiting team,
the more the team can do at its own pace and discretion.
The work required to organize an investigation through this stage (starting
travel and convening the initial meeting) is relatively straightforward and uncom-
plicated. In contrast, however, at least three factors will probably complicate the
start of the scientific investigation: (1) the effects of a new setting (i.e., visiting
team members are outsiders and unfamiliar with the environment); (2) the often
intense pressure to solve the problem immediately and end the outbreak; and
(3) the media’s queries and other demands for the team’s time. Thus, in short
order, circumstances may change from tranquility and orderliness to a situation of
pressure and confusion. To overcome the myriad potential distractions, team
members must maintain the proper perspective by adhering to the basics: focusing
the mission to collect data systematically; verifying the diagnosis; and then
proceeding through case identification, orientation of data, and development and
testing of hypotheses (see chapters 8 and 10). Therefore, at the conclusion of the
initial meeting, some team members should try to visit patients to verify the
diagnosis through interviews, review of laboratory data, and, if necessary,
conducting a physical examination.

MANAGEMENT

Because of the potential complexity of field investigations, as well as the distract-


ing circumstances under which they are typically conducted, the field team
may want to take the following approaches to ensure the systematic and orderly
74 The Field Investigation

progression of the investigation. First, maintain lists of necessary tasks, check off
the actions that have been completed, and update the list at least twice daily.
Second, communicate frequently with coworkers, the requesting official, and the
person designated to be the media contact; hold a team meeting each day at a
regularly scheduled time. The team leader also should communicate with the
home base senior staff as frequently as needed. Third, never hesitate to request
additional help if required by the circumstances. Fourth, to ensure the investiga-
tion will be completed, avoid setting a departure date in advance or succumbing
to the pressure of family members to return earlier.
Investigations of large and complex problems may be particularly challeng-
ing for field teams and require even more rigorous organization of field opera-
tions. The following practical pointers are offered to assist in managing key
aspects of the investigation:

• Record the team’s decisions as the team makes them—this will help ensure
consistency and make the study reproducible, a consideration particularly
important in regard to case definitions and why certain criteria were used.
• Remember the need for quality-control measures such as training and
monitoring of data collectors and abstractors, conducting error checks
and validating data independently, and evaluating non-respondents and
missing records.
• Resist collecting more data than are needed (e.g., excessive clinical details).
• Write down the reason the team went to investigate and what was there
when the team arrived (i.e., a background section).
• Write while the investigation is ongoing—months later, team members
will have forgotten what they did.
• Write the methods while they are being defined and developed by team
members—a decision log helps.
• Maintain and retain an inventory of data files.
• Protect the information privacy interests of subjects.
• Because field investigations are difficult, associated with long hours and
great stress, field team managers must make a special effort to maintain
morale and should find ways to provide encouragement, positive reinforce-
ment, and appreciation to those who participate.

Occasionally, after some time in the field, an investigation does not yield
definite results or it identifies additional questions that require one or more inves-
tigations to address. At that point, the team leader, in consultation with the home
base senior staff, should assess the team’s morale and capacity to persevere to
determine whether the team should continue its efforts or a fresh team should
prepare to come in to extend the investigation.
Operational Aspects of Epidemiologic Field Investigations 75

DEPARTURE

Upon concluding the on-site field investigation, a departure meeting should be


organized to include the requestor, other key officials, and members of the
investigation team. In addition to helping to formally conclude the on-site work,
the departure meeting enables the team to debrief the requesting official on find-
ings of the investigation, review preliminary recommendations, provide
acknowledgments, and express appreciation to local hosts and collaborators.
The team should obtain any additional names, titles, and street and e-mail
addresses for follow-up communications. If at all possible, the team should
leave on site a preliminary report, and at the same time make a commitment to
provide a complete written report within an agreed-upon, specified time
period.
The departure meeting also may be the most appropriate occasion for
planning follow-up activities with the requesting official and organization. Such
activities could include additional studies, evaluation of control measures, analy-
sis and maintenance of data collected during the investigation, plans for final
reports and manuscripts (including discussion of authorship), and determining
who is responsible for each of these different follow-up activities.

REPORTS

Written summaries of the investigation include both preliminary and final reports.
The preliminary report fulfills the immediate obligation to the requesting official
and agency. It should include a summary of methods used to conduct the investi-
gation, preliminary epidemiologic and laboratory findings, recommendations, a
clear delineation of tasks and activities that must be completed, and appropriate
“thank you’s.” In addition to the preliminary report, which optimally should be
delivered to the requestor on departure or from the field within one to two weeks
of completion of the investigation, the team should prepare follow-up letters to
other principals (e.g., local health officials, co-investigators) to inform them and
to reinforce long-term relations.
The final reports should be written as quickly as possible—before team
members are called out to another epidemiologic field investigation! The final
report should include complete and final data. In addition to a written final report,
field investigation team members should consider other methods or forums for
communicating the investigation’s findings. Options include formal seminars—in
person, by teleconference, or by videoconference—where an oral presentation
will promote critical feedback; reports for public health bulletins intended for
public health practitioners (e.g., CDC’s Morbidity and Mortality Weekly Report);
76 The Field Investigation

comprehensive articles for peer-reviewed journals; and presentations of findings


at professional meetings.

EMERGING DEVELOPMENTS

This chapter has outlined and described operational principles for epidemiologic
field investigations. These principles represent a combination of standard man-
agement and administrative concepts adapted to the settings and needs of field
epidemiology. However, in the closing decades of the 20th century and the begin-
ning of the 21st century, major epidemiologic developments and other events, as
well as shifts in societal norms and governmental policies, have had an impact on
the operational aspects of field investigations. These emerging developments
encompass, but are not limited to, health information privacy, field investigations
spanning multiple jurisdictions, investigations of suspected bioterrorism, and use
of incident-command system. This chapter concludes by briefly discussing these
selected emerging developments.

Privacy Concerns

Privacy requirements and confidentiality concerns must be adhered to throughout


all phases of the field investigation. In addition to federal requirements regarding
information privacy (see Chapter 14), each state has its own laws that cover pri-
vacy and confidentiality of information obtained during epidemiologic investiga-
tions1. The stringency of these laws varies by state. The need to adhere to these
laws and to respect personal privacy and confidentiality interests also applies
when members of the field team write reports and make presentations to groups of
people who are not members of the investigation team. Trip reports should be
written in a manner that prevents identification of individuals and places that were
the subject of or implicated during the field investigation. Once the investigation
is complete, all records containing identifying information should be given to the
state or local jurisdiction that extended the invitation for management according
to the jurisdiction’s laws. In addition to protecting the privacy interests of persons
who were subjects of the investigation, this approach also minimizes the likeli-
hood that members of the invited field team would possess information that could
be subject to subpoena or freedom of information requests that normally would be
denied by the state or local jurisdiction.

Multi-jurisdiction Investigations

As global transport of foods, goods, and humans became rapid and routine,
multi-jurisdictional disease outbreaks also have become more frequent.
Operational Aspects of Epidemiologic Field Investigations 77

Contaminated produce from a farm or deli meat from a processing plant can cause
a multi-county, multistate, or international food-borne disease outbreak. In the
United States, improved surveillance and detection of multi-jurisdictional out-
breaks have been facilitated by new tools, such as PulseNet, a national molecular
subtyping network,2 and investigations of multistate food-borne disease outbreaks
have become better coordinated across local, state, and federal agencies. The key
features of a well-coordinated investigation of a multistate food-borne disease
outbreak include rapid communication between local, state, and federal public
health officials as soon as possible after recognition of the outbreak, led by a
single central group, such as the Foodborne and Diarrheal Diseases Branch at the
CDC; participation on regular, weekly teleconference calls to share proposed case
definition(s), evolving case counts, laboratory findings, hypotheses, and study
instruments; coordination of epidemiologic and laboratory investigations and sup-
port, whether provided in the field by some states or centrally by CDC; involve-
ment of food safety regulatory agencies in tracebacks or traceforwards of
implicated food(s); and frequent and consistent risk communication to the public
and media.3
For an acute public health problem involving many jurisdictions, rapid, cen-
tralized communication and coordination of field investigations involving key
public health officials from all levels is necessary to efficiently define and control
the source of the problem. For example, in the multistate outbreak of E. coli 0157:
H7 infections associated with consumption of fresh spinach in the United States
in 2006, CDC held a multistate teleconference within a few days after being
alerted by at least two states of small clusters of E. coli 0157:H7 infections and
CDC PulseNet confirmation of a rare matching PFGE pattern in patients from
some of these states.4 Based on preliminary information shared on this call, the
U.S. Food and Drug Administration (FDA) immediately advised consumers to not
eat bagged fresh spinach, effectively intervening on the ongoing nationwide out-
break. Days later, parallel laboratory investigations in several states detected the
outbreak strain of E. coli 0157:H7 in some bagged spinach, and weeks later, two
epidemiologic investigations, one led by a state enrolling its own infected resi-
dents and the other led centrally by CDC enrolling patients from other states,
implicated the same food vehicle.

Suspected Bioterrorism

Instances of suspected bioterrorism raise a spectrum of general operational and


other practical considerations regarding the coordination of concurrent and over-
lapping investigations involving officials from both public health and law enforce-
ment agencies.5 A paramount operational consideration involves determining
what sector and persons may be in charge of a given site: this is a function of
78 The Field Investigation

several factors, including the extent to which information and evidence suggest
that the site is a “crime scene,” as well as the extent to which findings indicate that
the site has public health intervention implications in terms of preventing further
exposures and identifying and managing persons who may have been exposed
prior to the initiation of the investigation.
In addition to the issue of determining who is “in charge” of the site, exam-
ples of related and key operational considerations are the approaches to collecting
samples from the site of the concurrent investigation and to interviewing persons
who may be affected—either with active cases of disease or who may have been
exposed—and/or who may be targeted by the criminal investigation as potential
suspects. From a public health perspective, the routine epidemiologic investiga-
tion may necessitate the collection of biologic specimens from persons (e.g.,
blood and sputum samples) and environmental samples (e.g., swabs). However,
during a concurrent investigation of suspected bioterrorism, when such specimens
and samples are being obtained in the setting of a possible crime scene, epidemi-
ology field team members must recognize that physical information-gathering
steps taken by law enforcement officials as part of an ongoing criminal investiga-
tion must adhere strictly to the process of establishing a “chain of custody of
evidence.” A key purpose for this process is to ensure that specimens and samples
presented as evidence during a criminal prosecution and trial in court can with-
stand challenge by the defense. The standards required for establishing a chain of
custody of evidence for any given sample are rigorous in relation to documenting
its precise source, who obtained it, who handled and maintained it, and other
factors.
Conducting interviews jointly by public health and law enforcement officials
is another example of emerging operational developments that pose new chal-
lenges for the epidemiology field team. Under the circumstances of an investiga-
tion of suspected bioterrorism or some other problem in which criminal activity
may have contributed to the public health problem, epidemiologists and criminal
investigators must adhere to procedures that both serve the interests of public
health and safety, and respect laws that safeguard the rights of individuals, includ-
ing persons who are or may become suspects in a criminal investigation. These
requirements have prompted some jurisdictions to develop agreements between
public health and law enforcement agencies that provide a basis for crafting
protocols for joint interviews conducted by representatives of both sectors.6

Incident Command Systems

Finally, whether an acute public health problem is the result of a natural or


unintentional occurrence or of suspected bioterrorism, it may be serious enough
to involve multiple jurisdictions (i.e., local, state, and federal) and multiple
Operational Aspects of Epidemiologic Field Investigations 79

governmental agencies (e.g., emergency medical services [EMS], law enforce-


ment, public health), and may require a standardized, coordinated response
encompassing jurisdictions beyond public health. In the United States, the Incident
Command System (ICS) is a standardized, on-scene command structure set up to
manage incidents across jurisdictional boundaries. ICS allows personnel from
various agencies and disciplines to work together in a common management
structure with a clear chain of command or unified commands, and provides logis-
tical and administrative support to operational staff. Originally developed in the
1970s to improve management of destructive fires, ICS has been embraced by fire,
police, EMS, and military agencies. In recent years, as part of bioterrorism prepar-
edness, public health personnel at local, state, and federal levels have been engaged
in emergency preparedness and many are trained in ICS. In addition, ICS increas-
ingly is used at all levels of public health to coordinate responses to large
outbreaks or other acute situations with substantial political and public interest.
In the 2001 anthrax attacks in the United States, local, state, and federal
public health field investigators worked with investigators from other agencies
under ICS set up at state and federal levels “to address the constant emergence of
new information, pursue many public health activities simultaneously across
multiple investigations, and communicate effectively” while the emergency oper-
ations center (EOC) was activated at CDC.7 On a smaller scale, a local health
department in Virginia used ICS to implement a mass tuberculosis-screening
program working with community partners and participating agencies to find
and test over 2,500 potential contacts of a nurse who died of untreated active
tuberculosis.8 Field investigators should be familiar with both ICS and the EOC,
as well as their relationships to the ICS should it be used and to an EOC activated
before or during an investigation. In general, use of ICS should simplify the
defining of roles for all involved and optimize use of all available resources and
expertise across jurisdictions when managing emergency incidents.
ACKNOWLEDGMENTS The authors gratefully acknowledge Michael B. Gregg, Robert A. Gunn,
and Jeffrey J. Sacks, whose work on the this chapter in previous editions of this book contributed in
part to this chapter.

REFERENCES

1. Hodge, J.G., Hoffman, R.E., Tress, D.W., et al(2007). Identifiable health information
and the public’s health: practice, research, and policy. In: R.A. Goodman,
R.E. Hoffman, et al. (eds.), Law in Public Health Practice, 2nd ed., Oxford University
Press, New York. pp. 238–61.
2. Swaminathan, B., Barrett, T.J., Hunter, S.B., et al. (2001). CDC PulseNet Task Force.
PulseNet: the molecular subtyping network for foodborne bacterial disease surveillance,
United States. Emerg Infect Dis 7(3), 382–9.
80 The Field Investigation

3. Sobel, J., Griffin, P.M., Slutsker, L., et al. (2002). Investigation of multistate foodborne
disease outbreaks. Public Health Rep 117, 8–19.
4. CDC (2006). Ongoing multistate outbreak of Escherichia coli serotype 0157:H7 infec-
tions associated with consumption of fresh spinach—United States, September. Morb
Mortal Wkly Rep 55, 1045–6.
5. Goodman, R.A., Munson, J.W., Dammers, K., et al. (2003). Forensic epidemiology: law
at the intersection of public health and criminal investigations. J Law Med Ethics 31,
684–700.
6. CDC (2004). NYC protocol: http://www2a.cdc.gov/phlp/docs/BTProtocolCover.PDF;
http://www2a.cdc.gov/phlp/docs/Investigations.PDF.
7. Perkins, B.A., Popovic, T., Yeskey, K. (2002). Public health in the time of bioterrorism.
Emerg Infect Dis 8,1015–8.
8. Rendin, R.W., Welch, N.M., Kaplowitz, L.G. (2005). Leveraging bioterrorism prepar-
edness for non-bioterrorism events: a public health example. Biosecur Bioterror 3,
309–15.
5
CONDUCTING A FIELD INVESTIGATION

M i c h a e l B . Gr e g g

This chapter explains how to perform an epidemiologic field investigation. It


focuses on a presumed point source (common source) epidemic, recognized and
reported by local health authorities to a state (provincial) health department. This
is a typical setting that highlights the tasks that you need to perform. Although the
context is one of an acute infectious disease epidemic in a community, the epide-
miologic and public health principles apply equally well to noninfectious disease
investigations.

BACKGROUND CONSIDERATIONS

Overall Purposes and Methods

Some purposes of epidemiology include determining the cause(s) of a disease, its


source, its mode of transmission, who is at risk of developing the disease, and
what exposure(s) predispose to the disease. Fortunately, in many outbreak inves-
tigations the clinical syndromes are easily identifiable; the agents can be readily
isolated and characterized; and the source, mode of transmission, and risk factors
of the disease are usually well known and understood. Therefore, you are often
well prepared for the field investigation. However, when the clinical diagnosis

81
82 The Field Investigation

and/or laboratory findings are unclear, the task becomes much more difficult.
It requires more careful consideration of the clinical presentation of disease in an
effort to determine the source, mode of spread, and population(s) at risk. For
example, bacterial contamination of food or water is usually manifested by signs
and symptoms referable to the gastrointestinal tract. Pathogenic agents transmit-
ted in air often affect the respiratory tract and sometimes the skin, eyes, or mucous
membranes. Skin abrasions or lesions may suggest animal or insect transmission.
So the clinical manifestations of disease may serve as critical leads.
Regardless of how secure the clinical diagnosis may be, your thought process
must include clinical, laboratory, and epidemiologic evidence. Together these
provide leads and pathways to take or reject to discover the natural history of
the epidemic.
Although you will perform several separate operations, in broad strokes you
will really do two things. First, you will collect information that describes the
setting of the outbreak; namely, when people became sick, where they acquired
disease, and what the characteristics of the ill people were. These are the descrip-
tive aspects of the investigation. Often, simply by knowing these facts (and the
diagnosis), you can determine the source and mode of spread of the agent and
can identify those primarily at risk of developing disease. Common sense will
often give you these answers, and relatively little, if any, further analysis is
required.
On occasion, however, it will not be readily apparent where the agent resided,
how it was transmitted, who was at risk of disease, and what the exposure was.
Under these circumstances, you will have to use a second operation, analytic epi-
demiology, to provide the answers. And the critical operations here include deter-
mining rates and comparing these rates. Virtually all epidemiologic analyses
require comparisons, usually groups of persons—ill and well or exposed and not
exposed (see Chapter 8). In epidemic situations you will usually compare ill and
well people—both believed at risk of disease—to determine what exposures ill
people had that well people did not have. These comparisons are made by using
appropriate statistical techniques (see Chapters 8 and 10). If the differences
between ill and well persons are greater than one would expect by chance, you can
draw certain inferences about why the epidemic occurred. In some situations,
comparisons can be made between exposed persons and those not exposed to see
if there are significant differences in rates of illness between the two groups.

The Pace and Commitment of a Field Investigation

An underlying theme throughout this chapter is the need to act quickly, establish
clear operational priorities, and perform the investigation responsibly. This should
not imply haphazard collection and inappropriate analysis of data, but rather the
Conducting a Field Investigation 83

use of simple and workable case definitions, case-finding methods, and analyses
(see Chapters 4 and 11).
Data collection, analyses, and recommendations should be performed in the
field. There is a strong tendency to collect what you think is the essential informa-
tion in the field and then retreat to “home base” for analysis—particularly now with
the availability of personal computers. Avoid this reflex at all costs. Such action
will probably be viewed as lack of interest or concern or even possessiveness by the
local constituency. A premature departure also makes any further collection of data
or direct contact with study populations and local health officials difficult, if not
impossible. Once home, you lose the urgency and momentum to perform, the sense
of relevancy of the epidemic, and, most of all, the totally committed time for the
investigation. Every field investigation should be completed, not only to the field
team’s satisfaction, but particularly to that of the local health department as well.

THE INVESTIGATION

Introduction

Ten basic tasks will be described in a logical order (Table 5–1). However, you may
perform several of these functions simultaneously or in different order during the
investigation. Control and prevention measures may even be recommended soon
after beginning the investigation simply on the basis of intuitive reasoning or

Table 5–1. The Ten Steps of a Field Investigation

1. Determine the existence of the epidemic


2. Confirm the diagnosis
3. Define a case and count cases
4. Orient the data in terms of time, place, and person
5. Determine who is at risk of becoming ill
6. Develop a hypothesis that explains the specific exposure that caused disease and
test this hypothesis by appropriate statistical methods
7. Compare the hypothesis with the established facts
8. Plan a more systematic study
9. Prepare a written report
10. Execute control and prevention measures
84 The Field Investigation

common sense. Sometimes the local officials know why the epidemic occurred,
and you are there simply to supply a scientific basis for their conclusion.
No two epidemiologists will take the exact same pathway of investigation.
Yet, in general, the data they collect, the analyses they apply, and the control and
prevention measures they recommend are likely to be similar.
Since, by definition, our example epidemic has resulted from a point source
and may be nearly over before the field team arrives, the investigation will in all
likelihood be retrospective in nature. This should alert you to some fundamental
aspects of any investigation that occurs “after the fact.” First of all, because many
illnesses and critical events have already occurred, virtually all information
acquired and related to the epidemic will be based upon memory. Health officers,
physicians, and patients will probably have different recollections, views, or
perceptions of what transpired. Information may conflict, may not be accurate,
and certainly cannot be expected to reflect the precise occurrence of past events.
Like the clinician, you may have to ask patients what they think made them sick,
what they think caused the epidemic. Most critically, in parallel with medical
practice, action may have to be taken without the benefit of all the desired data
(see Chapter 11).
For the young, inexperienced medical epidemiologist steeped in the tradition
of molecule and millimole determinations, the “more-or-less” measurements of
the field epidemiologist can initially be major hurdles to a successful field inves-
tigation. However lacking in accuracy these data may be, they are often the only
data you have; and they must be collected, analyzed, and interpreted with care,
imagination, and caution. Furthermore, you have not seen the epidemiologic
method work in real life. Unlike clinical medicine when in a matter of minutes to
a few hours the physical examination usually reinforces the history, and the labo-
ratory results usually reinforce both, there often is no immediate reinforcement of
the thought processes and activities in the field. It usually takes several days or a
week before data start coming in that begin to reassure you that you are on the
right track.

Determine the Existence of an Epidemic

Local health officials usually will know if more disease is occurring than would
normally be expected. Since most local health departments have ongoing records
of communicable diseases and certain noninfectious conditions, by comparing
weekly, monthly, or yearly data, you can easily determine if the observed numbers
exceed the expected level. Although there may not be laboratory confirmation at
this time, an increase in reported cases by local physicians is enough evidence
to investigate. However, at this time avoid the use of the terms “epidemic” or
“outbreak.” These words are quite subjective. Local health officials take different
Conducting a Field Investigation 85

views of the normal rise and fall in cases, and whether changes in the pattern merit
investigation.
You must be aware of artifactual causes of increases or decreases in reported
cases such as changes in local reporting practices, increased interest in certain
diseases because of local or national awareness, a new physician or clinic in town,
or changes in diagnostic methods. An excellent example of artifactual reporting
occurred in southwest Florida in 1977 when a new physician in the community
reported many cases of encephalitis in his practice. After extensive field work by
local, state, and federal epidemiologists, it was clear there was no epidemic, but
simply misdiagnoses by the physician.1
Sometimes, however, it may be difficult to document the existence of an
epidemic rapidly. You may need to acquire absentee records from schools or fac-
tories, records of outpatient clinic visits or hospitalizations, laboratory records, or
death certificates. A simple telephone survey of practicing physicians will strongly
support the existence of an epidemic, as would a similar rapid survey of house-
holds in the community. In such quick assessments, you could ask about signs and
symptoms rather than about specific diagnoses. Ask physicians or clinics if they
are treating more people than usual with sore throats, gastroenteritis, or fever with
rash, as examples, in order to obtain an index of disease incidence. Although not
specific for any given disease, such surveys can often establish the existence of an
epidemic. Sometimes it is extremely difficult to determine if there is an epidemic.
Yet because of local pressures, the team may have to continue the investigation
even if they believe no significant health problem exists.

Confirm the Diagnosis

Confirm the clinical diagnosis by standard laboratory techniques such as serology


and/or isolation and characterization of the agent. Do not try to use newly intro-
duced, experimental, or otherwise not broadly recognized confirmatory tests—at
least not at this stage in the investigation. If at all possible, visit the laboratory and
verify the laboratory findings in person. For example, talk to the technician, check
the record books, and look at the gram stain yourself.
Not every reported case has to be confirmed in the laboratory. If most
patients have signs and symptoms compatible with the working diagnosis, and,
perhaps, 15% to 20% are laboratory-confirmed, you do not need more confirma-
tion at this time. This usually is ample confirmatory evidence. See and examine
several representative cases of the disease as well, if at all possible. Clinical
assumptions should not be made; the diagnosis should be verified by you
or a qualified physician with you. Nothing convinces supervisors and health
officers more than an eyewitness confirmation of clinical disease by you and the
investigating team.
86 The Field Investigation

Define a Case and Count Cases

Now try to create a workable case definition, decide how to find cases, and count
them. The simplest and most objective criteria for a case definition are usually the best
(e.g., fever, X-ray evidence of pneumonia, white blood cells in the spinal fluid, number
of bowel movements per day, blood in the stool, or skin rash). However, be guided by
the accepted, usual presentation of the disease with or without standard laboratory
confirmation in the case definition. Where time may be a critical factor in a rapidly
unfolding field investigation, use a simple, easily applicable definition—recognizing
that some cases will be missed and some non-cases included. For example, in an
epidemic of hepatitis A, a history of jaundice, fever, and an abnormal liver enzyme
test should be quite adequate to start with. Later you can refine the definition.
Some factors that can help determine the levels of sensitivity and specificity
of the case definition are the following:

• What is the usual apparent-to-inapparent clinical case ratio?


• What are the important and obvious pathognomonic or strongly clinically
suggestive signs and symptoms of the disease?
• What microbiologic or chemical isolations, identification, and serologic
techniques are easy, practical, and reliable?
• How accessible are the patients or those at risk; can they be contacted
again after the initial investigation for follow-up questions, examination,
or serology?
• In the event that the investigation requires long-term follow-up, can the
case definitions be applied easily and consistently by others not on the
current investigating team?
• Is it absolutely necessary that all patients be identified during the initial
investigation or would only those seen by physicians or hospitalized
suffice?

No matter what criteria are used, you must apply the case definition equally
and without bias to all persons under investigation.
Methods for case finding will vary considerably according to the disease in
question and the community setting. Most outbreaks involve certain clearly iden-
tifiable groups at risk; therefore, finding cases will be relatively self-evident and
easy. Active, direct contact with selected physicians, hospitals, laboratories,
schools, or industries or by using some form of public announcement will find
most of the remaining, unreported cases. However, sometimes more intensive
efforts—such as physician, telephone, door-to-door, or culture or serologic
surveys—may be necessary to find cases. Regardless of the method, you must
establish some system(s) of case finding during the investigation and perhaps
afterwards (see Chapter 3).
Conducting a Field Investigation 87

Simply knowing the number of cases does not provide adequate informa-
tion. Control and prevention measures depend upon knowing the source and
mode of spread of an agent as well as the characteristics of ill patients. Therefore,
case finding should include collecting pertinent information likely to provide
clues or leads to the natural history of the epidemic and, particularly, relevant
characteristics of the ill. First, collect basic information about each patient’s
age, gender, residence, occupation, and date of onset, for example, to define the
basic descriptive aspects of the epidemic. Next, get pertinent signs, symptoms,
and laboratory data. If the disease under investigation is usually water- or food-
borne, ask questions about exposure to various water and food sources; if trans-
mitted by person-to-person contact, ask about the frequency, duration, and
nature of personal contacts. If the nature of the disease is not known or cannot
be comfortably presumed, you will need to ask a variety of questions covering
all possible aspects of disease transmission and risk. Also be mentally prepared
for the possibility of having to apply a second questionnaire if the first analysis
does not help.

Orient the Data in Terms of Time, Place, and Person

Now the team should have a reasonably accurate number of cases to view descrip-
tively. So it is time to characterize the epidemic in terms of when patients became
ill, where they lived or became ill, and what special attributes the patients had (see
Chapter 9 for greater detail). You may want to wait until the epidemic is over or
until all likely cases have been reported before performing such an analysis. Don’t.
The earlier you develop ideas of why the epidemic started, the more pertinent data
you can collect. The addition of a proportionately small number of cases later on
will usually not affect the analysis or recommendations.

Time
Characterize the cases by plotting a graph that shows the number of cases
(y axis) over the time of onset of illness using an appropriate time interval (x axis)
(Fig. 5–1). This “epidemic curve” gives a considerably deep appreciation for the
magnitude of the outbreak, its possible mode of spread, and the possible duration
of the epidemic—much more than would a simple “line-listing” of cases. One can
often infer a remarkable amount of information from a simple picture of times of
onset of disease. If the incubation period of the disease is known, relatively firm
inferences can be made regarding the likelihood of a point source exposure,
person-to-person spread, or a mixture of the two. And just the opposite: if you
know when the exposure occurred, you may be able to determine the incubation
period. This is particularly important if you do not know what the disease is.
Also, if the epidemic is still in progress and you have a good idea of the disease,
88 The Field Investigation

Figure 5–1. Cases of Pontiac fever, by date of onset—Michigan, June 28–


2
August 5, 1968. [Source: Glick et al., 1978. ]

you may be able to predict how many more cases are likely to occur. Finally, an
epidemic curve provides an excellent “prop” for ready communication to nonepi-
demiologists, administrators, and the like who need to grasp in some fashion the
nature and magnitude of the epidemic.
The epidemic curve in Figure 5–1 shows cases of Pontiac fever (subsequently
confirmed as Legionnaires’ disease) that occurred in Pontiac, Michigan, July and
August 1968, by day of onset.2 The epidemic was explosive in onset, suggesting
(1) a virtually simultaneous point-source exposure of many persons; (2) a disease
with a short incubation period because of the very tight clustering of cases over a
very narrow time frame); and (3) a continuing exposure spanning several weeks—
all of which were subsequently confirmed.

Place
Sometimes diseases occur or are acquired in unique locations in the com-
munity, which, if you can visualize, may provide major clues or evidence regard-
ing the source of the agent and/or the nature of exposure. Water supplies, milk
distribution routes, sewage disposal outflows, prevailing wind currents, air-flow
patterns in buildings, and ecological habitats of vectors may play important roles
in disseminating microbial or environmental pathogens and determining who is at
risk of acquiring disease. If one plots cases geographically, a distribution pattern
may appear that approximates these known sources and routes of potential expo-
sure. This, in turn, may help identify the vehicle or mode of transmission.
Conducting a Field Investigation 89

Figure 5–2. Culture-positive cases of Shigella, by sites along the Mississippi River
where each case swam within three days of onset of illness. [Source: Rosenberg
3
et al., 1976. ]

Figure 5–2 illustrates the usefulness of a “spot map” in the investigation of


an outbreak of shigellosis in Dubuque, Iowa, in 1974.3 Early analysis showed that
cases were not clustered by place of residence. A history of drinking water gave
no useful clue to a possible source and mode of transmission. However, it was
later learned that many cases had been exposed to water by recent swimming in a
camping park located on the Mississippi River. Figure 5–2 shows the river sites
where 22 culture-positive cases swam within three days of onset of illness, strongly
suggesting a common source of exposure. Ultimately, the epidemiologists incrim-
inated Mississippi River water by documenting gross contamination by the city’s
sewage treatment plant five miles upstream and by isolating Shigella sonnei from
a sample of river water taken from the camping park beach area.

Person
Lastly, you must examine the characteristics of the patients themselves in
terms of a variety of attributes, such as age, gender, race, occupation, or virtually
90 The Field Investigation

any other characteristic that may be useful in portraying the uniqueness of the
case population. If a singular or special attribute emerges, this frequently suggests
a strong lead as to the group at risk and even an idea of the specific exposure.
Some diseases primarily affect certain age groups or races; frequently, occupation
is the key attribute of people with certain diseases. The list of human characteris-
tics—really potential risks and exposures—is nearly endless. However, the more
you know about the disease in question (the agent’s reservoir, mode(s) of spread,
persons usually at greatest risk), the more specific and pertinent information you
should seek to determine whether any of these risks or exposures predispose to
illness.

Determine Who Is at Risk of Becoming Ill

You now know the number of ill people, when and where they were when they
became ill, what their general characteristics are, and, usually, have a firm diagno-
sis or a good “working” diagnosis. These data frequently provide enough infor-
mation to determine with reasonable assurance how and why the epidemic started.
For example, a time, place, and person description of the epidemic will strongly
suggest that only people in a particular community supplied by a specific water
system were at risk of getting sick, or that only certain students in a school or
workers in a single factory became ill. Perhaps it was only a group of people who
attended a local restaurant who reported illness. However, no matter how obvious
it might appear that only a single group of persons was at risk, one should look
carefully at the entire community to be sure there are not other affected persons.
Sometimes it is very difficult to know who is at risk, particularly in epidem-
ics that cover large geographic areas and involve many age groups with initially
no obvious unique characteristics. Under these circumstances the team may have
to do a survey of some kind to get more specific information about the ill persons
and some idea of who is at risk.

Develop a Hypothesis That Explains the Specific Exposure


That Caused Disease and Test This Hypothesis by
Appropriate Statistical Methods
This next step, the first real epidemiologic analysis of the field investigation, is
often the most difficult one to perform. By now you should have an excellent
grasp of the epidemic and an overall feel for the most likely source and mode of
transmission. However, the exposure that caused disease must be determined.
A simple example was the 1989 investigation of an epidemic of nausea, vom-
iting, and diarrhea among 20 people who ate at a single pizzeria in McKeesport,
Pennsylvania.4 Since the disease was most likely acquired by eating something
Conducting a Field Investigation 91

(because of the signs and symptoms) and because no other cluster of similar dis-
ease had occurred elsewhere in the community, the epidemiologists focused atten-
tion only on those who bought food from the pizzeria. The logical hypothesis then
was that the exposure necessary to develop nausea, vomiting, and diarrhea was
consumption of some food(s) contaminated with a microbial or chemical agent.
Therefore, those who bought and ate food from the pizzeria on the presumed day
of exposure were given a questionnaire asking what beverages and kinds of foods
and pizza they had eaten; that is, what foods had they been exposed to. Early
analysis showed that 100% of the ill persons (cases) had eaten mushrooms on
pizza. Because so many ill people had eaten these pizzas, one might quickly
assume it was the contaminated food. Yet the 100% simply represents how popu-
lar the mushroom pizza was among the ill attendees. Alone, the 100% does not
give adequate valid support to the hypothesis that exposure to the pizza (i.e.,
eating the mushroom-topped pizza) caused illness. What had to be done was to
determine the food histories of the well pizza eaters (controls) and compare their
histories to the ill persons. When this comparison was done, the food histories
were very similar between the two groups except for one food, the mushroom
pizzas: only 33% of the well attendees ate the mushroom-topped pizza. The
hypothesis, then, was that the difference in exposure rates—100% among the ill
and 33% among the well—was because the mushroom pizza was contaminated.
When these rates were tested statistically, it showed that, assuming that eating the
particular pizza had no relation to getting ill, such a difference would occur less
than one time in 10,000 such instances. Therefore, the statistical evidence as well
as other information (isolation of S. aureus from cans of mushrooms) supported
the hypothesis that eating the mushroom pizza was the exposure that caused the
outbreak.
Again, this phase of the investigation clearly will pose the greatest challenge.
Field epidemiologists must review the findings carefully; weigh the clinical, labo-
ratory, and epidemiologic features of the disease; and hypothesize possible expo-
sures that could plausibly cause disease. In other words, you must seek from the
patients’ histories exposures that could conceivably predispose them to illness. If
exposure histories for ill and well are not significantly different, a new hypothesis
must be developed. This will require imagination, perseverance, and sometimes
resurveying those at risk to obtain more pertinent information.

Compare the Hypothesis with the Established Facts

At this time in the investigation, epidemiologic and statistical inferences have


provided the most probable exposure responsible for the epidemic. Yet you must
“square” the hypothesis with the clinical, laboratory, and other epidemiologic
facts of the investigation. In other words, do the proposed exposure, mode of
92 The Field Investigation

spread, and population affected fit well with the known facts of the disease? For
example, if, in the gastroenteritis outbreak referred to above, the analysis incrimi-
nated a food of high protein and low acid content that supports growth of staphy-
lococcal organisms and production of enterotoxin (as is the case with mushrooms),
the hypothesis fits well with our understanding of staphylococcal food poisoning.
However, if the analysis incriminated coffee or water—highly unlikely sources of
staphylococcal enterotoxin—you must then reassess the findings, perhaps secure
more information, reconsider the clinical diagnosis, and certainly pose and test
new hypotheses. Unfortunately, on rare occasions this reassessment is necessary,
and you should be prepared.
The following investigations illustrate the uses of simple descriptive and ana-
lytic epidemiology, how some analyses may not prove helpful, how posing new
hypotheses may be necessary, how the facts must fit logically, and how important
persistence is in arriving at a defensible conclusion.
Thirty-four cases of perinatal listeriosis and seven cases of adult disease
occurred between March 1 and September 1, 1981, in several maritime provinces
of Canada.5 These cases represented a manifold increase over the number of cases
diagnosed in previous years, suggesting some common exposure. Although
L. monocytogenes is a common cause of abortion and nervous system disease in
cattle, sheep, and goats, the source of human infection has been obscure. Cases
could not be linked together by person-to-person contact; they shared no common
water source; and food exposures, as determined from a general food history,
were not different between cases and controls. However, a second, more detailed
food history and subsequent intensive interrogation of cases and controls revealed
that there was a statistically significant difference between cases and controls
regarding exposure to coleslaw. Even though this food had never been previously
incriminated as a source of listeria, it was the only food item positively associated
with disease and essentially the only lead the investigators had at the time. Armed
with this clue, the team subsequently found a specimen of coleslaw in the refrig-
erator of one of the patients that grew out the same serotype of listeria isolated
from the epidemic cases. No other food items in the refrigerator were positive for
listeria.
The coleslaw had been prepared by a regional manufacturer who had obtained
cabbages and carrots from several wholesale dealers and many local farmers.
Although environmental cultures from the coleslaw plant failed to reveal listeria
organisms, two unopened packages of coleslaw from the plant subsequently grew
L. monocytogenes of the same epidemic serotype. A review of the sources of the
vegetable ingredients was made, and a single farmer was identified who had grown
cabbages and also maintained a flock of sheep. Two of his sheep had previously
died of listeriosis in 1979 and 1981. Also, he was in the habit of using sheep
manure to fertilize his cabbage.
Conducting a Field Investigation 93

This information does not prove this farm was the source of the listeria organ-
isms that caused the epidemic. However, the hypothesis that coleslaw was the
source and the statistical test that supported this hypothesis provided the neces-
sary impetus to continue the investigation. And, ultimately, a single, highly likely
source of the bacteria was discovered. These findings strongly suggest listeriosis
is a zoonotic infection transmitted from infected animals via contaminated
vegetables to humans.
In January and February 1980, an epidemic of 85 cases of salmonellosis in
Ohio prompted an extensive field investigation by Taylor et a1.6 All cases were
caused by an uncommon serotype of salmonella, S. muenchen. This finding plus
the fact that all cases were among teenagers and young adults strongly suggested
a common source of exposure. Knowing that the natural reservoirs for almost all
serotypes are poultry, chicken eggs, and other domestic farm animals and that the
majority of salmonella epidemics can be traced to eating meat or poultry products
or having contact with these animals, Taylor and colleagues questioned the cases
and appropriate controls. Their questions included food histories and contact with
farm animals. Not too surprisingly, the investigators found that significantly more
cases than controls gave a history of eating ham. On the surface this evidence
strongly incriminated ham as the vehicle of infection. However, in trying to define
the source of the contaminated ham, Taylor learned that the ham eaten by the
patients came from five different distributors. How likely is it that one uncommon
serotype would come from five different distributors who, in turn, secured their
ham from different producers? The logic was overwhelming: despite a reasonable
food source of the salmonella and persuasive statistics, the ham was not the source
of the salmonella, and more questioning had to be done.
At this same time, another, identical, epidemic of salmonella was reported in
Michigan. Having more cases to work with and focusing on possible unique char-
acteristics of the teenage/young adult population, the team asked many more
questions of cases and controls, including questions about the use of drugs. To
their great surprise, they found a highly significant association between illness
and smoking marijuana. Although this association seemed as implausible as that
with ham, samples of marijuana smoked by the cases were culture positive for
S. muenchen, strongly incriminating the marijuana as the vehicle of infection.

Plan a More Systematic Study

The actual field investigation and analyses have now been completed, requiring
only a written report (see below). However, because there may be a need to find
more cases, to define better the extent of the epidemic, or to evaluate a new labora-
tory method or case-finding technique, you may want to perform more detailed
and carefully executed studies. With the pressure of the investigation somewhat
94 The Field Investigation

removed, consider surveying the population at risk in a variety of ways to help


improve the quality of data and answer particular questions.
Perhaps the most important reasons to perform such studies are to improve
the sensitivity and specificity of the case definition and establish more accurately
the true number of persons at risk; that is, to improve the quality of numerators
and denominators. For example, serosurveys coupled with a more complete clini-
cal history can often sharpen the accuracy of the case count and define more
clearly those truly at risk of developing disease. Moreover, repeated interviews of
patients with confirmed disease may allow for rough quantification of degrees of
exposure or dose responses—useful information in understanding the pathogen-
esis of certain diseases.

Prepare a Written Report

Frequently, your final responsibility is to prepare a written report to document the


investigation, the findings, and the recommendations (see Chapter 12). There are
several important reasons why a report should be written and written as soon as
possible:

A Document for Action


Sometimes control and prevention efforts will only be taken when a report of
all relevant findings has been written. This can and should place a heavy, but nec-
essary, burden on the field team to complete its work quickly. Even if all possible
cases have not yet been found or some laboratory results are still pending, reason-
able written assumptions and recommendations can usually be made without fear
of retraction or subsequent major change.

A Record of Performance
In this day of input and output measurements, program planning, program
justifications, and performance evaluations, there is often no better record of
accomplishment than a well-written report of a completed field investigation. The
number of investigations performed and the time and resources expended not only
document the magnitude of health problems, changes in disease trends, and the
results of control and prevention efforts, but also serve as concrete evidence of
program justification and needs.

A Document for Potential Medical/Legal Issues


Presumably, epidemiologists investigate epidemics with objective, unbiased,
and scientific purposes and similarly prepare written reports of their findings and
conclusions objectively, honestly, and fairly. Such information may prove absolutely
Conducting a Field Investigation 95

invaluable to consumers, practicing physicians, or local and state health department


officials in any legal action regarding health responsibilities and jurisdictions (see
Chapter 14). In the long run, the health of the public is best served by simple, care-
ful, honest documentation of events and findings made available to all for interpreta-
tion and comment.

Enhancement of the Quality of the Investigation


Although not fully understood and rarely referred to, the actual process of
writing and viewing data in written form often generates new and different thought
processes and associations in one’s mind (see Chapter 12). The discipline of com-
mitting to paper the clinical, laboratory, and epidemiologic findings of an epidemic
investigation almost always will bring to light a better understanding of the natural
unfolding of events and their importance in terms of the natural history and devel-
opment of the epidemic. The actual process of creating scientific prose, summariz-
ing data, and creating tables and figures representing the known established facts
forces you to view the entire series of events in a balanced, rational, and explaina-
ble way. This process is considerably more demanding than preparing an oral
report to give to the local health department the day of departure from the field.
Occasionally, previously unrecognized associations will emerge from a careful,
step-by-step written analysis that may be critically important in the final interpreta-
tion and recommendations. The exercise of writing what was done and what was
found will sometimes uncover facts and events that were more or less assumed to
be true, but not specifically sought for during the investigation. This, in turn, may
stimulate further inquiry and fact finding in order to verify these assumptions.

An Instrument for Teaching Epidemiology


There would hardly be disagreement among epidemiologists that the exer-
cise of writing the results of an investigation constitutes an essential building
block in learning epidemiology. Much the way a lawyer prepares a brief, the epi-
demiologist should know how to organize and present in logical sequence the
important and pertinent findings of an investigation, their quality and validity, and
the scientific inferences that can be made by their written presentation. The simple,
direct, and orderly array of facts and inferences will not only reflect the quality of
the investigation itself but also the writer’s basic understanding and knowledge of
the epidemiologic method.

Execute Control and Prevention Measures


It is not the purpose of this chapter to discuss this aspect of a field investiga-
tion. Nevertheless, the underlying purposes of all epidemic investigations are to
control and/or prevent further disease.
96 The Field Investigation

SUMMARY

The field investigation is a direct application of the epidemiologic method, very


often with an implied and relatively circumscribed timetable. This forces field
epidemiologists to: (1) establish workable case finding techniques; (2) collect data
rapidly but carefully; and (3) describe cases in a general sense regarding the time
and place of occurrence and those primarily affected. Usually, you will know the
agent and its sources and modes of transmission, which will allow you to identify
the source and mode of spread rapidly. However, when the clinical disease is
obscure and/or the origin of the agent ill-defined, you may be hard-pressed to
create a hypothesis that will not only identify the critical exposure and show sta-
tistical significance but will also logically explain the occurrence of the epidemic.
Although you will not be able to prove, scientifically, causation in the strictest
sense, in most instances the careful development of epidemiologic inferences,
coupled with persuasive clinical and laboratory data, will almost always provide
convincing evidence as to why the epidemic occurred. Lastly, a written report
sharpens your communication and epidemiologic skills and provides the health
community with permanent documentation of the investigation.

REFERENCES

1. Centers for Disease Control and Prevention (1977). Unpublished data.


2. Glick, T.H., Gregg, M.B., Berman, B., et al. (1978). Pontiac fever. An epidemic of
unknown etiology in a health department. I. Clinical and epidemiological aspects. Am J
Epidemiol 107, 149–60.
3. Rosenberg, M.D., Hazlet, K.K., Schaefer, J., et al. (1976). Shigellosis from swimming.
JAMA 236, 1849–52.
4. Centers for Disease Control (1989). Multiple outbreaks of staphylococcal food poison-
ing caused by canned mushrooms. MMWR 38, 417–18.
5. Schlech, W.F. III, Lavigne, P.M., Bortobussi, R.A., et al. (1983). Epidemic listeriosis—
evidence for transmission by food. N Engl J Med 308, 203–6.
6. Taylor, D.N., Wachsmith, K., Shangkuan, Y., et al. (1982). Salmonellosis associated
marijuana. A multistate outbreak traced by plasmid fingerprinting. N Engl J Med 306,
1249–53.
6
SURVEYS AND SAMPLING

Joa n M. H e r o l d

A survey is a canvassing of people for the purpose of collecting information.


Surveys are done when there is a question to be answered, and there is no existing
data source to provide the needed information. A survey is a lot of work and
should never be conducted when the information can be obtained more readily
elsewhere. Therefore, it is important to investigate thoroughly the availability of
existing data before undertaking a survey. A good place to start is to contact a
national statistical office, census bureau, ministry of health, or other governmental
organizations that would have knowledge of large data collection efforts and the
availability of existing data.
Surveys can be classified in a number of ways. One distinction is between
a census, or a complete population survey, in which every element in the target
population is included, and a sample survey, in which only a portion of the
target population is selected. A census or complete population survey is
extremely expensive and is rarely used to collect detailed information from a
large population. Even the United States census does not collect detailed infor-
mation from the total population. Instead it asks fewer than 10 questions of the
total population and collects the more detailed census information from a sample
of households. Large health-related surveys are also sample surveys. Only when
the target population is small should you consider doing a complete population
survey.

97
98 The Field Investigation

STEPS IN CARRYING OUT A SURVEY

1. Write a protocol.
2. Select a survey mode.
3. Develop a questionnaire.
4. Design and select the sample.
5. Train interviewers (or prepare for mail-out).
6. Collect data (fieldwork).
7. Enter data into a computer, edit, and process the data.
8. Analyze the data.
9. Write a survey report.

Writing a Protocol

Perhaps more than any other type of data collection, a survey cannot be under-
taken without a protocol or detailed plan. The various steps in survey design are
all interconnected and, therefore, must be thought out carefully prior to beginning
any steps of the survey itself. For example, the budget influences the choice of the
survey mode, sample design, sample size, and length of questionnaire. The analy-
sis plan affects the format of questions, sample design, and sample size. The
sample size influences the mode, analysis, and interpretation of results. The mode
dictates the length and format of the questionnaire. A protocol allows all these
interrelationships to be considered—and they must be considered—before actu-
ally choosing a mode, designing a questionnaire, or selecting a sample. The pro-
tocol should include: Study Objectives; Methodology, including a list of
information to be sought from the survey, survey design, sampling plan, and data
editing plan; Analysis Plan, including the computer software necessary to analyze
the data; Logistics for implementing the survey, including personnel and equip-
ment needed; Budget; and Time Line. Once all these steps have been thoroughly
thought through, you are ready to begin work on the survey.

Selecting a Survey Mode

Surveys can be classified by their mode of data collection. There are mail and
Internet surveys, telephone surveys, and face-to-face interview surveys. Prior to
developing a questionnaire and choosing a sample, the survey mode must be
decided. Each of these modes has its advantages and disadvantages.
Mail, or self-administered, surveys are seldom used to collect information
from the general public because names and addresses usually are not available,
and the response rate tends to be low. However, the method may be highly effec-
tive with members of particular groups, such as members of an HMO or members
Surveys and Sampling 99

of a professional association. The principal advantages of mail surveys are that


they may obtain more thoughtful responses, and they are the least expensive to
implement. The biggest disadvantage of the mail survey is that it typically obtains
a much lower response rate than a telephone or face-to-face interview. A response
rate of 50% is not unusual for a mail survey. Questionnaires that are distributed
and returned by computer share many of the advantages and disadvantages of the
mail survey, including the principal disadvantage of a low response rate. Moreover,
a computer survey is not a good choice for a general population survey in most
countries because of the selectivity of persons who use or own computers.
Sometimes survey data are obtained with self-administered questionnaires that
are not mailed or sent over the Internet but are provided to respondents in person,
such as at a clinic or at a group gathering. If sufficient time is allowed for response
to the questionnaire, this method will have most of the advantages of a mail survey
without the principal disadvantage of a low response rate.
Telephone interviewing is an efficient survey method and has become quite
popular in the United States. Investigations of epidemics frequently rely on tele-
phone surveys because they are quick, inexpensive, and sensitive (i.e., they quickly
reveal whether a problem truly exists). Under good conditions, the response rate
for a telephone survey is better than a mail survey but not as high as that of a face-
to-face interview. Unfortunately, cooperation with telephone surveys by the public
has recently begun to decline, particularly in large cities, as a result of the prolif-
eration of telephone usage for surveys, polls, sales, and the solicitation of dona-
tions. Also, populations with and without telephones may differ, creating a
possible important bias.
A face-to-face interview is often the preferred or only feasible method of
survey data collection. Among its many advantages, the most important is its high
response rate (80%–95%). It also has the advantage of permitting the collection of
more complex and more sensitive information than a mail or telephone survey. It
can tolerate a much longer time for questionnaire administration, thus allowing
for more information to be collected. The principal disadvantage of the face-
to-face interview is the cost: interviewers’ salaries, their transportation, and, at
times, their meals and housing have to be considered. Furthermore, it takes longer
to locate respondents for face-to-face interviews, which extends the time that
interviewers’ salaries, transport, room, and meals must be covered. A second dis-
advantage is the potential for interviewer bias (also a risk in telephone surveys),
but we will see later in this chapter that this can be considerably controlled with
proper selection and training of interviewers.
Surveys may combine these various modes. The telephone may be used to
“screen” for eligible respondents and then to make appointments for face-to-face
interviews. Additionally, mixed mode surveys may use a less expensive method to
start, then switch to a method that yields a higher response rate for those who fail
100 The Field Investigation

to respond to the initial method. The most popular of the mixed mode surveys is
the combined mail and telephone mode. Caution is advised, however, in the use of
mixed mode surveys. Questionnaire construction is usually different for different
survey modes, and this difference creates a measurement problem with mixed
mode approaches. Moreover, potential biases vary depending on the mode, and
this can cause problems in interpreting the results. Therefore, it is highly recom-
mended that you seek the assistance of a survey expert if you choose to use a
mixed mode approach.

Developing a Questionnaire

Writing Questions
The first step in developing a questionnaire is to define the research question
and to list the information that you wish to obtain. A list of information or varia-
bles that you want will help you create the questions that will give that informa-
tion, as well as help you avoid writing unnecessary questions. You will also need
to know the type of analysis you plan to use and the mode of data collection. Your
analysis plan will determine the form of responses to questions. For example, if
you plan to work with proportions, you will want to collect categorical responses.
On the other hand, if you can work with means, you may collect scaled responses.
It is also possible that you want to do a content analysis on qualitative data, in
which case you may seek open-ended responses (see below). The mode of data
collection (mail/Internet, telephone, or face-to-face interview) will affect how the
question is written, what response categories are shown, the length of the ques-
tionnaire, and the overall format of the questionnaire. Here are some general rules
on question writing and questionnaire format.
The question format can be of three types:

1. Structured or closed-ended questions. These are questions that have pre-


determined response categories to choose from. The respondent is told
what the response options are and is asked to choose from among the
options. Multiple-choice and true/false questions are examples of this
format. The structured format is easiest to implement for large samples,
for self-administered questionnaires with hand-written responses, and
when the range of response possibilities is known. A fundamental rule for
writing structured questions is that the response options must be mutually
exclusive and exhaustive. To meet the “exhaustive” criterion, it is often
necessary to include a response option labeled “Other (specify)_____” in
order to allow for responses that were not thought of by the question
writer.
Surveys and Sampling 101

2. Unstructured or open-ended questions. This format allows the respon-


dent to answer in his or her own words. The unstructured question is
useful when the researcher does not know what the range of response
options might be. It may also provide a more accurate response, as it
prevents the respondent from guessing or misinterpreting a response cat-
egory that the researcher has constructed. However, coding and analysis
of answers to open-ended questions can be very difficult and time con-
suming. Open-ended questions, therefore, are to be avoided in large-scale
surveys and by researchers inexperienced with coding or interpreting
qualitative data.
3. Precoded open-ended questions. Open-ended questions that are precoded
are often used in interviewer-assisted surveys. These questions do not pro-
vide answer options to the respondent, but have options written in the
questionnaire for the interviewer to circle or check that correspond to the
respondent’s stated answer. Many precoded open-ended questions will
also require the “Other (specify)_____” option mentioned above for struc-
tured questions.

The interviewer must always be aware that errors in response—both volun-


tary and involuntary, due to misunderstanding, misrepresentation, or faulty
memory—can and will occur. To obtain the most accurate information from a
respondent, several things should be taken into account: (1) questions should be
written as unambiguously as possible; (2) the vocabulary used in question con-
struction should be consistent with the vocabulary of the respondents; (3) if inter-
viewers are involved, they must be trained to avoid influencing the respondent and
to read the question exactly as written so that every interviewee responds to
exactly the same question wording; (4) use as many questions as possible from
previously used questionnaires developed for your target population; (5) field test
the questionnaire to ensure that respondents understand the questions and
concepts in the same way that the researcher does.

Questionnaire Format
The order of questions in the questionnaire varies depending on the mode of
data collection. A questionnaire administered by an interviewer should have some
easy and non-threatening questions to start. Often demographic questions are
asked first to give the respondent an opportunity to get comfortable with the inter-
viewer prior to being asked more difficult or sensitive questions. On the other
hand, a mail/Internet survey should get right to the point, with questions specific
to the principal purpose of the survey at the beginning of the questionnaire. In this
way the respondent’s attention is immediately engaged, and he or she is more
likely to complete and return the questionnaire.
102 The Field Investigation

Threatening or embarrassing questions should be kept to a minimum and


placed toward the end of the questionnaire. If the respondent chooses not to answer
these questions, you will at least have obtained other information asked earlier in
the questionnaire that you can use in analysis.
Avoid asking questions that are not applicable to a particular respondent.
This is done by using filter questions and skip patterns that direct the respondent
to skip over questions that do not pertain to him or her. It is possible to lose
the interest and thoughtfulness of respondents if they feel you are asking
irrelevant questions. Skip patterns may be used frequently in a questionnaire
administered by an interviewer. They are to be used sparingly in a self-
administered questionnaire.
Avoid offering the respondent a “don’t know” option. A questionnaire that is
developed for a personal interview may have “don’t know” categories for all ques-
tions in the questionnaire, with instructions to the interviewer not to read these
options. A questionnaire that is developed for self-administration, on the other
hand, should keep “don’t know” options to a minimum.
Use transition sentences to prepare the respondent for a new topic. Remember
that the data you collect are only as good as your respondent’s interpretation and
memory. Transition sentences allow the respondents to adjust their minds for a
shift in subject matter.
Above all, the questionnaire must be well spaced, clearly typed or printed,
and easy to follow. The placement of response categories for questions should be
consistent throughout the questionnaire. They should be listed vertically and not
horizontally, so they are easily seen. Keep in mind that the easier it is for the eye
to identify the response options, the quicker will be the completion of the ques-
tionnaire, the fewer will be the errors in selecting a response category, and the
fewer will be the errors in reading the response category when entering the data
into the computer.
The questionnaire will need to be reviewed numerous times, by both content
experts and editors. A questionnaire with many errors will produce data with
many errors.
Finally, a cover page is usually advisable for interviewer-administered ques-
tionnaires. The cover page to a questionnaire will have a place for the interviewer
to code the final status of the interview—“completed”; “unable to locate house-
hold or respondent”; “refused”; and other useful categories. It may also have a
place for the interviewer to record date and time of attempts to reach the respond-
ent, which is helpful in scheduling revisits. Most important, the cover page will
also contain information that will allow the interviewer to identify the correct
member of the sample. It may contain an address or name or telephone number of
the potential interviewee along with other identifying information. The purpose of
having identifying information on its own page is so that the page can later be
Surveys and Sampling 103

removed from the questionnaire after fieldwork and data entry are completed. In
this way, the respondent cannot be linked to the answers he or she has provided.

The Pretest
A newly developed questionnaire that has not been used previously in a pop-
ulation must be pretested. A pretest is a form of pilot study to check on the validity
and reliability of the individual questions and the instrument as a whole. In a pre-
test, the final questionnaire is administered, using the mode that will be used in the
actual survey, to a small (usually purposive) sample taken from the same popula-
tion that the final sample is drawn from. It is very important, however, that the
respondents for the pretest not be included in the final sample. Thus the pretest is
usually not conducted until after the final sample has been drawn. Depending on
the length and complexity of the questionnaire, the sample size for a pretest can
vary from 25 to 100 individuals. The pretest should reveal any problem respond-
ents may have in understanding the questions and whether or not there are any
difficulties in following the questionnaire. If the pretest is of sufficient size, it may
also be used to identify questions that may be removed from the questionnaire
because of lack of variability in responses to those items. The pretest of the ques-
tionnaire also affords an opportunity to test other aspects of survey procedures,
such as ability to locate respondents, willingness of prospective respondents to
consent to the interview, the duration of the interview, and so forth.

Selecting a Sample

To Sample or Not to Sample


Seldom do public health budgets have the resources for complete population
surveys. Therefore, sampling methods are used to obtain information from a
smaller number than the total population. When a large population is involved,
well-designed sampling will usually provide better data than a census-type survey.
Given an always limited budget, a few reliable, well-trained interviewers working
on a properly selected sample of the population can obtain more accurate informa-
tion than would be possible for a larger team of less–well-trained field staff trying
to interview all members of a population. Sampling does introduce sampling error,
which is inherent to the sampling process. However, with available resources con-
centrated on a sample of a large population, the reduction in interviewer, nonre-
sponse, and other errors that would come about from resources spread too thin
will more than compensate for the introduction of sampling error.
Proper sampling techniques can provide a measure of the amount of error
produced by the sampling process. Any estimate made from a sample is subject to
error, but sampling errors have the favorable characteristic of being controllable
104 The Field Investigation

through the size and design of the sample. Sampling errors, even for small sam-
ples, are often the least of the errors present in a survey. (See below for a listing of
other sources of error.)
Nevertheless, it is important to keep in mind that, for a small, geographically
concentrated population, it may be possible to do a complete or census-type
survey. For example, an outbreak in a small village or at a church supper may be
best studied by surveying everyone in those small populations and thus completely
avoiding sampling error.

Types of Samples
Sampling error cannot be calculated for all samples. Our ability to calculate
sampling error depends on the type of sampling employed. There are two broad
types of sampling used in sample surveys: probability sampling and nonprobability
sampling. Probability sampling uses statistical theory in the design of the sample
and, consequently, permits the calculation of sampling error. Probability sampling
is the selection of a sample such that every member in the population has a known
and nonzero probability of being included. This type of sampling is unbiased and
enables you to draw valid conclusions about the population from which your
sample is drawn. Nonprobability sampling is not based on statistical theory. It is a
type of sampling that is inherently biased and does not permit the calculation of
sampling error. Nonprobability samples include purposive samples, convenience
samples, and the like.
Purposive (or judgment) sampling is the selection of a sample based on some-
one’s judgment and knowledge of the subject matter. This type of sampling is
biased and generally used only when there is no time to define a probability sample.
An example might be the selection of community leaders in a refugee camp in such
a way as to try to get maximum representation of the various ethnic groups residing
there when the target population are all refugees in the camp. The community
leaders would then be asked questions about the members of their community.
Convenience sampling is the use of a sample that is near at hand. Such a
sample is inherently biased by the fact that it includes only persons that happen to
be out and about or taking a specific route or engaged in a specific activity at the
time of the survey. Route samples, street-corner political surveys, or a sample
based on persons coming into a clinic are convenience samples when the target
population is the resident population of a given area.
On occasions when the goal of a study is not to make statistical estimates
about a population but rather to explore ideas and opinions of people about a new
topic that may not be ready for a quantitative investigation, convenience samples
may be very useful. They can provide ideas about people’s thoughts and opinions
and can be used to generate hypotheses for further study. But any study that wishes
to produce statistics about the total population must use probability sampling.
Surveys and Sampling 105

Probability Sampling
As stated before, a probability sample is one in which every member of the
population has a known and nonzero probability of being selected into the sample.
A special case of the probability sample is the random sample, where each member
of the population has an equal chance of being selected. The vast majority of the
statistical tests we use carry with them the assumption that the sample has been
randomly selected. While the selection of a random sample may not always be
feasible, if we know the probability of selection of every member of the popula-
tion, we can make adjustments to the data (through computer programs) to account
for the differences between our probability sample and a strictly random sample.
If we do not meet the criteria of a probability sample, we cannot draw conclusions
about the population using standard significance tests and confidence intervals.
To draw a random sample you need to have a list of all members of the
population from which the sample is to be drawn. This list is called a sampling
frame. It is important that this frame be current and accurate. For example, when
drawing a sample of college students, you will want a list of current students and
not a list of those attending the college a year ago. When drawing a sample of
housing units in a town, you will not want to use a list of housing units identified
at the previous census eight years ago. We often fail to realize that our sample is
only as good as the sampling frame from which it is selected. It is, therefore, very
important to obtain an updated sampling frame that lists all elements of the popu-
lation as close to the survey date as possible. If none is available, it is up to you,
the survey implementer, to add to your budget the personnel and materials neces-
sary to produce a current sampling frame. If you have to create a sampling frame
for your sample, pay close attention to cluster sampling, described below.

Probability Sample Designs


Simple random sampling gives every member of the population an equal
chance of being included in the sample. It requires a listing of every member of
the population. Once all members of the population are assigned a number, a table
of random numbers may be used to select individuals for the sample. Simple
random sampling is theoretically simple, but often unrealistic in practice, because
it can be expensive and may present logistical difficulties such as geographic dis-
persion of the study sample. Since no control of the distribution of the sample is
exercised in this case, the variables in some samples may be poorly distributed
(not biased, but unrepresentative). Therefore, simple random sampling is not
always desirable. The principle of simple random sampling, however, is the basis
of all good sampling techniques and can be utilized in each of the following more
specialized designs.
Systematic sampling is often used when elements (e.g., individuals or house-
holds) can be ordered or listed in some manner. Rather than selecting all elements
106 The Field Investigation

randomly, one determines a selection interval (n), by dividing the total population
listed by the sample size. The sampler then chooses a random starting point on the
population list, and selects every nth person (the length of the selection interval).
Good geographic or strata distribution can be assured if the population is listed
according to geographic area or other stratifying characteristic. It is an easy
method to apply and a popular one among public health professionals.
In stratified sampling, the target population is divided into suitable, non-
overlapping subpopulations or strata. Each stratum should be homogeneous within
and heterogeneous between other strata. A random sample can then be selected
within each stratum. In this way, each stratum is more accurately represented, and
since members are more alike within each stratum, the overall sampling error is
reduced. Separate estimates can be obtained from each stratum, and an overall
estimate can be obtained for the entire population defined by the strata. The sample
selection for each stratum is further defined by whether it is proportionate or
disproportionate across strata. Proportionate stratified sampling uses the same
sampling fraction that is calculated for the total population (sample size divided
by the total population size) for selecting a sample from each stratum.
Disproportionate stratified sampling uses different sampling fractions across strata
in an attempt to get sufficient numbers of elements to make separate statistical
estimates for each stratum. Disproportionate sampling is the method used when
“oversampling” of a particular stratum is done. This method frequently is used to
get sufficient representation of minority ethnic groups and to enable independent
estimates of characteristics by ethnicity. While disproportionate stratified sampling
allows for sufficient sample size within each stratum to make stratum-specific esti-
mates with relatively equal precision, it requires the extra step of weighting the
data when estimates are made for the total population, or all strata combined.
Cluster sampling is of particular value to save resources in surveys of human
populations when the population is geographically dispersed or when a sampling
frame for the elements of the population you wish to study is not available. In this
type of sampling, the units first sampled are not the individual elements we are ulti-
mately interested in, but, rather, clusters or aggregates of those elements. For exam-
ple, in sampling the population of a rural area that is widely dispersed and difficult
to reach, a sample of villages may be selected, and then all of the households in the
sampled villages may be included in the survey. It is apparent that such a sample
involves less traveling than a simple random sample of households throughout the
rural area. Another typical example is in a study of schoolchildren, when a list of all
children attending schools in an area is not available. One would then use a list of
schools, and select a sample of schools from the list. In this case, schools are the
sampling unit or clusters. Once the sample of schools has been selected, all of the
students in the sampled schools may be surveyed. This type of sampling almost
always loses some degree of precision. To maintain the same degree of precision as
Surveys and Sampling 107

in simple random sampling, one would have to approximately double the sample
size that would be calculated for a simple random sample.
Multistage sampling involves sampling at different levels of population
groupings. It is most often used in surveys where cluster sampling is necessary. In
the cases given in the previous paragraph, for example, if one were to sample the
households in the selected villages, or sample the children in the selected schools,
there would be two levels of sampling involved, and they would demonstrate a
two-stage sample design. The first stage would be the selection of a sample of vil-
lages or schools, and the second stage would be the selection of a sample of
households or students. Both of these examples, however, may be converted to
three-stage designs. If, in the example of the population of rural areas, we were
first to select a sample of villages (clusters), then select a sample of households
(clusters) in each selected village, and finally select one adult (final sampling unit)
in each of the sampled households, we would have a three-stage sample design.
With respect to the children attending school, our first stage would be the selec-
tion of schools (clusters), the second stage might be the selection of a sample of
classes or grades (clusters) in the selected schools, and the third stage would be
the selection of a sample of students (final sampling unit) in the classes. Again, we
would have a three-stage design. An obvious advantage in the school example is
that you need only a listing of schools, classes within the selected schools,
and students in the selected classes. You have bypassed the need for a list of all
children attending school!
Most national surveys involve multistage sampling, with geographically
defined clusters being the first stage or the primary sampling unit. This is, in part,
because of the prohibitive cost of dispersing interviewers across a broad geo-
graphic area, but more important, it is due to many countries’ not having a list of
all members of their population. The United States is an example. The United
States does not have a list of all members of its population. Instead it has a list of
census tracts. To conduct a sample survey for the U.S. population, one would have
to first select census tracts from a list provided by the Census Bureau, then update
the sampling frame for the selected tracts by mapping out the number and location
of housing units in those tracts (unless that had been done with a recent census or
survey), then select housing units from the updated frame, and finally select people
living in the selected housing units.

Sample Size
Ideally, the sample size chosen for a survey should be based on how reliable
the final estimates must be. In practice, usually a trade-off is made between the
ideal sample size and the expected cost of the survey. The size of the sample must
be sufficient to accomplish the purpose but should not be larger than necessary,
because it will draw resources from other aspects of the survey process.
108 The Field Investigation

Sample size is determined by the desired confidence level and precision of your
estimates and the variability of the characteristic being measured for the population.
The formula for calculating the sample size needed to estimate a proportion is:

n = z2 pq/d 2

where,

n = the sample size


z = the standard normal deviate (1.96 for a 95% confidence
level)
d = the level of accuracy desired, or sampling error
(often set at .05)
p = the proportion of the population having the characteristic
being measured (if proportion is unknown, set p = .50,
which is maximum variability)
q = the proportion of the population that does not have the
characteristic (i.e., 1− p)

If the total population from which the sample is to be drawn is less than
10,000, then the size of the population must also be taken into account. Thus,
for a population of size 10,000 or greater, n, above, is the final sample size; for
populations less than 10,000, the following adjustment must be made:

nf = n/1+(n/N)

where,

nf = the final sample size, when population is less than 10,000


n = the sample size for populations of 10,000 or more
N = the size of the total population from which the sample
is drawn

The above formulas may be easily modified when the estimates of interest
are means rather than proportions. As stated, these formulas are the basic ones for
simple random sampling. However, we know that in reality we often use stratified
or multistage sampling methods. Adjustments to these formulas are necessary for
these more complex designs or for more complex analysis than estimating propor-
tions and means. Under such circumstances it is best to consult a statistician. If
one is not easily available, some rules of thumb that may come in handy are:
(1) for cluster designs, you will want to double the calculated sample size for a
simple random sample; (2) for disproportionate stratified samples, you will want
to calculate a sample size for each stratum.
Surveys and Sampling 109

Once a sample size is calculated, it must be appraised to see whether it is


consistent with the resources available to conduct the survey. This appraisal
demands an estimation of the personnel, materials, and time required to pursue the
proposed sample size. It often becomes apparent that the calculated sample size
has to be reduced. The usual loss is through increasing sampling error and losing
precision in your estimates. If this happens, you are faced with the decision of
whether to proceed with reduced precision or whether to abandon efforts until
more resources can be found. On the positive side, however, is that if you conduct
the survey and find less variability in your characteristics of interest than you
estimated for your sample size calculations, your precision will be improved.

Preparing for Fieldwork


This section focuses on procedures relevant to face-to-face surveys. In field
epidemiology, this is the mode you are likely to use, and the training of interview-
ers is the paramount feature for putting this type of survey into motion. You have
spent time and effort in developing a good questionnaire and a representative
sample of your target population, but your work can be all for naught with a casu-
ally selected and poorly trained group of interviewers. Remember, the interviewers
are collecting your data!
You will want interviewers who are most likely to elicit honest responses
from the respondents. You do not want high-ranking people whose status may
influence the respondent to respond favorably (and untruthfully) to questions.
Instead, choose interviewers who interact well with people and who are empa-
thetic and unthreatening to the respondent. For certain situations, it may be prefer-
able to have interviewers with similar social or demographic characteristics to the
respondents, such as gender, age, or ethnicity.
Interviewers should be thoroughly trained in the following matters:

1. How to find the correct households or sample points. Detailed instructions


on the importance of keeping to the sample design and how to locate
the selected households or persons must be given. Often maps of survey
areas are involved, and interviewers must be well trained in how to read
the maps.
2. How to approach the respondent to assure they agree to be interviewed.
This includes introducing oneself, specifying the value of the survey, and
the authority behind the survey.
3. How to inform the respondent of the anonymity and confidentiality of
their participation. The fact that the respondent’s identification will be
eliminated from the data, if this is the case, is important to convey.
4. How to introduce a consent form, if applicable, and obtain a signature
(see Chapter 14).
110 The Field Investigation

5. How to administer the questionnaire so that question wording is not


changed from one interview to the next. This is best done by strong
instructions to read the question and to resist the temptation of stating
the question in the interviewer’s own words.
6. How to define the terms used in the questionnaire, so that all respondents
receive the same explanation of terms.
7. How to deal with new situations. It is important for the interviewer to
consult with a supervisor about any new situations that arise in the field,
especially those involving errors in the questionnaire or the interview
procedure. Decisions in such situations should be made by, or communi-
cated to, a field supervisor, so that determinations can be standardized
across all interviewers.
8. How to administer the questionnaire. Sufficient practice sessions
are needed to ensure adherence to skip patterns and other issues related
to filling out the questionnaire, as well as to other procedures listed
above.
9. How to dress for interviewing so the respondent feels at ease in the pres-
ence of the interviewer.
10. How to review the completed questionnaire after the interview has taken
place to check for accuracy, consistency, and completeness in the field.
At this point, there still is the opportunity for the interviewer to return to
the respondent if there are any errors that must be corrected. For large-
scale surveys, it is best to have supervisors in the field with the inter-
viewers, one of whose tasks would be to review questionnaires.
11. The importance of the information they are gathering, to adhering to the
sample design, to finding the respondent, to minimizing refusals, and of
their contribution to the overall survey effort. The few additional hours
required to explain to the interviewers the use of the data, the work that
has gone into the survey thus far, and the value of the representative
sample, is time well spent.

Interviewer training should comprise both classroom and field training. It is


critical that interviewers not practice on members of the actual sample. A day or
two of supervised practice interviews in the field can do much to assure quality
data collection when the real fieldwork begins.
It is also recommended that a reference manual or interviewer’s manual be
developed that contains all the interviewer instructions for the fieldwork, includ-
ing how to locate the sample points, definitions, and such.
Preparation for fieldwork also includes instruction on revisits to households
or other places where respondents are to be found, in order to keep to a minimum
the number of members of the sample that are not located.
Surveys and Sampling 111

When fieldwork is about to begin, the following supplies will be needed for
the interviewers:

1. Sufficient supplies of questionnaires, pencils, and pencil sharpeners.


(Pencils are easier to use because of erasures that are often needed during
the interview.)
2. Any cards or pictures that may accompany the questionnaire.
3. Identification of the interviewer via a letter and/or an ID card.
4. A clipboard to make it easier to fill out the questionnaire.
5. A copy of the reference manual.
6. Maps or instructions on how to locate the respondents.

Response Rate

A response rate needs to be calculated at the end of every survey. The response
rate is simply the number of completed questionnaires divided by the number of
people in your original sample. Often survey directors will report other rates,
using a smaller denominator, such as the number of people from the original
sample who were actually located, or the number of people who answered their
telephone, or the number of mailed questionnaires that actually reached a correct
address. These rates are not true response rates. They are simply ways of avoid-
ing having to report a response rate that may not have been as high as desired.
Note that nonresponse is not simply a function of the number of refusals obtained,
but also the number of sample points that were never located. Therefore, the
response rate reflects not only the compliance of the population contacted, but
also the skill of the survey personnel in finding the members of the selected
sample.

Entering and Editing the Data

Depending on the duration of fieldwork, the collected data may be entered into
a computer while data collection is taking place or at the completion of data
collection.
Data entry is a stage of survey work when many errors can occur. In the past,
the standard way of checking for data entry error was to require double entry.
Double entry simply means the data are entered twice, by different enterers. Then
the two sets of data are compared (by computer), and if disagreement in the data
is found between the two data sets, the original questionnaire is consulted and the
incorrect code is corrected. Double data entry is both costly and time-consuming.
Fortunately, there is less need for it today because of the proliferation of data
entry/edit programs.
112 The Field Investigation

As can be deduced from the previous paragraph, in the recent past, data entry
and data editing were two separate activities. Today, there are numerous computer
programs that accomplish editing of data entry error concurrent with data entry.
One such program is Epi Info (see Chapter 7). These programs usually reproduce
the questions from the questionnaire on the computer screen and allow movement
from one question to the next only if an acceptable entry is made. An acceptable
entry may be defined by allowable codes or by following the appropriate skip pat-
tern. An example of allowable codes may be an age range of 15 to 49 for a repro-
ductive health survey. If the data entry person attempts to enter a 52 as the response
for age, the computer will not accept it. Or, if there are five response categories for
educational level, coded 1 to 5, the computer will only accept an entry in the 1 to 5
range. If the computer entry person mistakenly enters a 6, the computer will not
move on to the next question until it is corrected. Such a data entry/edit program
can identify the majority of data entry errors and consequently obviate the need
for double data entry. In the absence of an entry/edit program, double data entry
may be called for.
The data entry/edit program, however, does not identify all errors, and it
cannot correct all errors. A mis-keyed code that falls within the range of accepta-
ble codes will not be caught. Furthermore, any errors that are in the questionnaire,
and not due to data entry, cannot be corrected by the data entry person. The latter
errors can only be corrected by the interviewer and often not without returning to
the individual respondent. This usually is only done if data entry is timed close to
the original interview.
Once sufficient data have been entered into the computer, other edits can be
done. Consistency checks that may not have been easily programmed into the data
entry/edit program may be written and run on the data (see Chapter 7). And when
all the data have been entered, a set of frequencies for all the items in the question-
naire should be produced for further scrutiny for previously undetected errors.
After all the data have been entered and edited and there is no possibility of
returning to the field, the cover sheets with identifying information on the respond-
ents should be destroyed, as well as any other material (such as lists) that can
identify participants in the survey. The questionnaires themselves should be
kept—at least through the initial stages of analysis. Consistency errors may still
be discovered during the analysis phase, and it is always helpful to be able to
return to the original questionnaires.

Analyzing the Data

Principles of data analysis are described elsewhere in this book (see Chapter 10).
The analysis consideration unique to survey data, however, is the importance of
using the appropriate statistical techniques to adjust for the sample design and to
Surveys and Sampling 113

calculate sampling errors. As mentioned earlier, when disproportionate stratified


sampling is used, weights must be calculated and used when producing any statis-
tics, including percentages, for the total sample. Most popular statistical pack-
ages, such as Statistical Analysis System (SAS), Epi Info, and Statistical Programs
for the Social Sciences (SPSS) accommodate weights very nicely for producing
descriptive statistics. When calculating sampling error, statistical significance,
and confidence intervals, however, for any sample design other than simple
random or systematic sampling, it will be necessary to use a statistical package
that can adjust for the design effect. The most common package with this ability
is Survey Data Analysis (SUDAAN), but others are available as well.

Reporting the Results

As in all epidemiologic work, the survey should be described in a written report.


The report should include the survey’s objectives, methods, results, and your
interpretation of the findings. The report serves two purposes: (1) to document the
methods used to conduct the survey; and (2) to communicate to decision makers,
such as policy makers, funding sources, and program managers, the findings of
the survey. Thus, you should keep in mind that you are writing for two very dis-
tinct audiences. A detailed description of your methods is of paramount impor-
tance to demonstrate to other researchers and users of the data that your data
collection was sound and your results are reliable. (Be sure to include the response
rate!) Your description of findings, on the other hand, must be clear and appropri-
ate for decision makers who may be neither epidemiologists nor statisticians.
Percentages and means may be the best way to communicate to this audience.
Bear in mind that the findings must be presented in a way that is understandable
to non-researchers.

SOURCES OF ERROR

All along the route of survey implementation there are places for error to
contaminate the data. While it is not possible to eliminate all error, you must be
cognizant of potential error, must attempt to keep it at a minimum, and when all
else fails, be prepared to define the bias that error may cause in the data. When
conducting a survey, the following broad areas for error must be foremost in your
mind as the survey planner and implementer.

1. Coverage error. Coverage error occurs when the population from which
the sample is drawn is not equivalent to the target population. This usually
results from outdated or poorly constructed sampling frames. It can also
114 The Field Investigation

occur from incorrect information included in the sampling frame, such as


incorrect addresses; or from an incomplete frame, such as only those
households with computers or telephones when the target population is
the total population. Attention must be given to the quality of the sam-
pling frame and its close equivalence to the target population before a
sample is drawn. If coverage error is not discovered until after the survey
is implemented, you should report the bias caused by coverage error and
its effect on interpretation of findings.
2. Sampling error. Sampling error is the least problematic in field surveys in
that it is quantifiable and unbiased. As stated earlier, sampling error is
linked to both the design and size of the sample. All sample surveys have
sampling error.
3. Measurement error. Measurement error may be the most difficult to avoid.
It often goes undetected and is nonquantifiable. Measurement error arises
from various sources in the data collection process and is the error that
makes a single respondent’s answer incomparable to another’s. Questions
that are not clear or not interpreted in the same way by all respondents
may not be measuring what you intend to measure for all respondents.
Interviewers who are not consistent in the way they present questions or
in the definitions they provide to respondents will create error, in that dif-
ferent respondents will have a different understanding of the question.
Questions that are embarrassing or threatening or interviewers who are
authority figures can evoke untruthful responses from interviewees.
Questions that ask about events in the past may lead to recall bias that
varies directly with the length of time that has passed since the event
occurred.
4. Error due to nonresponse. This may be the most serious and most easily
avoidable error in performing field surveys. Ask yourself, “What is the
value of a carefully selected sample, designed to be representative of the
population, when a response rate of 50% is obtained?” If only 50% of
your sample has responded, you are very likely to have lost the represen-
tative properties of your sample design. Nonresponse can be attributed to
two major factors: (1) failure of the interviewer to locate the respondent;
and (2) failure of the respondent to consent to the interview. Both of the
factors are controllable to a large degree by good selection and training of
interviewers. At least three revisits should be made to households or other
locations before assigning the status of “unable to locate respondent” to
the interview. Often five to six revisits are recommended. As for “refused
to participate,” when surveying during a field investigation, you should
not expect the level of refusal rate you would likely see in political, mar-
keting, or other types of surveys. If you explain the health value of the
Surveys and Sampling 115

survey to the prospective respondents, it is usually not difficult to obtain


their consent. A face-to-face survey, the mode that typically obtains the
highest response rate, should never result in a response rate lower than
70%. An 80% to 90% response rate is not unusual for a face-to-face public
health survey. In the case of a response rate lower than 80%, you are
obliged to consider whether nonresponse has created a bias in the data and
the direction of that bias. Keep in mind that respondents who are easily
located may have different characteristics than those who are never at
home. Persons who refuse to participate in the survey are likely to be less
compliant in other areas, including health behaviors, than those who read-
ily consent to be interviewed. A low response rate does more damage in
rendering a survey’s results questionable than merely reducing the sample
size, since often there is no valid way of scientifically inferring all the
characteristics of the nonrespondent population.
5. Data processing error. In the past, data entry was another significant
source of error in surveys. But today the use of data entry/edit programs
has reduced data entry error substantially. Another source of processing
error still needs attention: that of coding. In surveys with reasonably large
sample sizes that have open-ended questions in the questionnaire, it will
be necessary to code these responses in order to manage them. The coding
of open-ended responses should never be left to an unsupervised assistant.
Coding takes skill and often the experience of a veteran investigator.

SHORTCUTS TO AVOID

Conducting a successful survey entails scores of activities, each of which must


be carefully planned and controlled. Taking shortcuts can invalidate the results
or cause them to be seriously misleading. Four of the shortcuts that occur too
often are:

1. Failure to use probability sampling procedures. One way to greatly reduce


the usefulness of an otherwise well-conceived survey is to use a conven-
ience sample rather than one based on probability design. It may be easy
and cheap, for example, to get some needed information by selecting a
sample of patients attending a public clinic one afternoon. However, this
sampling procedure could give incorrect results if you attempt to general-
ize them to all clinic attendees.
2. Failure to pretest to the questionnaire. No qualified investigator will accept
your results if they are based on newly formulated questions that have not
116 The Field Investigation

been pretested. The pretest not only demonstrates whether or not the
target population understands the questions in the same way as the person
who created them but also offers an opportunity to identify errors in the
questionnaire.
3. Failure to train the interviewers thoroughly. Interviewers not only need to
learn to conduct the interviews in a standardized fashion but they must
also be taught the importance of locating the correct respondent and
persuading that person to be interviewed. A week or two of interviewer
training is not unreasonable for a large-scale survey.
4. Failure to use adequate quality control procedures. You should build into
your survey necessary checks on its different facets at all stages—review
of sample selection procedures, supervision of interviewing, random
checks that interviews have actually taken place, and oversight of editing
and coding decisions, among other things. Insisting on proper standards
in recruitment and training of survey personnel helps a great deal, but
equally important are proper review, verification, and evaluation to ensure
that the execution of the survey corresponds to its design. Without proper
quality control of all steps in the survey process, errors can occur that can
be irreversible, costly, and have damaging results.

REFERENCES AND FURTHER READINGS

Survey Methods
1. Abramson, J.H. (1974). Survey Methods in Community Medicine. Churchill Livingstone,
Edinburgh and London.
2. Couper, M.P., Baker, R.P., Bethlehem, J.,et al. (1998). Computer Assisted Survey
Information Collection. John Wiley and Sons, New York.
3. Dillman, D.A. (1978). Mail and Telephone Surveys: The Total Design Method. John
Wiley and Sons, New York.
4. Dillman, D. (2002). Mail and Internet Surveys: The Tailored Design Method. John
Wiley and Sons, New York.
5. Fowler, F.J. (2002). Survey Research Methods, 3rd ed., Sage Publications, Thousand
Oaks, Calif.
6. Groves, R.M., Fowler, F.J., Couper, M.P., et al. (2004). Survey Methodology. John Wiley
and Sons, Hoboken, N.J.
7. Lessler, J., Kalsbeek, W. (1992). Nonsampling Error in Surveys. John Wiley and Sons,
New York.
8. Rossi, P.H., Wright, J.D., Anderson, A.B. (1983). Handbook of Survey Research.
Academic Press, Orlando, Fla.
9. Salant, P., Dillman, D.A. (1994). How to Conduct Your Own Survey. John Wiley and
Sons, New York.
Surveys and Sampling 117

Questionnaire Design and Interviewing


1. Beimer, P., Groves, R.M., Lyberg, L.E., et al. (1991). Measurement Errors in Surveys.
John Wiley and Sons, New York.
2. Belson, W.A. (1981). The Design and Understanding of Survey Questions. Gower,
Aldershot, England.
3. Converse, J., Presser, S. (1986). Survey Questions. Sage Publications, Beverly Hills,
Calif.
4. Fowler, F.J., Mangione, T.W. (1990). Standardized Survey Interviewing: Minimizing
Interviewer Related Error. Sage Publications, Newbury Park, Calif.
5. Groves, R.M., Dillman, D.A., Eltinge, J., et al. (2002). Survey Nonresponse. John Wiley
and Sons, New York
6. Sudman, S., Bradburn, N.M. (1982). Asking Questions: A Practical Guide to
Questionnaire Design. Jossey-Bass, San Francisco.
7. Sudman, S., Bradburn, N., Schwartz, N. (1996). Thinking about Answers: The
Application of Cognitive Processes to Survey Methodology. Jossey-Bass, San
Francisco.

Sampling
1. Cochran, W.G. (1977). Sampling Techniques, 3rd ed., John Wiley and Sons, New York.
2. Kish, L. (1965). Survey Sampling. John Wiley and Sons, New York.
3. Levy, P.S., Lemeshow, S. (1980). Sampling for Health Professionals. Lifetime Learning
Publications, Belmont, Calif.
4. Lohr, S. (1999). Sampling: design and analysis. Duxbury Press, Pacific Grove, Calif.
5. World Health Organization (1986). Sample Size Determination. World Health
Organization, Geneva.
7
USING A COMPUTER FOR FIELD
INVESTIGATIONS

An d r e w G . D e a n a nd C o nsue l o M. Bec k - Sagué

Computers are increasingly important tools for epidemiologic field investigations.


Epidemiologists routinely use computers in field investigations along with ques-
tionnaires, statistics, laboratory tests, and other essential epidemiologic tools.
Computers, whether laptop, desktop, or palmtop, are machines, and, like
most machines, require an investment of technical skill and setup time that must
be balanced against the anticipated increase in quantity and quality of output.
Computers are most useful for:

• Tasks that are clearly defined and that will be done many times in the
same way
• Rapid computation or counting involving large numbers of similar records
• Tasks matching the capabilities of existing software
• Numerically intensive calculations
• Accurate retention of details
• Investigators who have used the same system before

Manual processing is still indicated for:

• One-time or occasional tasks


• Small numbers of records
118
Using a Computer for Field Investigations 119

• Complex or changing tasks requiring human judgment, perhaps prior to


computer entry
• Operators who are not familiar with computer use
• Situations where staffing for manual tasks is easier to obtain than computers
or knowledgeable operators

Tasks that may be usefully performed on a computer during an outbreak


investigation include searching for information, sample size calculation, question-
naire design, data entry, importing or exporting files in various formats, tabulation
of results, statistical calculations, graphing, mapping, presentation graphics, and
computer communication.

MICROCOMPUTERS

Progress in the miniaturization of computers has been nearly miraculous in the past
three decades, and a description of microcomputer hardware is sure to be outdated
as soon as it is printed. At present a portable computer and a printer can be carried
to the field in a briefcase and operated either from batteries or standard electrical
power. Palmtop computers that fit in a pocket and do not require a keyboard are
becoming popular, although they are still limited compared with laptop models.
A laptop or desktop computer may have a hard disk capable of storing millions of
records. Portable modems make it technically possible to send files, access biblio-
graphical databases, or search the Internet from any area with cable or telephone
Internet service, although some countries place restrictions on modem use. Wireless
connections are rapidly becoming available in some areas, and useful work can be
performed from “Internet cafés” if private connections are not available.
The most common type of microcomputer is the Intel-compatible computer
with a Microsoft Windows® operating system. There are more than 500 million
copies of Microsoft Windows in the world, at least 22% of which are pirated.1
Since microcomputers running some form of Microsoft Windows are ubiquitous
and also permit fairly easy development of software, most epidemiologic software
is available for these models. Macintosh and Linux computers require different
software, but browsers in all three systems can access the Internet for searching,
communication, and calculation. Windows programs can be run within or beside
the other operating systems using Windows emulators or “dual boot” systems.
Documents and spreadsheets can be created, edited, and shared on the Internet using
only a browser, thus allowing those with different types of computer operating
systems to participate.
Laptop computers are more expensive than desktop models of the same
capacity but are fairly rugged and light enough to carry, and most models easily

You might also like