Professional Documents
Culture Documents
Public Health Delivery The Role of Informatics and Technology
Public Health Delivery The Role of Informatics and Technology
Review Paper
Public health delivery in the information age: the role of informatics and technology
Copyright © Royal Society for Public Health 2019 Month 2019 Vol XX No X l Perspectives in Public Health 1
SAGE Publications
ISSN 1757-9139 DOI: 10.1177/1757913918802308
Review Paper
Public health delivery in the information age: the role of informatics and technology
Application of informatics and systems’ readiness and response must proactively engage governmental
information technology in public capacity.6 and non-governmental stakeholders to
health In support of this argument, the World maintain robust health information
Over the last two decades, public health Business Council for Sustainable systems and disaster management plans
and medical care systems have Development (WBCSD) noted that along with surge capacity. Nonetheless,
embraced information technology (IT) as ‘nearly everyone agrees that the way we this can only be achieved through the
a powerful revolutionary tool for manage health today is unsustainable’.7 implementation and availability of an
engagement, change enhancement, It costs more than we can afford and operational information system. Hence,
improvement, and health promotion. delivers less than we expect.7 If the the purpose of this systematic review
Public health agencies use various current public health system is to flourish was to evaluate the development and
information systems to improve real-time in the coming age of uncertain resources use of informatics (public health
surveillance systems, prompt effective and increased demand, then it requires informatics (PHI)), and IT tools and its
communication of warning systems, data redesign and implementation of new impact on public health delivery.
collection, and sharing of information.2,3 systems that are both not sustainable
According to the disease control priorities and reliable in real-time.8,9 To be
Methods
project (DCP2) report, global pandemic prepared and respond to outbreaks like
Data sources
outbreaks such as severe acute Zika, Ebola, H1N1, SARS, and similar
The authors searched six major scientific
respiratory syndrome (SARS), and the re-emerging diseases and disasters, we
electronic databases. The search
influenza A (H1N1) were contained need to invest in the existing public
strategy focused on issues relating to
through the application of rapid health system and strengthen its
public health and informatics or
surveillance and response network information system infrastructure.
technology use over the last decade
systems.2,4 Despite these successes, Furthermore, Bell et al.10 noted that the
(2000–2016). Investigators identified
there is a need for more advanced response to the Ebola outbreak was
studies in MEDLINE, Cumulative Index to
technology that focuses on effective problematic due to poor health
Nursing and Allied Health Literature
collaboration among public health infrastructure, lack of geographic and
(CINAHL) Complete, Cochrane Database
agencies and with other partners to cultural familiarity with the disease, and
of Systematic Reviews, COMPENDEX,
promote adequate epidemic forecasting distrust in government and healthcare
Scopus, and Academic Search Premier.
and communication.5 workers. The major lessons these
The studies were retrieved using
One of the goals of healthy people outbreaks are the need of effective
combinations of the following Medical
2020 is to improve public health and systems to detect and stop infectious
Subject Headings (MeSH) terms only:
strengthen the US national security disease threats, stronger international
public health AND informatics OR public
through global disease detection, surge capacity partnership, improving
health informatics AND information
response, prevention, and control infection prevention and control in
technology OR management information
strategies.3 Global health is important, healthcare settings, IT systems, rigorous
systems. We also systematically
since the health of the US population is training of healthcare workers and
reviewed the reference lists of articles
affected by public health threats and scientists, as well as development of
retrieved. The year of publication was
events that happen across the world. faster reliable laboratory tests and
limited to January 2000– 31 March 2016.
Examples include the Zika and Ebola genetic analysis methods.10–12 In
The earliest publication date of 2000 was
viruses outbreak that began in 2014, the addition, there is the need for a well-
selected because the term ‘Public Health
2009 H1N1 influenza, and the 2003 prepared global response systems and
Informatics’ was entered into the MeSH
SARS epidemic.3 These outbreaks have action strategies that should include
during that time.
shown that there are no borders for short-, medium-, and long-term plans on
deadly pathogens. Moreover, the how to address threats and contain
explosion in the number of emerging future epidemic outbreaks. Inclusion and exclusion criteria
and re-emerging infectious and Similarly, it is necessary to establish Our inclusion criteria were studies on the
communicable diseases calls for and maintain a solid foundation that use of informatics and technology and its
investment and development of consists of core functions for a strong impact on public health delivery between
informatics infrastructure to facilitate public health emergency response before the years 2000 and 2016. We excluded
swift identification, monitoring, a crisis occurs.6 Contingency plans studies that were not published in
management, and containment of global should include robust surveillance and English and those that focused solely on
epidemic. As accurately argued by strong collaborative systems that enable medical or healthcare delivery or health
Duchin,6 Zika and Ebola have exposed easy communication with public health technologies such as electronic medical/
the weaknesses in our public health agencies and experts.6 In addition, the health records (EMRs/EHRs),
system not only in terms of insufficient use of incident management framework computerized physician order entry
investment for preparedness, response is paramount for health emergency (CPOE), clinical decision support system
to disease outbreaks, and other health response. As a result, public health (CDSS), and healthcare automation
threats but also the public health agencies and the medical care system systems.
Public health delivery in the information age: the role of informatics and technology
Public health delivery in the information age: the role of informatics and technology
Table 1
Type of public health surveillance systems and implication for public health
Boom et al.13 Immunization Information Description of the Houston – Harris County Effective and efficient preparation for
System (Houston – Harris Immunization Registry’s experience after responses during public health
County Immunization Hurricane Katrina emergencies
Registry)
Bradley et al.14 Centers for Disease Control Initiative to advance early detection by Foster relationships and communication
(CDC) BioSense Early Event providing the standards, infrastructure, and among local, state, and federal public
Detection data acquisition for near real-time reporting, health officials, and facilitate information
analytic evaluation and implementation, and exchange regarding data sources,
early event detection support for state and analytics, monitoring practices, and other
local public health officials aspects of early event detection and
situational awareness
Derby et al.19 The Arizona Poison and Evaluate the ability of APDIC’s data Poison control centers might improve
Drug Information Center collection system to provide early detection public health syndromic surveillance for
(APDIC) and The Foodborne of FBDOs and to recommend ways to foodborne illnesses because they capture
Disease Outbreaks (FBDOs) improve FBDO surveillance efforts by early, real-time symptom data from the
System integrating the two surveillance systems broadest possible range of sources (i.e.
callers with mild to severe illness)
Espino et al.21 Real-Time Outbreak and To accelerate deployment of computer- This project hopes to accelerate the
Disease Surveillance (RODS) based syndromic surveillance deployment of real-time public health
surveillance by lowering costs, increasing
reliability, preventing vendor lock-in, and
ensuring software customizability
Fan et al.22 The Alberta Real Time (1) To improve upon traditional paper- ARTSSN provides richly integrated
Syndromic Surveillance Net based, fragmented public health information on a variety of health
(ARTSSN) surveillance using a centralized automated conditions for early detection of and
system; (2) enhance routine public health prompt action on abnormal events such
surveillance through effective use of existing as clusters, outbreaks, and trends
Provincial Electronic Health Record data for
earlier detection of cases, clusters,
outbreaks, and trends of communicable
disease, injury and environmental hazard
exposure; and (3) track the effectiveness of
public health interventions
Fan et al.23 Automated Mortality To enhance surveillance monitoring of the The new system provided public health
Surveillance System (MSS) H1N1 at local and regional levels to support officials with timely information regarding
evidence-based decision-making by the impact of H1N1 mortality the
physicians and public health authorities Kingston, Frontenac, Lennox & Addington
(KFL&A) region with weekly updates
Flamand Dengue Fever Surveillance To improve early detection of outbreaks and The system enabled health authorities to
et al.25 System a better provision of information to health detect outbreaks and provided real-time
authorities information
Graber and Rate-Based Statewide To describe results from a pilot surveillance Establishing state-based public health
Smith27 Surveillance System system for carbon monoxide poisoning surveillance for carbon monoxide (CO)
poisoning is feasible and essential for
guiding prevention and control efforts
Public health delivery in the information age: the role of informatics and technology
Table 1 (Continued)
Type of public health surveillance systems and implication for public health
Heffernan New York City’s First To assess the syndromic surveillance The syndromic surveillance system
et al.29 Syndromic Surveillance system helped improve detect communitywide
Systems outbreaks and reassurance during high-
profile public events
Hughes The Emergency Department To understand the factors driving respiratory EDSSS provides additional intelligence
et al.32 Syndromic Surveillance attendances at emergency departments about different categories of attendance,
System (EDSSS) in England (EDs) in England highlighting pressures in particular age
groups, thereby aiding planning and
preparation to respond to acute changes
in EDs, and thus the health service in
general
Hutwagner CDC Early Aberration Provide local and state health departments EARS can be used with a variety of data
et al.34 Reporting System (EARS) with a tool to assist in the best application sources to produce outputs that enable
of often-limited resources during the users to determine how many
epidemiological investigations of important resources and personnel they can invest
public health events in investigating specific aberrations
Lewis et al.41 National Capital Region Description of the NCR Disease System provides users with a means to
(NCR) Disease Surveillance Surveillance Network as an example of measure health of communities using
Network cooperation and potential for regional real-time tracking disease-surveillance
surveillance activities data
Lombardo The Electronic Surveillance A prototype syndromic surveillance system ESSENCE II has provided excellent
et al.44 System for the Early for capturing and analyzing public health performance with respect to the
Notification of Community- indicators for early detection of disease framework and has proven to be a useful
Based Epidemics outbreaks and cost-effective approach for providing
(ESSENCE II) early detection of health events
Mandl et al.45 Syndromic Surveillance The design and deployment of the first Syndromic surveillance is another
System wave of syndromic surveillance systems, is modality that clearly has a role in
intended to serve as a guide for detecting and monitoring bioterrorism as
informaticians, public health managers, and well as other outbreaks and public health
practitioners who may be planning problems
deployment of such systems in their regions
Mnatsakanyan Electronic Surveillance To highlight a protype decision-support Great improvement in both the sensitivity
and System for the Early model and specificity of the detections
Lombardo47 Notification of Community-
based Epidemics
(ESSENCE)
Naumova The Integrated Forecasts The description of the Integrated Forecasts Although the system is under
et al.48 and EaRly eNteric Outbreak and EaRly eNteric Outbreak System development, its potential has been
Detection System demonstrated through successful use of
(INFERNO) emergency department records
associated with a substantial waterborne
outbreak
Shea and BioWatch Program Collect airborne particles onto filters, which BioWatch in urban areas may serve as an
Lister55 are subsequently transported to effective deterrent to potential bioterrorists
laboratories for analysis
(continued)
Public health delivery in the information age: the role of informatics and technology
Table 1 (Continued)
Type of public health surveillance systems and implication for public health
Sosin58 National Syndromic To provide a common framework to The framework for evaluating syndromic
Surveillance System evaluate syndromic surveillance systems surveillance systems provides a focal
point for evaluating and understanding
syndromic surveillance systems for
terrorism preparedness and outbreak
detection
Tang61 National Health Information Provides the underlying information utility Accelerate development and wide-scale
Infrastructure (NHII) that connects local health providers and deployment of electronic public health
health officials through high-speed surveillance systems, computer-based
networks to national data systems patient records, and disaster-response
necessary to detect and track global threats information technologies. Such efforts
to public health hold the greatest potential to protect our
citizens from disaster and to deliver the
best healthcare if disaster strikes
Wagner The National Retail Data (1) To enlist participation of retailers to NRDM data-utility approach reduces the
et al.65 Monitor (NRDM) For Over- achieve 70% coverage of OTC sales effort required for health departments to
The-Counter (OTC) nationally; (2) influence the industry toward monitor sales of OTC healthcare products
Healthcare Products real-time data collection; (3) obtain
supplemental information needed for spatial
analysis, adjustment for promotional effects,
and maintenance of UPC analytic
categories (e.g. liquid cough medications);
(4) promote and develop this type of
surveillance practice; (5) achieve fault and
load tolerance; and (6) develop detection
algorithms for the data
World Health Communicable Disease Two key functions to (1) provide early The recommendations should be used as
Organization49 Surveillance System (Guide warning of potential threats to public health a basis on which to plan improvements of
to monitoring and and (2) program monitoring functions which the surveillance system. Routine
evaluating) may be disease specific or multi-disease in monitoring and follow-up evaluations
nature should continue as scheduled
Xue and Public Health Emergency To investigate the ongoing development of By using the functional coupling
Liang67 Information System (PHEIS) PHEIS framework, some insights were provided
in China regarding China’s post-SARS public
health emergency responses from a
process re-engineering perspective
Yih et al.71 Syndromic Surveillance Evaluation of a real-time ambulatory care- The system was able to detect true
System based syndromic surveillance system in clusters of illness but none was of public
four metropolitan areas of the United States health interest
duplication of immunization children and their parents. Due to the Hughes et al.32 investigated the factors
administered to children resulting in a success of the IIS, Michigan Care contributing to respiratory pathogens
cost saving of over US$26.5 million. In Improvement Registry added hazard and emergency room attendance.
addition, the IIS backup systems module functionalities to capture Results revealed that the EDSSS
prevented the distraction of all medical medication and mass immunization provides real-time better early warning
charts and enabled providers in during an epidemic.13 Using public activity than laboratory surveillance.
Houston, Texas, and Louisiana, to health England emergency department Findings also highlight the need to
deliver efficient and effective care to syndromic surveillance system (EDSSS), triangulate laboratory surveillance
Bravata Bioterrorism Surveillance Evaluate the potential utility of existing surveillance Review of surveillance Few surveillance systems have been
et al.15 System systems for illnesses and syndromes related to systems for early detection specifically designed for collecting and
bioterrorism of bioterrorism-related analyzing data for the early detection of a
diseases bioterrorist event
Buckeridge The Defense Advanced To improve the timeliness of outbreak detection Synthesize and description Surveillance for rapid outbreak detection
et al.16 Research Project Agency (1) identifying new nontraditional data sources of major themes in should move from analyzing a single time-
(DARPA) sponsored project with early alerting potential and (2) develop and research on detection series to analyzing covariate and spatial
called the Bio-event Advanced evaluate outbreak detection algorithms for algorithms conducted information collected from multiple data
Leading Indicator Recognition surveillance data through the BioALIRT sources
Technology (BioALIRT) project
Buckeridge Simulated an Anthrax Epidemic To design a simulated anthrax epidemic injection Requirement for the design The model successfully addresses the
et al.17 Injection Model model that accounts for the complexity of the and evaluation of an limitations of existing simulation approaches
background data and enables sensitivity analyses epidemic simulation model by accounting for factors such as spatial
based on uncertain disease-agent characteristics mobility and disease modeling knowledge
base
Buehler Syndromic System in relation to Consider the mix of hypothetical factors that may The role of syndromic Efforts to detect bioterrorism epidemics at
et al.18 Bioterrorism affect the detection of epidemics attributable to surveillance in detecting a an early stage should not only address the
CDC category A bioterrorism agents bioterrorism-related development of innovative new surveillance
epidemic mechanisms but also strengthen resources
for diagnosis and enhance relationships
between clinicians and public health
agencies
Doyle The Public Health Surveillance Improve the sensitivity, timeliness, and quality of Description of the initial The PHSkb provides integrated, extensible,
et al.20 Knowledgebase (PHSkb TM) surveillance data through improved electronic creation of the PHSkb and interoperable system architecture
data interchange. Second, to describe the component to support notifiable disease
creation of the PHSkb surveillance
Flamand Dengue Fever Surveillance Assessment of the contribution of the data mining Application of contextual Utilization of the data mining approach
et al.24 System in French Guiana method to the understanding of factors sequential pattern essential to analyzing disease-surveillance
associated with the dissemination of infectious extraction techniques to data on a temporal and a spatial scale in
diseases and their spatiotemporal spread enable early warning of relation to climatic, social, and
dengue outbreaks in environmental variables
French Guiana
(continued)
Review Paper
Fricker and Syndromic Surveillance System Address current challenges in syndromic Statistical issues in Electronic biosurveillance systems and the
Rolka26 surveillance system electronic biosurveillance analytical methods have the potential to
Improve public health surveillance, not only
for bioterrorism, but also to improve
responsiveness to natural disease
outbreaks
Graber and Pilot Surveillance System for Describe results from a pilot surveillance system To describe the Establishing state-based public health
Smith27 Carbon Monoxide (CO) for carbon monoxide poisoning development of a state- surveillance for CO poisoning is feasible
Poisoning based surveillance system and essential for guiding prevention and
for unintentional, non-fire- control efforts
related CO poisoning using
a combination of existing
data sources, analyzed
using standard public
health methodology
Heisey- Massachusetts Department of Improve timeliness and completeness of reporting Assessment of the Implementation of the system has resulted
Grove Public Health Disease and case follow-up of hepatitis C. Massachusetts hepatitis C in an increase in timeliness of reporting and
et al.30 Surveillance System for surveillance system receiving completed form
Public health delivery in the information age: the role of informatics and technology
Hepatitis C
Henao CDC Foodborne Diseases To better measure the frequency of enteric Achievements of the FoodNet has helped improve food safety in
et al.31 Active Surveillance Network infections and their effects on society FoodNet from 1996–2015 the United States
(FoodNet)
Hurt-Mullen Electronic Surveillance System Describe the framework for daily evaluation of General principles of the Careful development of an evaluation and
and for Early Notification of ESSENCE data use of syndromic response framework is necessary to assess
Coberly33 Community-Based Epidemics surveillance whether the use of syndromic surveillance
(ESSENCE) systems requires excess work to distinguish
between statistical anomalies and important
public health events
Table 2 (Continued)
Josseran Heat Wave Syndromic (1) Give the public authorities 3 days’ prior To determine relevant System allowed the collection of data in
et al.35 Surveillance System in France warning that a heat wave may occur, in order for indicators related to health real-time and the subsequent optimization
the National Heat Wave Plan (NHWP) measures effects of heat waves and of the response by public health agencies
to be put into operation and (2) modifying the evaluate the ability of the
behavior of people, health institution, and health system to monitor
authorities with regard to high summer variations in the activity of
temperatures emergency departments
over time
Karras Public Health Informatics Description and assessment of PHI curriculum PHI Curricula Development Need for all PHI training schools and
et al.36 Education development since the 1990s and Evaluation institutions to coordinate development of
curricula to facilitate standardization in
competencies areas
Koo et al.37 Challenges and opportunities Examination of public health as a professional Fundamental nature of The application of information science and
offered by Public Health discipline for informatics public health and grand technology in public health practice
Informatics challenges provides unfathomed opportunities to
improve the health of the population
Krause Electronic Surveillance System Provide timely and easily retrievable epidemiologic To describe the system, SurvNet may be a useful tool for other
et al.38 (SurvNet) for Infectious Disease information exchange on outbreaks at the local, and present epidemiologic outbreak surveillance systems because it
Outbreaks in Germany state, and national levels aspects of reported minimizes the workload of local health
outbreaks, and also to departments and captures outbreaks even
discuss the strengths and when causative pathogens have not yet
weaknesses after 5 years of been identified
practical use
Kukafka39 Public Health Informatics Proved examples of how informatics is being The role of health Health promotion and disease prevention
Career Development applied to health promotion activities informatics in disease practices in public health can be
prevention health education dramatically transformed by use of
and health promotion informatics tools and methods
Kulldorff Real-Time, Geographic, Early (1) Set benchmark for rigorous evaluation of the Power calculation for Temporal scan statistic performs
et al.40 Outbreak Detection Systems statistical power of early outbreak detection and evaluating disease substantially better at detecting a city-wide
(2) estimate and compare the power of outbreak detection outbreak, when compared with a space-
prospective temporal and space-time scan time
statistics
(continued)
Review Paper
Liang and Public Health Emergency Facilitate disease surveillance, detection, (1) Review of emergency China recognizes that surveillance and
Xue42 Response Information System reporting, and response response information detection of disease outbreaks is a critical
(PHERIS) in China systems and (2) analyze the part of the solution and a dynamic system
weakness of China’s old incorporating command, action, and
public health system and supporting components is needed to
describes the design and manage emergencies. The ongoing
functionalities of PHERIS development of PHERIS will provide a
from both technical and complete package for China to rapidly
managerial aspects detect emergencies, effectively share critical
information among key stakeholders, and
competently manage emergencies
Lober Information System The essential architectural components of a The role of data elements, Public health informatics and computer
et al.43 Architectures for Syndromic syndromic surveillance information system and vocabulary standards, data science research in data-integration
Surveillance discuss existing and potential architectural extraction, transport and systems can supplement approaches
approaches to data integration security, transformation and recommended by public health informatics
Mirhaji46 Public Health Surveillance To examine the conceptualization, design, Significance of a To streamline the collection and integration
Systems (PHS) with emphasis analysis, and implementation translational approach to of public health information, it requires the
on Syndromic and Bioterrorism the problems of public development of a culture and infrastructure
System health informatics to enhance meaningful integration
knowledge and information across
organizations
Public health delivery in the information age: the role of informatics and technology
Ortega IBM’s Public Health Information A prototype that leverages the latest information To retrospectively examine PHIAD can be deployed to provide a bridge
et al.50 Affinity Domain (PHIAD) in technology standards and infrastructure for the the public health policies technology that enables clinicians and
Mexico public health community put in place in Mexico City public health officials to share disease data
using standards-based, real-time electronic
transactions without upgrading their legacy
systems
Reeder Public Health Information Proposal for the creation of PHI reusable Reusable knowledge Identification and consistent use of rigorous
et al.51 System Design information system design in PHI system and system design will move the discipline of
standard PHI forward
Table 2 (Continued)
Reis et al.52 Automated Epidemiological To provide real-time population health monitoring Description of the evolution Results indicated the need for robustness
Geotemporal Integrated in the state of Massachusetts of the design over time in when designing public health information
Surveillance system (AEGIS) response to the challenges system
of a regional and national
integration environment
Savel Public Health Grid (PHGrid) Description of architectural framework for a Public Data grid aspect of grid PHGrid has the potential to overcome
et al.53 Health Grid computing technical, cultural, and financial obstacles
existing public health information systems
by improving the availability accuracy and
timeliness of critical health data
Scotch Public Health Grid Applications To assess the feasibility of using Web 2.0 The development and use Web 2.0 applications are reasonable
et al.54 using Web 2.0 Mashup technologies to develop complex public health of Web 2.0 technologies environments for rapid prototyping; they are
Technologies applications including Yahoo! not mature enough for large-scale public
health data applications
Shmueli Modern Biosurveillance System Monitoring of time series for early alerting of Statistical challenges in Lack of application to modern
and anomalies to stimulate investigation of potential monitoring modern biosurveillance raises attention to one of the
Burkom56 outbreaks biosurveillance data and main barriers to statistical involvement in
description of the current the field
state of monitoring in the
field
Siegrist and Bio-Event Advanced Leading Develop data sources, technologies, and Determine whether Due to minimal data exist for an actual
Pavlin57 Indicator Recognition prototypes for monitoring nontraditional data automated detection biologic attack, determining how quickly an
Technology (BioALIRT) sources that enable public health authorities to algorithms can reliably and algorithm might detect such an attack is
Biosurveillance detect terrorist release of a pathogen or toxin at quickly identify the onset of difficult. However, application of these
the earliest possible moment natural disease outbreaks algorithms in combination with other data-
that are surrogates for analysis methods to historic outbreak data
possible terrorist pathogen indicates that biosurveillance techniques for
releases, and do so at analyzing syndrome counts can rapidly
acceptable false-alert rates detect seasonal respiratory and
(e.g. once every 2–6 weeks) gastrointestinal illness outbreaks
Sosin58 National Syndromic Surveillance Describe the status of performance measurement Framework for evaluating Evaluation requirements should be
System of syndromic surveillance systems and ongoing Syndromic Surveillance simplified and standardized to allow
challenges in system evaluation Systems comparisons across systems and across
outbreak detection approaches
Review Paper
(continued)
Table 2 (Continued)
Stoto Syndromic Surveillance (1) To introduce the statistical issues in syndromic Use of statistical methods Although an increasing number of
et al.59 surveillance, (2) describe and illustrate in syndromic surveillance statistically sophisticated detection
approaches to evaluating syndromic surveillance algorithms have been developed, there is a
systems and characterizing their performance, limit to their efficacy. However, syndromic
and (3) evaluate the performance of a couple of surveillance systems can help public health
specific algorithms through both abstract to build relationships with hospitals and
simulations and simulations based on actual data other entities in their communities to get
access to data
Surján The Protégé ontology editor To create a core ontological model that is able to Development of conceptual The Protégé ontology helps improve data
et al.60 with RDF represent public health indicators framework for public health comparability in the system
indicators
Tokars BioSense US National Receives data from various sources and makes Describe and evaluates Findings can be used to improve both early
et al.62 Surveillance System them available for public health use modifications of C2 event detection and situation awareness
algorithm as well as its because accurate recognition of unusually
Uscher- Public Health Syndromic Allows for earlier detection of epidemics and more To describe current Due to the lack of guidance, limited
Pines Surveillance timely public health response, due to lack of syndromic surveillance resources for development of response
et al.63 reliance on clinicians for recognition and active system response protocols protocols, and few examples of syndromic
reporting of disease clusters to public health in health departments from surveillance detecting previously unknown
departments eight diverse states in the events of public health significance, health
United States and to departments have not prioritized the
develop a framework for development and refinement of response
Public health delivery in the information age: the role of informatics and technology
Wagner The Real-Time Outbreak and Test whether early detection of outbreaks can be Experience of the RODS Free-text chief-complaint data are useful in
et al.64 Disease Surveillance (RODS) achieved through statistical analysis of chief- project in collecting and public health surveillance and can be
Project complaint data (or other routinely collected data) analyzing patient chief obtained in real-time for modest cost
complaints
Table 2 (Continued)
Wilson Heuristic Model for Biological A model designed to enable rapid detection and Strategy for rapid response This approach could aid global public
et al.66 Detection Events assessment of biological threats that may require to pandemic influenza is to health officials and national political leaders
swift intervention by the international public health identify the first focus of in responding to biological threats of
community human-to-human efficient international public health significance
transmission of the H5N1
influenza virus
Yan et al.68 Syndromic Surveillance A case study comparing three state-of-the-art A comprehensive survey of Although syndromic surveillance systems
Systems syndromic surveillance systems state-of-the-art syndromic have been developed and deployed in
surveillance research and many state public health departments,
system development efforts there is an urgent need to create a cross-
from the perspective of jurisdictional data-sharing infrastructure to
information science and maximize the potential benefit and practical
technology impact of syndromic surveillance
Yasnoff Public Health Informatics (PHI) To identify how PHI can improve public health Need to utilize informatics Application of PHI principles provides
et al.69 delivery applications to enhance unprecedented opportunities to build
public health activities healthier communities
Yasnoff Public Health Informatics (PHI) Development of a national agenda for PHI To develop national agenda Implementation of this consensus agenda
et al.1 for PHI will help promote progress in the application
of information technology to improve public
health
Yih et al.70 The National Bioterrorism To create a flexible, open-source surveillance Assessment of the National Data files created by this system are also
Syndromic Surveillance system that uses ambulatory care data to identify Bioterrorism Syndromic directly usable by health departments and
Demonstration Program unusual clusters of illness and support rapid Surveillance Demonstration are compatible with the emerging standards
public health follow-up Program of CDC’s BioSense initiative. This allows
healthcare organizations to make their data
directly available to local and national health
agencies if they so choose
Review Paper
Public health delivery in the information age: the role of informatics and technology
systems with the EDSSS to increase Electronic surveillance systems longitudinal data collected enable
monitoring, planning, and response to functionality, capability, training, and epidemiologist to identify hotspots for
acute emergency room services.32 challenges community outbreaks. Nonetheless,
Similarly, Derby et al.19 evaluated the Well-developed and functioning IT continuous modification of the system is
Arizona Poison and Drug Information systems have the potential to help public needed to distinguish between important
Center (APDIC) database to assess its health officials make timely decisions public events requiring urgent attention
ability to improve foodborne disease during any disaster. It is crucial that and statistical anomalies (false alarms).33
outbreaks (FBDOs). After analyzing surveillance systems are designed to The next important issue is public
68,433 suspected foodborne calls, of provide public health personnel with the health information system architectural
which 2922 were suspected of human needed skills to predict, detect, manage, design and
exposure from Pima County, they communicate, and disseminate outbreak capability.24,38,40,43,46,50,51,53,54,59,60,70
concluded that although the APDIC information among all agencies and Mirhaji,46 Ortega et al.,50 Reeder et al.,51
helped to avoid duplication of cases decision-makers (Table 2). Buckeridge and Yih et al.70 examined the state of
reported, the system is limited in its and collegues16,17 evaluated the electronic PHS conceptualization,
ability to provide real-time foodborne algorithms of the bio-event advanced design, analysis, and implementation in
illness data19 (See Table 1). indicator recognition technology the US and concluded that the evolution
The traditional PHS systems continue (BioALIRT) and the simulation model of of the Internet has tremendously
to play a tremendous role by enabling the anthrax epidemic injection in Norfolk, changed public health delivery. However,
public health sector to detect and Virginia. The authors reported that both due to the complexity of PHS data
respond to outbreaks. Nonetheless, to the BioALIRT and the anthrax systems collection, electronic surveillance
meet the public health demands and accurately improve the timeliness of systems should be designed to enable
needs in today’s information age, new outbreak detection and progression of reusing data and sharing.
surveillance systems are necessary.76 the disease, but it lacks the ability to Another development is a surge in the
As a result, to strengthen health successfully track movement across number of public health schools and
promotion and disease prevention, different locations (Table 2).16,17 programs providing professional-level
state and local public health Similarly, Heisey-Grove et al.30 educational degrees from bachelor to
departments are collaborating with examined the impact of PHI in enhancing Doctor of Philosophy (PhD) and Doctor of
health agencies, organizations, and the Massachusetts hepatitis C Public Health (DrPH). This has also led to
institutions around the world to surveillance reporting system. According changes in entry requirements, core
implement various forms of integrated to the authors, more than 8000 new competencies in learning, practice, and
automated/electronic surveillance cases of hepatitis C are reported teaching for schools of public health and
systems to effectively track and detect annually. Prior to the implementation of programs.69 To meet the 21st century
diseases, disasters, and other the new system, local health needs, demands, and characteristics of
bioterrorism attacks. For example, the departments (LHDs) had to manually the population some scholars have
U.S. Centers for Disease Control and complete a four-page case-report form, argued public health programs must
Prevention (CDC) in conjunction with which took at least 7 min to complete. include courses in informatics.1,36,37,39,69
the Department of Homeland Security However, the implementation of the Yasnoff et al.,1,69 noted that ‘the need for
have developed the BioSense and other Massachusetts virtual epidemiologic new and improved information systems
information systems to coordinate network (MAVEN) Web-based system for public health is growing because of
disaster response among federal, state, resulted in timeliness of hepatitis C new challenges related to antibiotic-
and local public health reporting.30 Henao et al.31 analyzed resistance, emerging infections, and
agencies.14,44,47,48 Since its CDC’s 10 state health departments’ chemical and biological terrorism’.69
implementation, these systems have FoodNet surveillance system and Consequently, the authors suggested that
helped detect, monitor, report, and concluded that though the system has public health professionals should have
evaluate many public health incidents helped improve food safety in the US, it deeper skills and knowledge in informatics
(Table 1). These include respiratory is also critical to ensure rapid access to to effectively make the appropriate
problems associated with the southern clinical data and facilitate surveillance decision concerning PHS systems
California wildfires, gastrointestinal and epidemiologic research informatics development and management.1,69 Others
disease outbreak at a U.S. Department capacity such as geographic information argued that public health agencies should
of Defense base, rash illness among system linkage. The electronic collaborate with educational and training
elementary school students, as well as surveillance system early notification of institutions to coordinate development of
other communicable and waterborne community-based epidemics (ESSENCE) tailored informatics competencies
outbreaks (Table 1).22,23,44,48,55,77 Table 3 was developed to track higher-than- (continuing education) for current
provides further examples of syndromic expected visits to the emergency room, professionals to reflect technological
surveillance systems currently in use and sale of pharmaceutical products.33 changes.36,69,82–85 This training should
around the world for public health Analysis of the system by Hurt-Mullen meet variety of needs ranging from basic
threats.13,14,34,44,62,68,78–81 and Coberly33 revealed that the informatics skills for current and future
Public health delivery in the information age: the role of informatics and technology
Table 3
EpiCom – Berndt et al.78 To provide information exchange for reporting and Florida Department of Health –
tracking outbreaks and to alert public health USA
officials
The Louisiana Immunization Network for Kids To track immunizations/vaccinations of children Louisiana Department Health of
Statewide (LINKS) – Boom et al.13 and Hospitals – USA
Early Aberration Reporting System (EARS) – To monitor bioterrorism U.S. Centers for Disease Control
Bradley et al.14 and Hutwagner et al.34 and Prevention – USA
Electronic Surveillance System for Early To monitor infectious disease outbreaks at military Department of Defense – USA
Notification of Community-Based Epidemics treatment facilities worldwide
(ESSENCE) – Lombardo et al.44
Kentucky Preparation and Response on To aid volunteer and evacuee coordination efforts University of Kentucky – USA
Advanced Communications Technology
(PROACT) – McKinney et al.79
National Health Service (NHS) Direct To monitor infectious and noncommunicable Operated by National Health
Syndromic Surveillance – Yan et al.68 diseases Service (NHS) of UK
The Pennsylvania Electronic Disease To improve the timeliness of disease reporting and Pennsylvania Department of
Surveillance System (PA-NEDSS) – Sandt also provide access to complete and accurate Health – USA
et al.80 public health data for the Commonwealth
BioSense – Tokars et al.62 To expedite event recognition and response CDC and the Department of
coordination among federal, state, local, and local Homeland Security – USA
public health and healthcare organizations
Early Warning Outbreak Recognition System Collects data from a network of hospitals and Association of South East Asian
(EWORS) – Yan et al.68 provides technical approaches to distinguish Nations
epidemic from endemic diseases
Alternative Surveillance Alert Program (ASAP) Monitors gastrointestinal disease trends by Health Canada
– Yan et al.68 analyzing over the counter (OTC) anti-diarrheal and
anti-nausea sales data and calls to telehealth lines
Association of South East Asian Nations – Daily analysis of acute respiratory syndrome Korea
Yan et al.68
Experimental Three Syndromic Surveillances To analyze OTC sales data, outpatient visits, and National Institute of Infectious
in Japan – Yan et al.68 ambulance transfer Diseases – Japan
Australian Sentinel Practice Research To collect and report data on selected conditions The Royal Australian College of
Network (ASPREN) – Yan et al.68 such as ILI for weekly statistical analysis General Practitioners, the
Department of General Practice,
University of Adelaide, Australian
Government Department of
Health and Aging
Influenza-Like Illness (ILI) Surveillance in To collect medication sales and weekly office visit European Center for Disease
France – Yan et al.68 data to provide forecasts of influenza outbreaks Prevention and Control – France
HealthMap – International Society for Disease To monitor disease outbreak monitoring and real- Boston Children Hospital – USA
Surveillance (ISDS) – ISDS81 time surveillance of emerging public health threats
(continued)
Public health delivery in the information age: the role of informatics and technology
Table 3 (Continued)
Suite for Automated Global Electronic Collection of modular for electronic disease Johns Hopkins University Applied
bioSurveillance (SAGES) – ISDS81 surveillance Physics Laboratory – USA
Trip S – ISDS81 To increase the European capacity for real-time or European Commission through
near-real-time surveillance and monitoring of the Executive Agency for Health and
health burden of expected and unexpected health- Consumers
related events
professionals to a more specialized costs associated with hardware and Thus, whatever is done to make
informatics and information system software acquisition are no longer an integrated, comprehensive information
management skills.1,86 Currently, the issue,84,85 system and data system more easily available for laudable
delivery of PHI education and training standardization remain a problem.69,85 and worthwhile purposes is likely to create
varies from short-term in-service training Standardization can lead to design and new opportunities for misuse.69,85 The
to long-term academic education development costs reduction, increase currently available public use data and
including certificates, diplomas, first integration, and facilitate the collection statistics can play an increasingly
degrees, graduate degrees, and post- of meaningful aggregate data for quality important role in advancing progress on
graduate training.1,69 Again, Yasnoff improvement necessary for policy major public health threats. As noted by
et al.,69 Norris and Brittain,86 commented development.69,87,88 However, due to Bell et al.10, surveillance data are often
that the mode of these training programs complexity, diversity, and needs of each collected without informed consent.
varies greatly depending on the individual public health unit and agency, These issues can be safeguarded through
or organization’s education and or training maintaining technological standards has the use of ethical research frameworks,
requirements.69,86 The CDC PHI become more difficult. adequate design and support of PHS
fellowship-training program established in Another challenge is data and systems and responsible access control.89
the mid-1990s continues to evolve. The information sharing across organizational It is important that adequate security
main goal of this 2-year program is to and jurisdictional boundaries.36,39,43,68,85 measures are put in place to maintain
provide training and experience to public Historically and following the example of data and information security and
health professionals in applying computer the medical system, public health confidentiality, to prevent any form of
and information science skills to real agencies have designed information breach and to reassure the public that
public health problems.1,69 The training systems that are often maintained in their information is safe (Table 2).1,37,39
also provides fellows the opportunity to many different forms and incompatible.
work with experienced mentors in the field This has resulted in duplicative and
of PHI, thereby enhancing their fragmented systems that hindered the Discussion
understanding of global health issues, ability of allied public health officials to Public health is the science and art of
learn development of effective access them.37,69 Interoperable preventing disease, prolonging life, and
partnerships, and improving the health of information systems for both routine and promoting health through the organized
poor communities through the application emergency functions such as efforts and informed choices of society,
of health informatics and IT1,69 (See biosurveillance, outbreak management, communities, and individuals. The focus
Table 2). and electronic laboratory reporting are is to prevent injuries, outbreaks, and
Effective and efficient public health essential to public health work and diseases through surveillance of cases
delivery can be sustained only on readily practices. Interoperable information and the promotion of healthy behaviors.90
available IT. Real-time response to systems are also critical because the Within this function is prevention as a
natural disasters and those due to capability to exchange information primary goal for improving population
bioterrorists require a well-equipped across, and among organizations will health and quality of life through
integrated information system. Despite lead to early detection, faster response collaboration with different agencies and
the benefits of health informatics and IT, times, and early intervention to improve organizations to facilitate development of
there are obstacles to consider during the public’s health during any disaster.68 policies and programs to optimize
the design and implementation of such Ethical and procedural issues for interventions for healthy community.37
system. One of such issues is managing and safeguarding public health Hence, availability of and access to
implementing interoperable and data also need consideration. IT is ‘up-to-date’ robust information system is
reusable systems.51 While some believe perceived as a double-edged sword. crucial to public health practice, services,
Public health delivery in the information age: the role of informatics and technology
and delivery. It is obvious that the last wave focused on reducing costs Conclusion
traditional paper-based surveillance through the integration of ‘the benefits of To the best of our knowledge, this is the
systems are not efficient in providing state-level system development with the first evidence-based systematic review of
timely information for public health action. tools of software reuse’ and a requirement the literature solely dedicated to the role
Health informatics and IT system provide that ‘each system that is developed must of informatics and IT and its impact on
transformational tool to ensure efficient be standard based’.91 As the use of public health delivery. Through a
information access and exchange. Over informatics and PHI grow, strategies must comprehensive literature search, the
the last two decades, public health, and be put in place toward a reusable design authors identified 60 articles. This review
the medical care systems have invested of information systems to promote provides an in-depth overview of how
increasingly in IT and communication technology transfer, and effective public health agencies are using
systems. Globally syndromic surveillance functioning of public health agencies, and informatics and technology, benefits,
and biosurveillance systems are being the health system as a whole.51 This challenges, and opportunities. There is
developed and implemented (see Table means public health, as a field and no doubt that to most effectively serve
3). For example, the Pennsylvania discipline of focus, should encourage and and improve communities’ health in this
Electronic Disease Surveillance System demand high-quality informatics information age and beyond, requires a
was used to track and isolate Salmonella education and training systems with a strong PHI infrastructure. To meet this
quickly.80 focus on building recognition of the expectation, public health must invest in
Benefits derived from the importance of informatics. The goal of workforce development and capacity
implementation of a well-functioning public health education should be the through education and training in PHI. As
health information and IT systems include preparation of students for the future, by noted by the IOM’s Committee on Quality
better communication and collaboration creating an environment that supports the Healthcare in America, ‘information
across all public health and clinical teaching of PHI, competencies, and skills technology must play a central role in the
specialties, prompt access to accurate necessary for the future. redesign of the healthcare system if a
clinical and demographic information, substantial improvement in quality is to
and reduction or prevention of human Limitations of the review be achieved in the coming decade’.92 As
errors for automated processes.87,88 Several limitations are associated with a result, re-engineering public health
Despite these benefits, certain areas this study. To start with, the review was courses, learning competencies, skills,
represent grand challenges for public limited to only studies published in the and practices represents the next phase
health practice and delivery. These English language. This means, we might in public health.73,76
include the development of coherent have excluded potential articles that were
integrated national public health indexed in other languages or not
Conflict of Interest
information systems, integration between available in the electronic databases The author(s) declared no potential conflicts
public health and clinical care and searched. We assumed this explains why of interest with respect to the research,
pervasive concerns about the impact of the majority of the eligible studies authorship, and/or publication of this article.
IT on confidentiality and privacy. To included in the review were conducted in
encourage data harmonization, the US. In addition, the published date
documentation, and investigation, was limited from January 2000 to 31 Ethical Approval
rigorous system standardization should This study is a systematic review that
March 2016. Because the field
involves no human or animal subjects.
also be considered.37,69,76 encompasses many areas and is very
Therefore, no ethical approval was pursued.
According to Lumpkin,91 federal and interdisciplinary in nature, it is not
state public health information systems in possible to review without bias. Despite
the US have been developed in three these limitations, this review has drawn Funding
‘waves’.91 The first wave began with the attention to how informatics/technology Dr. Williams’ effort is supported in part by
independent development of state and has helped address some of the major the Division of Intramural Research, National
federal systems that could not exchange issues and challenges in public health for Institute on Minority Health and Health
data. The second wave was supported by Disparities, National Institutes of Health.
the last two decades. In addition, this
federal funding to develop state-level review has revealed the importance and
systems capable of exchanging data crucial role health informatics and IT are ORCID iD
using standards in building independent – playing to reshape public health delivery Faustine Williams https://orcid.
and therefore costly – state systems. The to ensure a healthy society. org/0000-0001-5810-1291
References
1. Yasnoff WA, Overhage JM, Humphreys BL 2. Disease Control Priorities Project. Public health 3. Office of Disease Prevention and Health
et al. A national agenda for public health surveillance: the best weapon to avert Promotion. Healthy people 2020: global health.
informatics. J Am Med Inform Assoc epidemics. May 2008. Available online at: Available online at: https://www.healthypeople.
2001;8(6):535–45. http://dcp-3.org/dcp2/chapters. gov/2020/topics-objectives/topic/global-health
Public health delivery in the information age: the role of informatics and technology
4. Castillo-Salgado C. Trends and directions of eastern Ontario for pandemic influenza promotion practice. Health Promot Pract
global public health surveillance. Epidemiol Rev preparedness. Can J Public Health 2005;6(1):23–8.
2010;32:93–109. 2010;101:459–63. 40. Kulldorff M, Zhang Z, Hartman J et al.
5. McHugh M, Staiti AB, Felland LE. How 23. Fan S, Blair C, Brown A et al. A multi-function Benchmark data and power calculations for
prepared are Americans for public health public health surveillance system and the evaluating disease outbreak detection
emergencies? Twelve communities weigh in. lessons learned in its development: the Alberta methods. MMWR: Morbid Mortal W
Health Aff 2004;23(3):201–9. Real Time Syndromic Surveillance Net. Can J 2004;53:144–51.
6. Duchin JS. US Public health preparedness for Public Health 2010;101:454–8. 41. Lewis SH, Holtry RS, Loschen WA et al. The
Zika and other threats remains vulnerable. 24. Flamand C, Fabregue M, Bringay S et al. collaborative experience of creating the
Disaster Med Public Health Prep Mining local climate data to assess National Capital Region Disease Surveillance
2016;10(2):298–9. spatiotemporal dengue fever epidemic Network. J Public Health Manag Pract
7. Hovenga EJS. Importance of achieving patterns in French Guiana. J Am Med Inform 2011;17(3):248–54.
semantic interoperability for national Health Assoc 2014;21(e2): e232–40. 42. Liang H, Xue Y. Investigating public health
Information Systems. Text & Context Nursing 25. Flamand C, Quenel P, Ardillon V et al. The emergency response information system
Journal 2008;17(1):158-67. Available online at: epidemiologic surveillance of dengue-fever in initiatives in China. Int J Med Inform
http://www.scielo.br/pdf/tce/v17n1/18.pdf French Guiana: when achievements trigger 2004;73(9):675–85.
8. Coiera E, Hovenga E. Building a sustainable higher goals. Stud Health Technol Inform 43. Lober WB, Trigg L, Karras B. Information
health system. Yearb Med Inform 2010;169:629–33. system architectures for syndromic
2007;2(1):11–8. 26. Fricker RD Jr, Rolka H. Protecting against surveillance. MMWR: Morbid Mortal W
9. Hovenga EJS. Importance of achieving biological terrorism: statistical issues in 2004;53(Suppl):203–8.
semantic interoperability for national health electronic biosurveillance. Chance 44. Lombardo JS, Burkom H, Pavlin J. ESSENCE
information systems. Texto Contexto Enfer 2006;19(4):4–14. II and the framework for evaluating syndromic
2008;17(1):158–67. 27. Graber JM, Smith AE. Results from a state- surveillance systems. MMWR: Morbid Mortal
10. Bell B, Damon I, Jernigan D et al. Overview, based surveillance system for carbon W 2004;53:159–65.
control strategies, and lessons learned in the monoxide poisoning. Public Health Rep 45. Mandl KD, Overhage JM, Wagner MM et al.
CDC response to the 2014–2016 Ebola 2007;122(2):145–54. Implementing syndromic surveillance: a
epidemic. MMWR Suppl 2016;65(3):4–11. 28. Hanrahan LP, Anderson HA, Busby B et al. practical guide informed by the early
11. Kateh F, Nagbe T, Kieta A et al. Rapid Wisconsin’s environmental public health experience. J Am Med Inform Assoc
response to Ebola outbreaks in remote areas – tracking network: information systems design 2004;11(2):141–50.
Liberia, July–November 2014. MMWR: Morbid for childhood cancer surveillance. Environ 46. Mirhaji P. Public health surveillance meets
Mortal W 2015;64(7):188–92. Health Perspect 2004;112:1434–9. translational informatics: a desiderata. J Assoc
12. Widdowson M-A. Implementing an Ebola 29. Heffernan R, Mostashari F, Das D et al. New Lab Autom 2009;14(3):157–70.
vaccine study – Sierra Leone. MMWR Suppl York City syndromic surveillance systems. 47. Mnatsakanyan ZR, Lombardo JS. Decision
2016;65:98–106. MMWR: Morbid Mortal W 2004;53 Suppl:23– support models for public health informatics.
13. Boom JA, Dragsbaek AC, Nelson CS. The 7. J Hopkins APL Tech D 2008;27(4):
success of an immunization information 30. Heisey-Grove DM, Church DR, Haney GA et al. 332–9.
system in the wake of Hurricane Katrina. Enhancing surveillance for hepatitis C through 48. Naumova EN, O’Neil E, MacNeill I. INFERNO: a
Pediatrics 2007;119(6):1213–7. public health informatics. Public Health Rep system for early outbreak detection and
14. Bradley CA, Rolka H, Walker D et al. BioSense: 2011;126(1):13–8. signature forecasting. MMWR Morb Mortal
implementation of a national early event 31. Henao OL, Jones TF, Vugia DJ et al. Wkly Rep 2005;54(Suppl):77–83.
detection and situational awareness system. Foodborne diseases active surveillance 49. World Health Organization. Communicable
MMWR Morb Mortal Wkly Rep network – 2 decades of achievements, 1996– disease surveillance and response systems:
2005;54(Suppl):11–9. 2015. Emerg Infect Dis 2015;21:1529–36. guide to monitoring and evaluating. Lyon:
15. Bravata DM, McDonald KM, Smith WM et al. 32. Hughes HE, Morbey R, Hughes TC et al. World Health Organization; 2006.
Systematic review: surveillance systems for Emergency department syndromic surveillance 50. Ortega JAA, Velazquez JGM, Renly SR et al.
early detection of bioterrorism-related diseases. providing early warning of seasonal respiratory Improving disease surveillance capabilities
Ann Intern Med 2004;140(11):910–22. activity in England. Epidemiol Infect through a public health information
16. Buckeridge DL, Burkom H, Campbell M et al. 2016;144(5):1052–64. affinity domain. Paper presented at 1st
Algorithms for rapid outbreak detection: a 33. Hurt-Mullen KJ, Coberly J. Syndromic ACM International Health Informatics
research synthesis. J Biomed Inform surveillance on the epidemiologist’s desktop: Symposium, IHI’10, Arlington, VA, 11–12
2005;38(2):99–113. making sense of much data. MMWR: Morbid November 2010.
17. Buckeridge DL, Burkom H, Moore A et al. Mortal W 2005;54(Suppl):141–6. 51. Reeder B, Hills RA, Demiris G et al. Reusable
Evaluation of syndromic surveillance systems – 34. Hutwagner ML, Thompson MW, Seeman GM design: a proposed approach to Public Health
design of an epidemic simulation model. et al. The bioterrorism preparedness and Informatics system design. BMC Public Health
MMWR: Morbid Mortal W response early aberration reporting system 2011;11.
2004;53(Suppl):137–43. (EARS). J Urban Health 2003;80(1): i89–96. 52. Reis BY, Mandl KD. Time series modeling for
18. Buehler JW, Berkelman RL, Hartley DM et al. 35. Josseran L, Caillère N, Brun-Ney D et al. syndromic surveillance. BMC Med Inform
Syndromic surveillance and bioterrorism- Syndromic surveillance and heat wave Decis Mak 2003;3(1):2.
related epidemics. Emerg Infect Dis morbidity: a pilot study based on emergency 53. Savel T, Hall K, Lee B et al. A Public Health
2003;9(10):1197–204. departments in France. BMC Med Inform Grid (PHGrid): architecture and value
19. Derby MP, McNally J, Ranger-Moore J et al. Decis Mak 2009;9(1):1. proposition for 21st century public health. Int J
Poison control center-based syndromic 36. Karras BT, O’Carroll P, Oberle MW et al. Med Inform 2010;79(7):523–9.
surveillance for foodborne illness. MMWR: Development and evaluation of public health 54. Scotch M, Yip KY, Cheung KH. Development
Morbid Mortal W 2005;54:35–40. informatics at University of Washington. J of grid-like applications for public health using
20. Doyle TJ, Ma H, Groseclose SL et al. PHSkb: a Public Health Man 2002;8(3):37–43. Web 2.0 Mashup techniques. J Am Med
knowledgebase to support notifiable disease 37. Koo D, O’Carroll P, LaVenture M. Public health Inform Assoc 2008;15(6):783–6.
surveillance. BMC Med Inform Decis Mak 101 for informaticians. J Am Med Inform Assoc 55. Shea DA, Lister SA. The BioWatch program:
2005;5:27. 2001;8(6):585–97. detection of bioterrorism, 2003. Congressional
21. Espino JU, Wagner MM, Tsui FC et al. The 38. Krause G, Altmann D, Faensen D et al. Research Service Report No. RL 32152.
RODS Open Source Project: removing a SurvNet electronic surveillance system for Available online at: https://fas.org/sgp/crs/
barrier to syndromic surveillance. Stud Health infectious disease outbreaks, Germany. Emerg terror/RL32152.html.
Technol Inform 2004;11(Pt 2):1192–6. Infect Dis 2007;13(10):1548–55. 56. Shmueli G, Burkom HS. Statistical
22. Fan C, van Dijk A, Fernando D et al. 39. Kukafka R. Public health informatics: the challenges in modern biosurveillance.
Automated mortality surveillance in south- nature of the field and its relevance to health Technometrics 2010;52(1):39–51.
Public health delivery in the information age: the role of informatics and technology
57. Siegrist D, Pavlin J. Bio-ALIRT biosurveillance 68. Yan P, Chen H, Zeng D. Syndromic surveillance 80. Sandt CH, Krouse DA, Cook CR et al. The key
detection algorithm evaluation. MMWR: Morbid systems. Annu Rev Inform Sci 2008;42(1):425– role of pulsed-field gel electrophoresis in
Mortal W 2004;53:152–8. 95. investigation of a large multiserotype and
58. Sosin DM. Draft framework for evaluating 69. Yasnoff WA, O’Carroll PW, Koo D et al. Public multistate food-borne outbreak of salmonella
syndromic surveillance systems. J Urban health informatics: improving and transforming infections centered in Pennsylvania. J Clin
Health 2003;80(1): i8–13. public health in the information age. J Public Microbiol 2006;44(9):3208–12.
59. Stoto MA, Fricker RD Jr, Jain A et al. Health Man 2000;6(6):67–75. 81. International Society for Disease Surveillance.
Evaluating statistical methods for syndromic 70. Yih WK, Caldwell B, Harmon R et al. National Tools and systems: surveillance tools. Available
surveillance. In: Wilson AG, Wilson GD, Olwell bioterrorism syndromic surveillance online at: http://www.syndromic.org/resources/
DH (eds). Statistical methods in demonstration program. MMWR: Morbid tools-and-systems
counterterrorism. New York: Springer; 2006, Mortal W 2004;53:43–6. 82. Brittain JM, Norris A. Delivery of health
pp. 141–72. 71. Yih WK, Deshpande S, Fuller C et al. informatics education and training. Health Libr
60. Surján G, Szilágyi É, Kováts T. A pilot Evaluating real-time syndromic surveillance Rev 2000;17(3):117–28.
ontological model of public health signals from ambulatory care data in four 83. Kukafka R, Yasnoff WA. Public health
indicators. Comput Biol Med 2006;36(7– states. Public Health Rep 2010;125:111–20. informatics. J Biomed Inform 2007;40(4):365–9.
8):802–16. 72. Friede A, Blum HL, McDonald M. Public health 84. Savel TG, Foldy S. The role of public health
61. Tang PC. AMIA advocates national health informatics: how information-age technology informatics in enhancing public health
information system in fight against national can strengthen public health. Annu Rev Public surveillance. MMWR Surveill Summ
health threats. J Am Med Inform Assoc Health 1995;16(1):239–52. 2012;61(Suppl):20–4.
2002;9(2):123–4. 73. Edmunds M, Thorpe L, Sepulveda M et al. The 85. Tomines A, Readhead H, Readhead A et al.
62. Tokars JI, Burkom H, Xing J et al. Enhancing future of public health informatics: alternative Applications of electronic health information in
time-series detection algorithms for automated scenarios and recommended strategies. public health: uses, opportunities & barriers.
biosurveillance. Emerg Infect Dis eGEMs 2014;2(4):1156. eGEMs 2013;1(2):1019.
2009;15(4):533–9. 74. Organisation for Economic Co-operation and 86. Norris A, Brittain J. Education, training and the
63. Uscher-Pines L, Farrell CL, Babin SM et al. Development. Improving value in health care: development of healthcare informatics. Health
Framework for the development of response measuring quality. Paris: Organisation for Inform J 2000;6(4):189–95.
protocols for public health syndromic Economic Co-operation and Development; 87. Williams F, Boren SA. The role of electronic
surveillance systems: case studies of 8 US 2010. medical record in care delivery in developing
states. Disaster Med Public Health Prep 75. Anderson GF, Frogner BK, Johns RA et al. countries. Int J Inform Manage
2009;3(Suppl S1): S29–36. Health care spending and use of information 2008;28(6):503–7.
64. Wagner MM, Espino J, Tsui F et al. Syndrome technology in OECD countries. Health Aff 88. Williams F, Boren SA. The role of the electronic
and outbreak detection using chief-complaint 2006;25(3):819–31. medical record (EMR) in care delivery
data – experience of the Real-Time Outbreak 76. Hope K, Durrheim DN, d’Espaignet ET et al. development in developing countries: a
and Disease Surveillance Project. MMWR: Syndromic surveillance: is it a useful tool for systematic review. Inform Prim Care
Morbid Mortal W 2004;53:28–31. local outbreak detection? J Epidemiol 2008;16(2):139–45.
65. Wagner MM, Tsui F-C, Espino J et al. National Commun H 2006;60(5):374. 89. Klingler C, Silva DS, Schuermann C et al.
retail data monitor for public health 77. Centers for Disease Control Prevention. Public Ethical issues in public health surveillance: a
surveillance. MMWR: Morbid Mortal W health preparedness: strengthening CDC’s systematic qualitative review. BMC Public
2004;53:40–2. emergency response. Atlanta, GA: Centers for Health 2017;17(1):295.
66. Wilson JM, Polyak MG, Blake JW et al. A Disease Control Prevention; January 2009. 90. Winslow C-E. The untilled fields of public
heuristic indication and warning staging model 78. Berndt DJ, Hevner AR, Studnicki J. health. Science 1920;51:23–33.
for detection and assessment of biological Bioterrorism surveillance with real-time data 91. Lumpkin JR. History and significance of
events. J Am Med Inform Assoc warehousing. In: Chen H, Miranda R, Zeng DD information systems and public health. New
2008;15(2):158–71. et al. (eds). Intelligence and security informatics. York: Springer; 2003.
67. Xue Y, Liang H. Is-driven process Berlin: Springer; 2003, pp. 322–35. 92. America IoMCoQoHCi. Crossing the quality
reengineering: China’s public health emergency 79. McKinney WP, Wesley GC, Sprang MV et al. chasm: a new health system for the 21st
response to the SARS crisis. J Inform Technol Educating health professionals to respond to century. Washington, DC: National Academies
Theory Appl 2004;6(3):41–58. bioterrorism. Public Health Rep 2005;120:42–47. Press; 2001.