Electronic Surveillance System For The Early Notification of Community Based Epidemics
Electronic Surveillance System For The Early Notification of Community Based Epidemics
Original Paper
Howard Burkom, MSc, DPhil; Wayne Loschen, BSc, MSc; Richard Wojcik, BSc, MSc; Rekha Holtry, BSc, MSc;
Monika Punjabi, BSc, MSc; Martina Siwek, MSc, PhD; Sheri Lewis, BSc, MSc
Johns Hopkins University Applied Physics Laboratory, Laurel, MD, United States
Corresponding Author:
Howard Burkom, MSc, DPhil
Johns Hopkins University Applied Physics Laboratory
11100 Johns Hopkins Road
Laurel, MD, 20723
United States
Phone: 1 240 228 5000 ext 4361
Email: [email protected]
Abstract
Background: The Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE) is
a secure web-based tool that enables health care practitioners to monitor health indicators of public health importance for the
detection and tracking of disease outbreaks, consequences of severe weather, and other events of concern. The ESSENCE concept
began in an internally funded project at the Johns Hopkins University Applied Physics Laboratory, advanced with funding from
the State of Maryland, and broadened in 1999 as a collaboration with the Walter Reed Army Institute for Research. Versions of
the system have been further developed by Johns Hopkins University Applied Physics Laboratory in multiple military and civilian
programs for the timely detection and tracking of health threats.
Objective: This study aims to describe the components and development of a biosurveillance system increasingly coordinating
all-hazards health surveillance and infectious disease monitoring among large and small health departments, to list the key features
and lessons learned in the growth of this system, and to describe the range of initiatives and accomplishments of local
epidemiologists using it.
Methods: The features of ESSENCE include spatial and temporal statistical alerting, custom querying, user-defined alert
notifications, geographical mapping, remote data capture, and event communications. To expedite visualization, configurable
and interactive modes of data stratification and filtering, graphical and tabular customization, user preference management, and
sharing features allow users to query data and view geographic representations, time series and data details pages, and reports.
These features allow ESSENCE users to gather and organize the resulting wealth of information into a coherent view of population
health status and communicate findings among users.
Results: The resulting broad utility, applicability, and adaptability of this system led to the adoption of ESSENCE by the Centers
for Disease Control and Prevention, numerous state and local health departments, and the Department of Defense, both nationally
and globally. The open-source version of Suite for Automated Global Electronic bioSurveillance is available for global,
resource-limited settings. Resourceful users of the US National Syndromic Surveillance Program ESSENCE have applied it to
the surveillance of infectious diseases, severe weather and natural disaster events, mass gatherings, chronic diseases and mental
health, and injury and substance abuse.
Conclusions: With emerging high-consequence communicable diseases and other health conditions, the continued user
requirement–driven enhancements of ESSENCE demonstrate an adaptable disease surveillance capability focused on the everyday
needs of public health. The challenge of a live system for widely distributed users with multiple different data sources and high
throughput requirements has driven a novel, evolving architecture design.
KEYWORDS
health surveillance; outbreak detection; population health
https://publichealth.jmir.org/2021/6/e26303 JMIR Public Health Surveill 2021 | vol. 7 | iss. 6 | e26303 | p. 1
(page number not for citation purposes)
XSL• FO
RenderX
JMIR PUBLIC HEALTH AND SURVEILLANCE Burkom et al
poison control call center data, prescription drug data, reportable During the ingestion process, data are cleansed (eg,
disease data, vital statistics mortality data, and school absentee duplicate records removed and invalid characters removed),
data. Once raw data reach ESSENCE, the analysis, visualization, updated (eg, existing records information is updated with
and communication features of ESSENCE allow the end user new information), and categorized (eg, syndrome and
to gather and organize the resulting wealth of information into subsyndrome categories assigned to records).
a coherent view of population health status and to communicate 2. Alerting: multiple temporal and spatial alerting algorithms
findings among other users and stakeholders. are applied to each data set to develop a list of alerts or
flags for further investigation by public health officials. In
As a result of ongoing user feedback daily and event-based
addition to algorithms developed by JHU/APL and the
disease surveillance needs, ESSENCE features include spatial
WRAIR, ESSENCE can incorporate algorithms required
and temporal statistical alerting, custom querying, user-defined
by the jurisdiction where the system is deployed.
alert notifications, geographical mapping, remote data capture, 3. Analysis and visualization: ESSENCE data and alerts can
and event communications.
be analyzed and visualized in multiple ways in the system,
ESSENCE provides three main functions: both spatially and temporally.
1. Data ingestion or preprocessing: traditional and These component functions are illustrated schematically in
nontraditional data sources are electronically received by Figure 1. They are introduced in the following sections, with
ESSENCE, and many are mapped to syndrome groupings. an additional file for each to provide details.
Figure 1. Schematic overview of Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE) features
showing a sampling of users’ data types, analysis modes, and screen interfaces. ED: emergency department; GIS: geographic information system.
tissues; social media posts and searches; and fantasy sports data. and gastrointestinal subsyndromes, such as asthma.
Multiple content formats used in ESSENCE include Health Categorization soon switched to the use of free-text chief
Level-7 (HL-7) formats for hospital data and National complaint or reason-for-visit data fields. For this categorization,
Emergency Medical Services Information System (NEMSIS) the JHU/APL ESSENCE team developed the Chief Complaint
formats for emergency medical services data. File formats Processor (CCP), a versatile, stand-alone program for weighted
include delimited or tabbed or fixed-width American Standard keyword-based classification by free-text fields. The CCP is
Code for Information Interchange (ASCII) text, XML, and highly configurable, with tables including sets of syndromes
JavaScript Object Notation (JSON). and subsyndromes with classification rules allowing complex
logic, positive and negative weighting of component terms,
Each data source has its own challenges for user jurisdictions
abbreviation and spelling rules, and a list of unmodifiable terms.
to obtain sustained electronic access from data providers and
For example, CCP puts a record with a chief complaint of
any requisite government approval. When a data stream of any
nausea or vomiting in the gastrointestinal category. The CCP
of these sources is acquired for routine monitoring, an immediate
creates a ChiefComplaintsParsed field for the use of
question is how to use the streaming data to track the health
classification rules after treatment of abbreviations, some
outcomes of interest. An often-applied procedure is to track the
misspellings, and other cleanup [14]. These classifications have
counts of subcategories of the data expected to correspond to
enabled additional natural language processing and machine
these outcomes. These subcategories are commonly called
learning initiatives by both ESSENCE developers and users,
syndromes, generalizing the medical definition of this term,
and findings from these initiatives are shared among users with
denoting disease-related collections of signs and symptoms.
each emerging health threat [15-17].
Thus, in the surveillance context, a syndrome may refer to
grouped hospital visits associated with a fixed collection of As with diagnosis code-based processing, syndrome groups are
symptoms, laboratory tests ordered for certain conditions, web tabulated, plotted, and monitored each day with statistical
searches containing sets of terms, billing records covering any alerting algorithms for early potential outbreak indications.
of a class of remedies, or other subgroups depending on the data
source. Syndrome formation is a critical step that may use only
Architecture, Security, Preprocessing, and Quality
a fraction of all streaming data and may produce few or many Management
groups to track. The number and composition of syndromes The software architecture used for ESSENCE is a 3-tier web
depend on the richness of the data, the number of outcomes of application with a presentation layer as a user front end, a
interest, and the resources of the monitoring institution for business layer for the application of algorithms, and a back end
investigation and response. for databases. All automated data transfers occur over secure
virtual private networks. Multiple, data-dependent preprocessing
Syndromes and subsyndromes used in ESSENCE vary
steps include deduplication procedures, formation of syndrome
depending on the available clinical grouping systems and the
fields, calculation of distances, and derivation of additional
needs of the user site. Early versions of ESSENCE formed
fields and flags based on jurisdictional business rules and logic.
syndrome groups using diagnosis codes, which have
The flow diagram is shown in Figure 2. Multimedia Appendix
disadvantages of late assignment and emphasis on billing
2 describes these features in detail.
practice in many medical systems. Examples include respiratory
Figure 2. Flow diagram illustrating typical Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE)
data flow with databases and tables, generalized to account for diversity among user needs and server configurations. API: application program interface;
ED: emergency department; GIS: geographic information system.
Individual alerting algorithms implemented in ESSENCE are infections, gastrointestinal infections caused by contaminated
listed and described in Multimedia Appendix 3. food or water, and rarer infections.
Visualization Surveillance systems were particularly helpful in tracking the
Both standard and user-customizable visualizations are available pandemic of the novel H1N1 influenza in 2009 [24]. The
in ESSENCE, many shaped in response to user ideas and pandemic was important as an interregional use of surveillance
requests. Highly configurable and interactive modes of data systems to track a common threat. For example, the National
stratification and filtering, graphical and tabular customization, Capital Region Disease Surveillance Network, comprising
user preference management, and sharing features allow users ESSENCE users at health departments in the District of
to query data and view geographic representations, time series Columbia and parts of the states of Maryland and Virginia,
and data details pages, and reports. Figure 2 shows examples shares population-level disease incidence information to promote
of the standard plots and maps. Multimedia Appendix 4 (Figures interjurisdictional surveillance. In 2009, this network allowed
S1-S4) summarizes key features with explanations and National Capital Region public health practitioners to track the
screenshots of novel visualizations developed for ESSENCE course of the pandemic from the spring through the fall,
to fulfill requests of the user community. comparing the overall and age-specific burden of illness to
national and neighboring state trends. A broader collaboration
Results between ESSENCE and non-ESSENCE system users adopted
a standardized definition of influenza-like illness to enable
Overview of Findings uniform local tracking of the pandemic across the United States
[25].
The results in this section represent a broad range of ESSENCE
applications, especially those not previously published in the Users have applied ESSENCE to form and share queries for
peer-reviewed literature, which demonstrate how ESSENCE indications of other infectious diseases using text from chief
monitors health threats at national, state, and local jurisdictions. complaints, discharge diagnosis, and triage notes when available.
Rather than giving the results of one analytic method applied Infectious threats tracked in published examples include general
to a particular data set, we show the results of the data waterborne diseases [26], tuberculosis [17], rabies [27], and
architecture, analytics, and visualizations described in the Middle East Respiratory Syndrome [15]. In recent years,
previous section for public health objectives achieved by users. concerns over mosquito-borne diseases have generated new
The following sections demonstrate the system simplicity, queries by multiple users and occasionally uncovered important
flexibility, and acceptability, key attributes from published cases [16].
system evaluation guidelines [18]. The examples in these
The health department of Maricopa County, Arizona, presented
sections were chosen to show the breadth and depth of the
an example of the benefits of surveillance systems in June 2018.
application to meet these criteria. For the other attributes, each
The department had added an ESSENCE query for signs of
ESSENCE user has local surveillance objectives and constraints
Rocky Mountain spotted fever, which is not endemic to that
that impose the requirements of performance metrics, such as
county, because of concerns that cases transferred from endemic
sensitivity, positive predictive value, and timeliness. Algorithms
areas might be missed. A child’s patient record was signaled
described in the analytic details supplement were developed to
by the query, and the department contacted the hospital. This
maximize the local sensitivity or positive predictive value
contact led to the reversal of a medication decision that might
tradeoff and other practical metrics.
have been fatal to the child [28].
In addition to the versions used and shared by the US
Such monitoring activities have repeatedly uncovered unreported
surveillance community, the applications below refer to the
cases of diseases for which reporting is mandatory [29]. These
open-source Suite for Automated Global Electronic
findings illustrate the importance of redundancy with systems
bioSurveillance (SAGES) toolkit that ESSENCE developers
such as ESSENCE to avoid missing important cases, even when
have provided for non-US health monitors, including
traditional reporting mandates exist.
OpenESSENCE and ESSENCE Desktop editions [19,20]. On
the basis of the features and functionality of ESSENCE, tools At the submission of this manuscript, the intense collaboration
within SAGES were developed specifically for use in low- and of ESSENCE users is focused on tracking the COVID-19
middle-income countries with limited resources but do not pandemic. General queries on COVID-like illness and specific
include some of the more recent analytics and visualization ones involving pneumonia and specific symptom sets are being
tools requested by users across the NSSP. refined and shared [30].
Infectious Disease Applications Applications for Tracking Burden of Severe Weather
Early applications of ESSENCE focused on the detection of and Natural Disaster Events
infectious disease outbreaks, with much attention paid to Health departments have used ESSENCE for preparedness,
influenza-like illness because it is a prodrome for multiple health burden assessment, and response to severe storms and
naturally occurring diseases and for many potentially other natural disasters. The state of Oregon conducted a
weaponized for bioterrorism [21,22]. Civilian [23], military successful program to mitigate the effects of wildfires [31]. This
[22], and VA [24] ESSENCE users monitored for outbreaks of program featured customized ESSENCE queries with other
seasonal and nonseasonal outbreaks of febrile respiratory coordinated efforts among state and local health departments
and preparedness teams. Among several states that use
https://publichealth.jmir.org/2021/6/e26303 JMIR Public Health Surveill 2021 | vol. 7 | iss. 6 | e26303 | p. 6
(page number not for citation purposes)
XSL• FO
RenderX
JMIR PUBLIC HEALTH AND SURVEILLANCE Burkom et al
ESSENCE to monitor the effects of hurricanes, the Tennessee Applications for Chronic Disease and Mental Health
Health Department devised queries to determine the volume Surveillance
and clustering of patients in local hospitals because of storms
The use of ESSENCE to monitor risk factors and incidence of
in other states [32]. Effective monitoring of some events requires
chronic disease and mental health disorders has proliferated
a combination of multiple data sources. Following a prolonged
since a DoD ESSENCE study using clinic and prescription data
storm-related power outage, the health department of
to monitor behavioral health in 2004 [41]. The Boulder County,
Seattle-King County, Washington, combined data from the
Colorado Health Department recently implemented and tested
ESSENCE ED data with ambulance calls and public utility data
multiple queries to monitor mental health [42].
to monitor for cases and clusters of carbon monoxide poisoning
and food poisoning [33]. More recently, the Florida Health Addressing ESSENCE utility for chronic diseases in general,
Department monitored carbon monoxide poisoning after the Cook County Illinois health department applied machine
Hurricane Irma in 2017 [34]. Institutions using ESSENCE are learning methods to assess the utility of ESSENCE ED data for
increasingly incorporating environmental and other data sources monitoring cardiovascular disease, acute myocardial infarction,
in their systems for richer situational awareness of acute coronary syndrome, stable angina, stroke, diabetes,
disaster-related health threats [35,36]. hypertension, asthma, and chronic obstructive pulmonary
disease. From correlational validation testing based on 8 full
Applications for Mass Gathering Surveillance years of chief complaint text and electronic medical record data,
Scheduled mass gathering events such as political conventions they concluded that ESSENCE data are suitable for monitoring
and major athletic competitions concern population health all these conditions except stable angina and hypertension “at
monitors because (1) such events are bioterrorism opportunities local, state, or national levels” [43]. The Nebraska State Health
to harm many victims and gain media attention, (2) infections Department has used ESSENCE to monitor for cardiovascular
through contaminated food or water could spread rapidly disease for several years, and the Florida State Department
through the expanded population, (3) those visiting for several similarly monitors acute myocardial infarction incidence [44].
days could import infections or take them back to their own
cities, and (4) a surge of patients could overwhelm local care Applications for Injury and Substance Abuse
provider resources. Adequate preparedness and response require Surveillance
coordination across jurisdictional boundaries, but privacy laws An unexpected but arguably the most helpful benefit of
often restrict patient-level data sharing. ESSENCE syndrome ESSENCE to health department users is to facilitate
definitions and queries have been customized for many such communication and collaboration among agency divisions. An
events. In 2007, Marion County, Indiana, and Cook County, important example in the context of the ongoing opioid overdose
Illinois, were home counties for the competing teams in Super crisis has been the strengthening of connections between
Bowl XLI, and the game was hosted in Miami-Dade, Florida. syndromic surveillance specialists and groups specializing in
The health departments of these geographically distant counties injury prevention, behavioral health, and drug abuse.
were ESSENCE users, and customization of their systems for Adaptations of ESSENCE included queries for both prescription
the days surrounding the event helped coordinate surveillance and illicit drug types and overdose cluster detection to help
despite only 2 weeks’ notice after the teams were determined inform public health response tactics, such as needle exchange
[37]. and naloxone distribution.
A partnership between the Florida Department of Health and Multiple health departments have applied ESSENCE to gain
the US HHS Office of the Assistant Secretary for Preparedness awareness of the locations and subpopulations at risk of injuries
and Response to improve the response of Disaster Medical from falls [45]. The Boston Public Health Commission in
Assistance Teams produced a new ESSENCE module that was Massachusetts used it to monitor for hearing loss, acute
deployed for health monitoring of the 2012 Republican National depression, and explosion-related injuries in the aftermath of
Convention in Tampa [36]. State and county health departments the 2013 Boston Marathon bombing and subsequent manhunt.
used ESSENCE for coordinated monitoring of crowds at the The St Louis Missouri Health Department established ESSENCE
US Olympic Trials in July 2016 [38]. In January 2017, the queries for injuries indicative of bomb-making activities [46].
Washington DC Department of Health used ESSENCE queries
Monitoring for substance abuse is common among ESSENCE
along with other data sources for health surveillance at the 58th
users. The Tri-County Health Department in Colorado uses its
US presidential inauguration [39].
system to investigate the adverse effects of marijuana use [47].
For monitoring of events outside the United States, JHU/APL The Florida State Department queries for ED visits resulting
developed the SAGES system, the open-source version of from synthetic marijuana [48] and for novel street drugs, such
ESSENCE designed for global resource-limited settings, in as Flakka, as they become known public health problems [49].
2014 to monitor the 8th Micronesian Games held in Federated Recently, the opioid crisis has stimulated intense collaboration,
States of Micronesia, Pohnpei, and the 3rd International including shared syndrome definitions and analytic case-finding
Conference on Small Island Developing States in Apia, Samoa tools among geographically scattered institutions using
[40]. ESSENCE [50-52].
The ongoing adaptation of ESSENCE to meet the needs of the
understaffed public health practice community has provided a
means to share methods and information, although data are
https://publichealth.jmir.org/2021/6/e26303 JMIR Public Health Surveill 2021 | vol. 7 | iss. 6 | e26303 | p. 7
(page number not for citation purposes)
XSL• FO
RenderX
JMIR PUBLIC HEALTH AND SURVEILLANCE Burkom et al
often not shareable. The common analytic platform has enabled practices, and epidemiological concerns. Typically, users cannot
an evolving user ecosystem of multiple working groups, and wait for several minutes for data retrieval and time-consuming
the US CDC currently hosts the NSSP Community of Practice, model runs. Alerting algorithms applied prospectively to detect
with subgroups including Syndrome Definition, Data Quality, disparate events in a wide variety of data types cannot match
and Technical Committees [53]. The Syndrome Definitions the detection performance of models developed retrospectively
committee promotes the analysis of common queries among using historical data sets labeled with target events for a
geographically scattered user sites and the US CDC [54], thus particular syndrome. The ESSENCE algorithm baselines do not
improving communication between local and national health span years, not only for storage and computational reasons but
monitors. Epidemiologists, system designers, and other also because for many users’ desired data types, stable data or
stakeholders may find and share resources on committee any data are available only within the past year. Hence,
websites and through the NSSP Knowledge Repository [30]. A ESSENCE alerting algorithms, adapted from published
primary example is the opioid overdose crisis, a noninfectious applications of models and control charts in health care settings
threat. In addition to analytics and visualizations to support the [55-57], use rolling baselines of weeks rather than years.
activities related to this crisis, developers and users have worked
together to acquire additional data sources, such as emergency
Facilitating Communication
medical incidents, poison center calls, and death records, to Multiple ESSENCE users have remarked that one of the
determine the benefit of fusing information varying in specificity system’s main benefits has been to facilitate communication
and timeliness into a common surveillance picture to better with other divisions within a health department, with external
inform awareness and interventions. local and federal agencies, and with care facilities that provide
data and can benefit from the broader geographic perspective
Regarding data standards that are essential among the many that a surveillance system enables. Hence, substantial ESSENCE
NSSP stakeholders, Multimedia Appendix 2 refers to the development has occurred in response to user requests for
reference tables and business logic to convert data field entries custom analysis comparisons, visualizations, and report formats,
into categorical values from standard sources such as the Public allowing overburdened users to concentrate on the task of
Health Information Network Vocabulary Access and routine health monitoring. In situations where data sharing is
Distribution System and from evolving standards developed by precluded by county or state regulations, ESSENCE
NSSP Data Sharing and Syndrome Definitions workgroups. communication tools have enabled information sharing. The
sharing and query-building tools in the visualization section
Discussion have been increasingly used to enhance collaboration among
NSSP subcommittees as well as individual users.
Principal Findings
In the Results section, the multiple applications of ESSENCE Multiple Analysis Modes
installations by health departments at various levels and the The applicability of individual analysis modes, such as
surveillance community initiatives enabled and expedited by univariate and multivariate time series monitoring,
the system illustrate the combined effect of the technical spatiotemporal cluster detection, and single case identification
components described in the Methods section and developed all depend on the nature and quality of available data. For
over 20 years, driven by the major influence of public health example, the spatial scan statistic implemented in ESSENCE
users. The following sections describe the lessons learned, key can avoid issues of jurisdictional boundaries, but only if data
innovations, and user-driven enhancements. location fields are present and reliably represented in the data.
In many data sources, the limitation of location fields to zip
Lessons Learned
codes or postal codes restricts the geographic precision of
Several principles have driven the success of ESSENCE since clusters of interest. Health monitors generally require multiple
its origins in the late 1990s. methods to analyze population health data. A notable example
Versatility is that ESSENCE users in multiple health departments have
discovered unreported cases of reportable disease that traditional
Users have valued the configurability and adaptability of sentinel surveillance is mandated to communicate to public
ESSENCE. Default categorization of complex data into health. The various analysis modes of ESSENCE provide
syndromic groupings has always been valuable to users who affordable and sometimes beneficial redundancy and safety net
are inexperienced or who do not have the time to formulate or functionality.
validate their own categories for monitoring. Conversely, health
departments with greater analysis capacity have long demanded The following list summarizes these lessons for developers of
surveillance systems that allow them to create their own other systems:
categories to track, and ESSENCE customization with • Accommodation for a variety of processing systems and
query-building features using both diagnosis codes and free text data types, flow, and format.
has grown along with the sophistication and broadening needs • Features facilitating shareable ad hoc queries and reports
of health department users. Precomputed, canned analysis to investigate novel concerns.
products are not found in ESSENCE. However, versatility • A suite of analytic tools allowing multiple looks at available
presents challenges to database design and to the selection and data, tools that provide prompt feedback and do not require
adaptation of statistical analysis tools. Surveillance data evolve years of data history.
with institutional information systems and formats, coding
https://publichealth.jmir.org/2021/6/e26303 JMIR Public Health Surveill 2021 | vol. 7 | iss. 6 | e26303 | p. 8
(page number not for citation purposes)
XSL• FO
RenderX
JMIR PUBLIC HEALTH AND SURVEILLANCE Burkom et al
• Provision of default views as well as tools to modify and categories of patients who use health care systems that provide
arrange them as desired while avoiding canned or data to ESSENCE. These tools can show patient-level usage
precomputed visualizations. trends to inform the allocation of health care resources in a
• Integrated collaboration features and user events to foster community.
direct community involvement in system evolution.
Conclusions
Innovation Installations of ESSENCE have provided systems capable of
The development of ESSENCE has produced novel features in meeting public health surveillance requirements at multiple
areas of complex, disparate data management, analytical levels of purview and jurisdiction. The data architecture runs
methods, and the enhancement of user reporting and on modular configurations of a variable number of servers, with
collaboration, interrelated efforts to empower health monitors. the number contingent on the data volume, number of active
The data management advances include architecture and data users, and frequency of required analysis operations; hence, the
transfer capabilities to meet the needs of institutions with ESSENCE data architecture accommodates the acquisition and
varying resources. Analytics advances require data quality transfer processes of small and very large health departments.
examination methods and alerting algorithms appropriate for Essential to the growth of ESSENCE has been the capability
diverse data time series that meet rapid response needs and do provided to the user community to drive system development
not require more than a few months of data history. User to meet its evolving needs. Users are provided with multiple
experience enhancements include customizable visualization syndrome and subsyndrome categories but are not limited by
and reporting features that provide unique time- and them or by canned or precomputed visualizations. Tools are
resource-saving capabilities. provided to build simple or arbitrarily complex queries and
dashboards for routine monitoring. The rich set of analytic
User-Driven Enhancements methods includes alerting algorithms and other tracking tools
Recent ESSENCE projects have produced a variety of user applicable to sparse or rich data streams, with adjustment for
capability enhancements. For sharing information within and only the most common data issues. These tools require historical
across jurisdictions, web-based features allow users to share baseline data of at most a few months, both accommodating
what they are doing within ESSENCE with peers and to see limited historical data and providing fast turnaround for
what others are querying and find interesting. Text analysis and understaffed public health monitors. Although these algorithms
visualizations facilitate the creation of ad hoc local free-text cannot be tuned to particular syndromic categories or health
queries. These features provide correlation, trend, and events as in retrospective studies, they are designed for a range
association analytics to help the user determine what terms or of common data types and behaviors. Current data missingness
phrases should or should not be included in queries. and lateness indicators are also provided to help users assess
Back-end tools and checks with visualizations allow the user the reliability of the visualizations and statistics that they view.
to closely monitor the local ESSENCE system for data issues Finally, ESSENCE provides a growing suite of communications
and irregularities. These administrative capabilities help capabilities for customizable reporting, sharing, and convenient
managers and users maintain day-to-day system availability download for additional analytics. These combined features
and improve the visibility of issues that may develop over time. have streamlined onboarding, promoted methods and
information sharing among the public health community, and
Recently added visualizations and cohort clustering analytic enabled the diverse, all-hazards applications described earlier.
tools for longitudinal assessment allow users to determine
Acknowledgments
The authors would like to acknowledge the invaluable assistance provided by their colleagues and partners. The continued
ESSENCE research and development would not have been possible without the support of the CDC, DoD, VA, numerous state
and local health departments, and JHU/APL over the last 20 years. The authors especially acknowledge the numerous champions
and advisors among ESSENCE users who have dedicated time and effort to the betterment of public health surveillance.
Conflicts of Interest
None declared.
Multimedia Appendix 1
The Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE) history highlights.
[DOC File , 36 KB-Multimedia Appendix 1]
Multimedia Appendix 2
The Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE) data architecture,
security, and preprocessing.
[DOC File , 85 KB-Multimedia Appendix 2]
Multimedia Appendix 3
Principles and details of The Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE)
alerting algorithms.
[DOC File , 257 KB-Multimedia Appendix 3]
Multimedia Appendix 4
Visualization tools in the Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE).
[DOC File , 714 KB-Multimedia Appendix 4]
References
1. Mandl KD, Overhage JM, Wagner MM, Lober WB, Sebastiani P, Mostashari F, et al. Implementing syndromic surveillance:
a practical guide informed by the early experience. J Am Med Inform Assoc 2004 Nov 21;11(2):141-150 [FREE Full text]
[doi: 10.1197/jamia.M1356] [Medline: 14633933]
2. Paterson BJ, Durrheim DN. The remarkable adaptability of syndromic surveillance to meet public health needs. J Epidemiol
Glob Health 2013 Mar;3(1):41-47 [FREE Full text] [doi: 10.1016/j.jegh.2012.12.005] [Medline: 23856537]
3. Thomas M, Yoon P, Collins J, Davidson A, Kenzie WR. Evaluation of syndromic surveillance systems in 6 US state and
local health departments. J Public Health Manag Pract 2018;24(3):235-240 [FREE Full text] [doi:
10.1097/PHH.0000000000000679] [Medline: 28961606]
4. Sosin D, DeThomasis J. Evaluation challenges for syndromic surveillance--making incremental progress. Morb Mortal
Wkly Rep 2004 Sep 24;53:125-129 [FREE Full text] [Medline: 15714641]
5. Lewis MD, Pavlin JA, Mansfield JL, O'Brien S, Boomsma LG, Elbert Y, et al. Disease outbreak detection system using
syndromic data in the greater Washington DC area. Am J Prev Med 2002 Oct;23(3):180-186. [doi:
10.1016/s0749-3797(02)00490-7] [Medline: 12350450]
6. Lombardo J, Burkom H, Elbert E, Magruder S, Lewis SH, Loschen W, et al. A systems overview of the electronic surveillance
system for the early notification of community-based epidemics (ESSENCE II). J Urban Health 2003 Jun;80(2 Suppl
1):32-42 [FREE Full text] [doi: 10.1007/pl00022313] [Medline: 12791777]
7. Siegrist D, Pavlin J. Bio-ALIRT biosurveillance detection algorithm evaluation. Morb Mortal Wkly Rep 2004 Sep
24;53:152-158 [FREE Full text] [Medline: 15714645]
8. Biosense platform quick start guide to using ESSENCE. National Syndromic Surveillance Program. 2017. URL: https:/
/www.cdc.gov/nssp/biosense/docs/biosense-platform-quick-start-guide-for-essence.pdf [accessed 2017-04-24]
9. Kumar RS, White JR. Impact of the NSSP’s transition to ESSENCE on chief complaint field-based syndromes. Online J
Public Health Inform 2018 May 22;10(1):8365. [doi: 10.5210/ojphi.v10i1.8365]
10. National Syndromic Surveillance Program (NSSP). Centers for Disease Control and Prevention. 2021. URL: https://www.
cdc.gov/nssp/overview.html#bioSense [accessed 2021-03-14]
11. German R, Lee L, Horan J, Milstein R, Pertowski C, Waller M, Guidelines Working Group Centers for Disease
ControlPrevention (CDC). Updated guidelines for evaluating public health surveillance systems: recommendations from
the Guidelines Working Group. MMWR Recomm Rep 2001 Jul 27;50(RR-13):1-35. [Medline: 18634202]
12. Disaster medical assistance teams. Office of the Assistant Secretary for Preparedness and Response - U.S. Department of
Health and Human Services. 2017. URL: https://www.phe.gov/Preparedness/responders/ndms/ndms-teams/Pages/dmat.
aspx [accessed 2019-12-18]
13. National Poison Data System. American Association of Poison Control Centers (AAPCC). 2019. URL: https://aapcc.org/
national-poison-data-system [accessed 2020-11-01]
14. Sniegoski CA. Automated syndromic classification of chief complaint records. Johns Hopkins Apl Technical Digest
2004;25(1):68-75 [FREE Full text]
15. Munroe J, Straver R, Rubino H, Pritchard S, Atrubin D, Hamilton JJ. MERS PUI surveillance and restrospective identification
in ESSENCE-FL, 2013-2015. Online J Public Health Inform 2017 May 02;9(1):7696. [doi: 10.5210/ojphi.v9i1.7696]
16. Centers for Disease Control and Prevention. Florida Department of Health Syndromic Surveillance identifies unreported
cases of zika virus disease, 2016–2017. National Syndromic Surveillance Program (NSSP). 2019. URL: https://www.
cdc.gov/nssp/success-stories/FL-Zika.
html#:~:text=Syndromic%20surveillance%20identified%2017%20Zika,locally%20spread%20Zika%20virus%20disease
[accessed 2019-09-03]
17. Wiese M, Atrubin D, McDougle W, Lewis J. Effectiveness of using a chief complaint and discharge diagnosis query in
ESSENCE-FL to identify possible tuberculosis patients and contacts in Hillsborough County, Florida. Online J Public
Health Inform 2014;6(1):e36. [doi: 10.5210/ojphi.v6i1.5080]
18. Buehler J, Hopkins R, Overhage J, Sosin D, Tong V, CDC Working Group. Framework for evaluating public health
surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR Recomm
Rep 2004 May 07;53(RR-5):1-11 [FREE Full text] [Medline: 15129191]
19. Lewis SL, Feighner BH, Loschen WA, Wojcik RA, Skora JF, Coberly JS, et al. SAGES: a suite of freely-available software
tools for electronic disease surveillance in resource-limited settings. PLoS One 2011 May 10;6(5):e19750 [FREE Full text]
[doi: 10.1371/journal.pone.0019750] [Medline: 21572957]
20. Lewis S, Feighner B, Loschen W, Wojcik R, Skora J, Coberly J, et al. An overview of suite for automated global electronic
biosurveillance (SAGES). In: Proceedings of the Conference on Sensing Technologies for Global Health, Military Medicine,
Disaster Response, and Environmental Monitoring II; and Biometric Technology for Human Identification IX. 2012
Presented at: SPIE Defense, Security, and Sensing; 2012; Baltimore, Maryland, United States p. 23-25. [doi:
10.1117/12.944300]
21. Franz D, Jahrling P, Friedlander A, McClain DJ, Hoover DL, Bryne WR, et al. Clinical recognition and management of
patients exposed to biological warfare agents. J Am Med Assoc 1997 Aug 06;278(5):399-411. [doi: 10.1001/jama.278.5.399]
[Medline: 9244332]
22. Marsden-Haug N, Foster VB, Gould PL, Elbert E, Wang H, Pavlin JA. Code-based syndromic surveillance for influenzalike
illness by International Classification of Diseases, Ninth Revision. Emerg Infect Dis 2007 Feb;13(2):207-216 [FREE Full
text] [doi: 10.3201/eid1302.060557] [Medline: 17479881]
23. Hopkins RS, Kite-Powell A, Goodin K, Hamilton JJ. The ratio of emergency department visits for ILI to seroprevalence
of 2009 Pandemic Influenza A (H1N1) Virus Infection, Florida, 2009. PLoS Curr 2014 Jun 30;6:A [FREE Full text] [doi:
10.1371/currents.outbreaks.44157f8d90cf9f8fafa04570e3a00cab] [Medline: 25914856]
24. Schirmer P, Lucero C, Oda G, Lopez J, Holodniy M. Effective detection of the 2009 H1N1 influenza pandemic in U.S.
Veterans Affairs medical centers using a national electronic biosurveillance system. PLoS One 2010 Mar 04;5(3):e9533
[FREE Full text] [doi: 10.1371/journal.pone.0009533] [Medline: 20209055]
25. Burkom H, Baer A, Paladini M, Revere D, McIntyre A. Analytic evaluation of a standardization effort for the distribute
emergency department surveillance project. Proceedings of the Joint Statistical Meetings. 2011. URL: https://ww2.amstat.org/
meetings/jsm/2011/index.cfm?fuseaction=proceedings [accessed 2021-05-25]
26. Kuspis K, Jagger M, Powell M, Hillwig R. Recognizing recreational water exposure and habituating HAB surveillance in
ESSENCE. Online J Public Health Inform 2018 May 22;10(1):2018-2005 [FREE Full text] [doi: 10.5210/ojphi.v10i1.8957]
27. Bemis K, Frias M, Patel MT, Christiansen D. Using an emergency department syndromic surveillance system to evaluate
reporting of potential rabies exposures, Illinois, 2013-2015. Public Health Rep 2017;132(1_suppl):59S-64S [FREE Full
text] [doi: 10.1177/0033354917708355] [Medline: 28692394]
28. Centers for Disease Control and Prevention. Arizona monitors transfer of patients with RMSF from tribal lands to facilities
in Maricopa County. National Syndromic Surveillance Program (NSSP). 2019. URL: https://www.cdc.gov/nssp/
success-stories/AZ-RMSF.html [accessed 2019-09-03]
29. O'Connell EK, Zhang G, Leguen F, Llau A, Rico E. Innovative uses for syndromic surveillance. Emerg Infect Dis 2010
Apr;16(4):669-671 [FREE Full text] [doi: 10.3201/eid1604.090688] [Medline: 20350382]
30. NSSP knowledge repository: syndrome definition subcommittee calls. NSSP Community of Practice. URL: https://www.
cste.org/page/nsspcop [accessed 2020-01-22]
31. Powell M, Boyd L. Tracking health effects of wildfires: the oregon ESSENCE wildfire pilot project. Online J Public Health
Inform 2017 May 02;9(1):2017-2005 [FREE Full text] [doi: 10.5210/ojphi.v9i1.7727]
32. Wiedeman C, Shaffner J, Squires K, Leegon J, Murphree R, Petersen P. Monitoring out-of-state patients during a 2017
hurricane response using ESSENCE. Online J Public Health Inform 2018 May 22;10(1):8936 [FREE Full text] [doi:
10.5210/ojphi.v10i1.8936]
33. Baer A, Elbert Y, Burkom HS, Holtry R, Lombardo JS, Duchin JS. Usefulness of syndromic data sources for investigating
morbidity resulting from a severe weather event. Disaster Med Public Health Prep 2011 Mar 08;5(1):37-45. [doi:
10.1001/dmp.2010.32] [Medline: 21402825]
34. Falise AM, Griffin I, Fernandez D, Rodriguez X, Moore E, Barrera A, et al. Carbon monoxide poisoning in Miami-Dade
County following hurricane irma in 2017. Disaster Med Public Health Prep 2019 Feb;13(1):94-96. [doi: 10.1017/dmp.2018.67]
[Medline: 30012229]
35. Laing R. Integrating poison center data into oregon ESSENCE using a low-cost solution. Online J Public Health Inform
2017 May 02;9(1):7620. [doi: 10.5210/ojphi.v9i1.7620]
36. Eggers C, Passman D, Chern A, Spector D, Kite-Powell A, Davis T, et al. Operational experience: integration of ASPR
data into ESSENCE-FL during the RNC. Online J Public Health Inform 2013;5(1):4550 [FREE Full text] [doi:
10.5210/ojphi.v5i1.4550]
37. Lombardo J, Sniegoski C, Loschen W, Westercamp M, Wade M, Dearth S, et al. Public health surveillance for mass
gatherings. Johns Hopkins APL Technical Digest 2008;27(4):347-355 [FREE Full text]
38. Jagger MA, Jaramillo S, Boyd L, Johnson B, Reed KR, Powell M. Mass gathering surveillance: new ESSENCE report and
collaboration win gold in OR. Online J Public Health Inform 2017 May 02;9(1):7719. [doi: 10.5210/ojphi.v9i1.7719]
39. Garrett-Cherry TA, Hennenfent AK, McGee S, Davies-Cole J. Enhanced one health surveillance during the 58th Presidential
Inauguration-District of Columbia, January 2017. Disaster Med Public Health Prep 2020 Apr;14(2):201-207. [doi:
10.1017/dmp.2019.38] [Medline: 31331411]
40. Hoy D, Mercier A, White P, Saketa ST, Roth A, Souares Y, et al. Using SAGES Open ESSENCE for mass gathering events.
Online J Public Health Inform 2015 Feb 26;7(1):5800. [doi: 10.5210/ojphi.v7i1.5800]
41. Pavlin J, Murdock P, Elbert E. Conducting population behavioral health surveillance by using automated diagnostic and
pharmacy data systems. MMWR Suppl 2004;53:24-72. [doi: 10.1037/e307182005-029]
42. Sussman L, Brown T. Online J Public Health Inform 2019 May 30;11(1):9773. [doi: 10.5210/ojphi.v11i1.9773]
43. Patel MT. Assessment of the use of ED Chief Complaint Data for monitoring chronic diseases. Online J Public Health
Inform 2018 May 22;10(1):2018-2005 [FREE Full text] [doi: 10.5210/ojphi.v10i1.8354]
44. Culpepper A, Atrubin D, Hamilton J, Cui D. Day of week analysis of myocardial infarctions using ESSENCE-FL emergency
department data. Lightning Talks 2016;8(1):6471 [FREE Full text] [doi: 10.5210/ojphi.v8i1.6471]
45. Hensley J, Gonzalez S, Stover D, Safranek T, Qu M. Evaluation of ESSENCE syndromic definitions for ED visits related
to falls in icy weather. Online J Public Health Inform 2019 May 30;11(1):9920. [doi: 10.5210/ojphi.v11i1.9920]
46. Torgerson A. Using ESSENCE to detect bomb-making activity: what’s appropriate? Online J Public Health Inform 2018
May 22;10(1):8986 [FREE Full text] [doi: 10.5210/ojphi.v10i1.8986]
47. Marx GE, Chen Y, Askenazi M, Albanese BA. Syndromic surveillance of emergency department visits for acute adverse
effects of marijuana, Tri-County Health Department, Colorado, 2016-2017. Public Health Rep 2019;134(2):132-140 [FREE
Full text] [doi: 10.1177/0033354919826562] [Medline: 30721641]
48. Wiese M, Clark CR. Analysis of ED and UCC visits related to synthetic marijuana in ESSENCE-FL, 2010-2015. Online
J Public Health Inform 2016 Mar 24;8(1):6594. [doi: 10.5210/ojphi.v8i1.6594]
49. Atrubin D, Bowden S, Hamilton J. Using syndromic surveillance to rapidly describe the early epidemiology of flakka use
in Florida, JUne 2014 - August 2015. Online J Public Health Inform 2015;8(1):6407 [FREE Full text] [doi:
10.5210/ojphi.v8i1.6407]
50. Hudson TL, Klekamp BG, Matthews SD. Local public health surveillance of heroin-related morbidity and mortality, Orange
County, Florida, 2010-2014. Public Health Rep 2017 Jul 10;132(1_suppl):80-87 [FREE Full text] [doi:
10.1177/0033354917709783] [Medline: 28692385]
51. Jacquemin B, Hamby T, Tsai S. Using probabilistic matching to improve opioid drug overdose surveillance, New Jersey.
Online J Public Health Inform 2019 May 30;11(1):9774. [doi: 10.5210/ojphi.v11i1.9774]
52. Hou W, Brutsch E, Dunn AC, Burnett CL, Dimond MP, Nakashima AK. Using syndromic data for opioid overdose
surveillance in Utah. Online J Public Health Inform 2018 May 22;10(1):8988. [doi: 10.5210/ojphi.v10i1.8988]
53. NSSP community of practice-resources that advance the science and practice of syndromic surveillance. National Syndromic
Surveillance Program. URL: https://www.cste.org/page/nsspcop [accessed 2020-01-22]
54. Centers for Disease Control and Prevention. NSSP newsletter update and archives. National Syndromic Surveillance
Program (NSSP). 2019. URL: https://www.cdc.gov/nssp/news.html [accessed 2019-12-12]
55. Morton AP, Whitby M, McLaws M, Dobson A, McElwain S, Looke D, et al. The application of statistical process control
charts to the detection and monitoring of hospital-acquired infections. J Qual Clin Pract 2001 Dec;21(4):112-117. [doi:
10.1046/j.1440-1762.2001.00423.x] [Medline: 11856406]
56. Unkel S, Farrington C, Garthwaite P, Robertson C, Andrews N. Statistical methods for the prospective detection of infectious
disease outbreaks: a review. J R Stat Soc 2012;175(1):49-82. [doi: 10.1111/j.1467-985X.2011.00714.x]
57. Benneyan JC, Lloyd RC, Plsek PE. Statistical process control as a tool for research and healthcare improvement. Qual Saf
Health Care 2003 Dec 01;12(6):458-464 [FREE Full text] [doi: 10.1136/qhc.12.6.458] [Medline: 14645763]
Abbreviations
CCP: Chief Complaint Processor
CDC: Centers for Disease Control and Prevention
DoD: Department of Defense
ED: emergency department
ESSENCE: Electronic Surveillance System for the Early Notification of Community-Based Epidemics
JHU/APL: Johns Hopkins University Applied Physics Laboratory
NSSP: National Syndromic Surveillance Program
OTC: over-the-counter
SAGES: Suite for Automated Global Electronic bioSurveillance
VA: Veterans Administration
WRAIR: Walter Reed Army Institute for Research
Edited by T Sanchez; submitted 09.12.20; peer-reviewed by C Staes, B Dixon; comments to author 20.01.21; revised version received
17.03.21; accepted 12.04.21; published 21.06.21
Please cite as:
Burkom H, Loschen W, Wojcik R, Holtry R, Punjabi M, Siwek M, Lewis S
Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE): Overview, Components, and
Public Health Applications
JMIR Public Health Surveill 2021;7(6):e26303
URL: https://publichealth.jmir.org/2021/6/e26303
doi: 10.2196/26303
PMID:
©Howard Burkom, Wayne Loschen, Richard Wojcik, Rekha Holtry, Monika Punjabi, Martina Siwek, Sheri Lewis. Originally
published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 21.06.2021. This is an open-access article
distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which
permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public
Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on
https://publichealth.jmir.org, as well as this copyright and license information must be included.