PublicHealthBooklet 060803
PublicHealthBooklet 060803
PublicHealthBooklet 060803
Planning, Designing, Conducting, and Evaluating Local Public Health Emergency Exercises
COLUMBIA UNIVERSITY
School of Nursing | Center for Health Policy
June 2006
Table of Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . 1 Exercise Planning and Principles in Public Health . . . . . . . . . . . . . . . . . . . . 2 Exercise Cycle and Organization . . . . . . 3
State Responsibilities Local Responsibilities
Developing Exercise Briefing Materials . . . . . . . . . . . . . . . . . . . . . . . . . 16 Conducting the Exercise . . . . . . . . . . . . 17 Moving from Observation to Evaluation . . . . . . . . . . . . . . . . . . . . . . . . 20 References and Resources . . . . . . . . . . 21 Appendices . . . . . . . . . . . . . . . . . . . . . . . 25
Types of Exercises . . . . . . . . . . . . . . . . . . 4
Discussion-based Exercise Operations-based Exercise
Copyright 2006 | Center for Health Policy | Columbia University School of Nursing | All rights reserved.
Introduction
n emergency preparedness exercise program is progressive, moving an agency toward even better emergency preparedness. It requires careful planning, including clearly identifying long-term improvement goals and specific exercise objectives and then designing, developing, conducting, and evaluating each exercise accordingly. Following this process will provide insight into what does and does not work for each specific local public health agency (LPHA).
I n t ro d u c t i o n
An exercise program enables an agency to test the implementation of emergency management procedures and protocols, fine-tune the internal coordination of the emergency plan, and practice coordinating with external response sectors. Depending on the scope and scale of the emergency preparedness exercises, they may involve many individuals, both internal (from within the LPHA) and external (from other response sectors). The national framework for emergency preparedness began with Homeland Security Presidential Directive 5 (HSPD-5), which directed the development of the National Response Plan (NRP).This plan aligned federal coordination, capabilities, and resources into a multidiscipline, all-hazards approach under a comprehensive incident management system known as the National Incident Management System (NIMS). HSPD-5 was followed by Homeland Security Presidential Directive 8 (HSPD-8), which put forth the following National Preparedness Goal: establish mechanisms for improved delivery of Federal preparedness assistance to State and local governments (www.LLIS.gov). Further, an interim National Preparedness Goal prescribes a capabilities-based planning approach for a wide range of threats and hazards. Among the capabilities-based planning tools available for use in developing emergency preparedness exercises are a suite of 15 National Planning Scenarios (Appendix D). As a step toward strengthened preparedness, the Department of Homeland Security Office of Domestic Preparedness (DHS ODP) developed and implemented an Exercise Evaluation Program, HSEEP, to enhance and support prevention, response, and recovery capabilities at federal, state, and local levels.The program seeks to standardize the language and concepts used by various agencies and organizations in the exercise planning process (DHS, 2002).This toolkit is based on and consistent with the national goals, plans, and principles outlined above.
Exercise planning must include criteria that will allow assessment of how well an LPHA performs under the conditions of a specific public health emergency or disaster.They define various levels of response performance. Criteria define various levels of response performance. Measures of these criteria will provide the basis for additional planning, training, conducting, and evaluation of emergency response operations (Appendix B).
State Responsibilities
Each state is expected to develop its own exercise program based on the guidelines provided by DHS.The program must address all of the tasks laid out by the federal guidelines, including 1. obtaining grants/funding 2. identifying roles and responsibilities for program development 3. designing, developing, implementing, and evaluating exercises 4. tracking improvements 5. monitoring whether the exercises conducted are consistent with HSEEP doctrine 6. designating a state-level agency/organization as the clearinghouse for all exercises conducted within the state 7. conducting an annual workshop to review the state exercise program, ensuring that the state objectives have been met and revising the multiyear exercise plan and schedule
Local Responsibilities
States disseminate their requirements to local jurisdictions by two routes: through the local emergency response agency, which has a direct tie to the designated state Office of Emergency Management, and through the state health agency. On the local level, there are many response sectors with which the public health sector needs to plan and coordinate its exercise activities.These activities are common to all response sectors. In general, LPHAs are responsible for 1. coordinating activities with the state health agency 2. identifying goals and objectives for exercises consistent with local public health risk, vulnerability, and needs assessments, as well as DHS strategy 3. designing and conducting exercises that conform to HSEEP requirements 4. providing the plans, procedures, and personnel to support the design, development, support, control, and evaluation of public health exercises 5. providing an Improvement Plan (IP) that is based on the recommendations made in the After Action Report (AAR), which is issued following the completion of an exercise
Types of Exercises
xercise is the generic term for a range of activities that test emergency response readiness, evaluate an emergency response plan, and assess the success of training and development programs.The five basic categories of such exercises are as follows: orientation exercises, tabletop exercises (TTX), drills, functional exercises (FE), and full-scale exercises (FSE).The first two categories are primarily discussion based, whereas the other three are action oriented.
Ty p e s o f E xe rc i s e s
4
A. Discussion-based Exercises
Orientation Exercise (Workshops or Seminars)
The purposes of an orientation exercise are to: (1) familiarize new staff with the agencys emergency response plan and/or (2) familiarize experienced staff with new or changing information/procedures. An LPHA may carry out an orientation exercise under a variety of circumstances, including the initiation of a new plan, procedure, or mutual aid agreement, or in the event of new staffing, leadership, facilities, or risk(s).The focus is usually on a single function, with roles and responsibilities clearly identified. It typically requires a scheduled meeting of pertinent agency staff. No previous experience is needed, and minimal staff preparation and lead time are required. Orientation exercises make use of various training techniques, including lectures, films, slides, videotapes, and panel discussions.
Ty p e s o f E xe rc i s e s
B. Operations-based Exercises
Drill
The purpose of a drill is to use repetition to instruct thoroughly. Drills can be used to test personnel training, response time, interagency cooperation and resources, and workforce and equipment capabilities. Drills optimally take place after orientation; staff should have an understanding of the agency function that will be tested in the drill and be given an opportunity to ask questions. How a drill begins depends on the type of drill being conducted. Drill categories include but are not limited to notification, communication, command post, and evacuation. In most cases, a general briefing by the drill designer sets the scene and reviews the drills purpose and objectives. Operational procedures and safety precautions are reviewed before the drill begins. Personnel are required to report, either in person or by telephone or e-mail, to a designated drill site or contact location. Both planned and spontaneous messages sustain the drills action.
t is critical for all exercise participants to be able to recognize the terms used to describe various exercise roles and responsibilities as well as other important exercise terminology. See Appendix C, page 32, for exercise terminology definitions.
T h e E xe rc i s e P l a n n i n g P ro ce ss
6
The teams size will depend on the size of the LPHA and should be modified to fit the scope of a particular exercise.The roles and responsibilities for the planning team must be clearly defined and should include delegation of responsibilities among team members as described below.
Command Role. Assigns tasks and responsibilities, establishes the timeline, and guides and
monitors exercise development.Typically, this role consists of a single team leaderoften the health director or the bioterrorism (BT) coordinator. In cases where large departments or large-scale exercises are involved, other staff members may assist the team leader.
Operations Group. Ensures scenario accuracy and applicability, and develops the evaluation criteria. Participants in this group typically include departmental subject matter experts and technical experts (e.g., epidemiologists for surveillance activities, environmental health specialists for environmental health sampling, and public health nurses for mass prophylaxis and immunization clinic set up).
Planning Group. Collects and reviews all policies and procedures applicable to the exercise. Also develops simulation and injects (i.e., intermediate changes or challenges to the exercise participants) needed to sustain exercise flow. In small departments or for small-scale exercises, the planning group may be combined with the operations group.
T h e E xe rc i s e P l a n n i n g P ro ce ss
Logistics Group. Gathers all supplies, materials, equipment, services, and facilities required
for the implementation of the exercise. For small-scale exercises, the logistics group may consist of a single senior administrative support person working closely with the planning group.
Administration/Finance Group. Keeps an account of the costs involved in conducting an exercise. For small agencies, this group may consist of a single individual, who may be the same administrative support person assigned to the logistics role.
Objectives
The objectives for any exercise must be challenging yet achievable and should support an LPHAs overall mission and preparedness plan.Whether there is a single objective or several, they should be based on the following: 1. an agencys current stage of emergency preparedness 2. gaps, weaknesses, or areas of concern affecting the agencys performance as identified through prior exercises 3. level of staff knowledge and understanding of emergency preparedness roles and responsibilities 4. applicability to emerging problems
T h e E xe rc i s e P l a n n i n g P ro ce ss
8
Example
Draft Goal: Test activation of the county POD operational model
Potential Specific Objectives:
1 2
Test activation of the POD operational model through evaluation of POD layout and patient flow. Provide staff with an opportunity to practice following the incident command system (ICS) and the functional roles required for expeditiously receiving and dispensing appropriate medications.
Provide and maintain effective two-way communications to ensure a 24/7 flow of critical health information among public health departments, health care organizations, law enforcement, public officials, and others.
nce the exercise goals and objectives have been formulated and the type of exercise selected, there are further considerations in the exercise planning process.These include developing support materials such as an exercise participant handbook/manual and evaluation forms, and scheduling a training or briefing session. Such a session will ensure that all exercise participants, including the team conducting and evaluating the exercise, the players (e.g., victims, hotline callers, community members, etc.), and others are clearly informed about their roles in the exercise prior to its start.These steps are discussed more fully, including examples, on page 16 (Developing Exercise Briefing Materials).
S ce n a r i o D eve lo p m e n t S t e p s
The scenario is the foundation of an effective exercise. It lays the groundwork for development of exercise objectives and selection of public health emergency exercise criteria.The process for scenario development is the same, regardless of whether an exercise will be conducted entirely within an LPHA or as part of a larger multigency exercise. An LPHA may select a scenario from the Suite of 15 National Planning Scenarios,* as long as the chosen scenario is plausible for the jurisdiction. When developing drills, or tabletop, functional, or full-scale exercises, follow these steps:
1 2 3
Use agency content experts to assist in scenario development. Research and gather background information to make the scenario realistic. Draft and review the scenario with the exercise planning team.
4 5
Do a talk-through with the entire planning team to identify possible problems and areas in need of improvement. Finalize the scenario, including the development of simulations and injects needed for scenario flow if the exercise includes response to changing information.
*These scenarios represent a range of potential natural disasters or deliberately caused events and are expected to be the basis of the National Exercise Program. Use of these scenarios can facilitate cross-agency collaboration or evaluation. See Appendix D. This is needed even if the exercise makes use of one of the National Planning Scenarios.
10
S ce n a r i o D eve lo p m e n t S t e p s
Discussion-based Exercise
1. Research
Gather the background and technical information needed to ensure that the scenario events are realistic and complete.This includes the flow, proper timing, and integration of the scenario elements.
S ce n a r i o D eve lo p m e n t S t e p s
Operations-based Exercise
1. Research
This will be the same as for discussion-based exercises.
11
he most important step in planning an exercise is developing an exercise evaluation plan. An exercise is only as useful as the results of its evaluation. It is therefore critical to clarify evaluation criteria early on, which should include the following: the efficiency with which some portion of the plan can be carried out staff competency in specific roles
12
D eve lo p i n g a n E va l u a t i o n P l a n
an LPHAs exercise process an LPHAs emergency plan an LPHAs ability to fulfill the plan the speed with which an LPHA puts some portion of the plan into place
Pre-exercise Activities
Consider the following pre-exercise activities when developing the evaluation plan.
Identify exactly what portion of public health emergency response will be activated. Use the universal task list or a local planning decision to determine which specific response activities will be practiced. Example: Set up LPHA EOC with complete telecommunications and radio connections with branches to the county EOC. Identify all LPHA components that are expected to participate. Example: Will logistics actually procure items or are they to be assumed? Will all branch offices participate, or only those selected?
Identify all functional roles to be activated. Include those likely to be identified only if initial participants perform as desired. Example: If the LPHA planning unit will be activated, there may be a need to exercise and evaluate field epidemiology. Select specific LPHA-level criteria from the menu in Appendix B (or DHS sources, if available for your locale). If external criteria are unavailable, specify preferred performance using the following format: action verb; object; context; time. Identify all job action sheets (JAS) associated with those criteria. Prepare observer documents. List criteria and JAS role evaluations to be observed.
D eve lo p i n g a n E va l u a t i o n P l a n
Evaluation Questions
Some exercises work better than others to develop staff skills, demonstrate abilities, or test community communication. Examples of evaluation questions tailored to specific criteria include:
3. Evaluating the Speed with Which the Plan Is Put into Place
Time to notify? Time to be in place? Other times as detailed in the action plan
13
14
D eve lo p i n g a n E va l u a t i o n P l a n
Evaluation Methods
Consider the following ways to evaluate. Any of these methods can be used, but each requires specific criteria for best effect.
EXTERNAL EVALUATOR OBJECTIVE SUBJECTIVE PARTICIPANT
1 2
Adapt generic mass-dispensing strategy to specific event within 60 minutes of notification. Staff dispensing site(s) with adequate and appropriate personnel for mass dispensing (including volunteer surge staff) prior to site opening.
3 4
Identify and request any just-in-time training needsincluding use of personal protective equipment (PPE)at least 2 hours prior to site opening. Ensure that system is fully in place for restocking supplies throughout duration of site activation.
Other criteria to evaluate public health emergency exercises include The Universal Task List (UTL), developed by the Department of Homeland Security, which can be found through the Office for Domestic Preparedness (ODP) Secure Portal at www.llis.gov Emergency Preparedness Performance Measures from the Centers for Disease Control and Prevention, found in Appendix 4 of Cooperative Agreement Guidance for Public Health Emergency Preparedness at http://www.bt.cdc.gov/planning/guidance05/index.asp
Ensure that system is fully in place for rotating and/or relieving staff throughout duration of site activation.
Prepare and deliver all required recordkeeping supplies to Site Coordinator prior to site opening.
D eve lo p i n g a n E va l u a t i o n P l a n
In the case of an unannounced exercise that included the objective of assessing the process by which the LPHA moved to open a mass distribution site, including logistics, notification of staff, and just-in-time training, the evaluation criteria would also include the following:
1 2 3
Establish liaison with jurisdiction-wide Joint Information Center (JIC) within 15 minutes of notifying the Incident Commander (IC) that the JIC is operational. Draft and approve public information for anticipated phases of response within 2 hours of establishing the agencys EOC. Identify key partners (e.g., other health jurisdictions, law enforcement, hospitals, etc.) and convey initial public health information to these partners no later than one (1) hour after approval of such information by the agencys IC.
4 5 6 7 8
Establish a schedule to update partners on a regular basis. Test backup communications procedures. Identify a public health spokesperson whose expertise is applicable to the nature of the emergency (e.g., Health Director, Health Officer, Epidemiologist, etc.). Develop and convey Single Overriding Communication Objective (SOCO) through the ICS structure. Update and distribute the SOCO (e.g., posted to Situation Boards, etc.) as needed, but at least every 4 hours.
Once an LPHA identifies the functional roles to be activated, the expected duties of each role related to each objective can be inserted into the observer format, as illustrated in the Sample Role Evaluation Checklist for Clinic Manager (Flu), in Appendix F, pages 5659.
15
Exercise Objectives:
To establish the purpose of the exercise and define the exercises goals.
Scenario:
A realistic and comprehensive storyline that serves as the backdrop for the exercise and details the conditions and technical issues at play.
Scope of Play:
The parameters in which the exercise will be conducted, including duration of the exercise, players involved, and level and details of involvement. Exercise activities are set within this scope to enable exercise participants to perform against the established objectives.
Briefing materials for Players: JASs; details of where, when, and to whom the player(s) should report; exercise identification and identifying clothing
Briefing materials for Controllers, Observers, and Evaluators: Exercise documentation forms; exercise identification and identifying clothing
T
1 2
he actual conduct of the exercise provides opportunity for assessment of agency capacity, participant training, and validation of competency, depending on the goals of the specific event.The components of conducting an exercise consist of these general steps:
C o n d u c t i n g t h e E xe rc i s e
briefings and preparations (distribute badges/clothing and other needed materials or equipment) initiate, facilitate, and observe exercise activity
3 4
Advance Steps
While this document has focused on the details of identifying goals, objectives, and criteria in order to assure a focused event that can be evaluated and used for agency improvement, there are other steps that must be taken in advance.The exercise planning group must:
1 2 3
secure appropriate location with all essential equipment, unless a pre-equipped Emergency Operations Center is to be used secure space for management of evaluators and observers, with appropriate communications equipment, orientation materials, identification, and debriefing planned secure space for assembling any victims, with instructions and transportation to exercise site, if needed
4 5 6
prepare any special signage to direct individuals to assigned locations arrange for equipment specific to the scenario and objectives (e.g., sample collection equipment for an exercise with contaminated water or food; mock medications for a mass prophylaxis exercise) secure staff to support the exercise process, including any needed assistance for set up or communications
17
18
C o n d u c t i n g t h e E xe rc i s e
C o n d u c t i n g t h e E xe rc i s e
Materials and/or equipment are distributed as necessary including instructions on how and where to return them. Instructions are given for when and where to report for the hot wash (debriefing), held immediately at the end of the exercise. Participants report to their assigned location. Exercise play is begun and terminated according to the exercise plan.
19
1 2 3
Plan and organize the evaluation in advance. All data collectors/evaluators and controllers need a complete briefing on exercise and evaluation materials. Observe the exercise and collect data using the materials provided (i.e., observer and data collector logs and workbooks, including the data collector/evaluator handbook). Analyze data and assess performance at the task, departmental, discipline-offunction, and mission levels. Reconstruct the exercise events from logs, workbooks, hot wash, and other debriefings. Identify the root causes of differences using critical thinking to determine why things happened as they did. Draft the After Action Report (AAR) (See Appendix F, page 53 for details).
5 6 7 8
Conduct the exercise debriefing/hot wash (See Appendix F, page 67). Depending on the size and complexity of the event, this process may consist of a single debriefing or a series of debriefings with various subgroups of exercise participants. Identify opportunities for improvement and lessons learned. Update the plan accordingly. Finalize the AAR, which should include an assessment of strengths and weaknesses. The AAR will in turn guide the development of the Improvement Plan (IP). Develop the IP. This converts the lessons learned from the exercise into measurable steps that will result in improved response capabilities.Then track the implementation of the IP (See Appendix F, page 69).
Emergency Management Institute. (1995). Flood mitigation and recoveryAn interactive exercise for local governments. Retrieved December 2003, from http://training.fema.gov/ EMIWeb/STCourses/nrcrs.asp. Emergency Management Institute. (1995). Mitigation and recovery exercisehurricane. Retrieved December 2003, from http://training.fema.gov/EMIWeb/STCourses/nrcrs.asp. Federal Emergency Management Agency. (1999). Pandemic Tabletop PowerPoint Slides. CDROM. Federal Emergency Management Agency. (2000). Hazardous materials exercise evaluation methodology. Retrieved April 2005, from http://training.fema.gov/emiweb/downloads/ HMManualTOC.doc. FitzGerald, D. J., Sztajnkrycer, M. D., and Crocco,T. J. (2003). Chemical weapon functional exerciseCincinnati: Observations and lessons learned from a typical medium-sized citys response to simulated terrorism utilizing weapons of mass destruction. Public Health Reports, 118, 205214. Gillis,T. K. (1996). Emergency Exercise Handbook: Evaluate and Integrate Your Companys Plan. Tulsa, OK: PennWell. Goodwin, C. (1986). Disaster drills. Topics in Emergency Medicine, 7(4), 2033. Henning, K. J., Brennan, P. J., Hoegg, C., ORourke, E., Dyer, B. D., and Grace,T. L. (2004). Health system preparedness for bioterrorism: Bringing the tabletop to the hospital. Infection Control & Hospital Epidemiology, 25(2), 146155. Hewlett P. L., Mitrani, J. E., Absili-Mills, P.,Tallarovic, J., et al. (1998). An analysis of chemical stockpile emergency preparedness program exercise results. In Volume 1:The CSEPP Exercise Results Database. Argone National Laboratory, Decision and Information Sciences Division; work sponsored by U.S. Department of the Army, Chemical and Biological Defense Command. Retrieved May 2004, from http://www.osti.gov/energycitations/servlets/ purl/656686-jEA4X8/webviewable/. Hoffman, R. E., and Norton, J. E. (2000). Lessons learned from a full-scale bioterrorism exercise. Emerging Infectious Diseases, 6(6), 652653. Jarrett, D. (2003). Lessons learned:The pale horse bioterrorism response exercise. Disaster Management & Response, 1(4), 114118.
22
R e fe re n ce s a n d R e s o u rce s
Lurie, N.,Wasserman, J., Stoto, M., Myers, S., Namkung, P., Fielding, J., et al. (2004, June 2). Local variation in public health preparedness: Lessons from California. Health Affairs. Retrieved September 2004, from http://content.healthaffairs.org/cgi/citmgr?gca=healthaff;hlthaff. w4.341v1. National Response Team. (1990). Developing a hazardous materials exercise program: A handbook for state and local officials. Retrieved December 2003, from http://ntl.bts.gov/DOCS/ 254.html. Osaki, C. (2003). Hands-on training for public health emergencies: Facilitators manual for bioterrorist attack on food: A tabletop exercise. Northwest Center for Public Health Practice, University of Washington, in collaboration with the Washington State Department of Heath and the Centers for Disease Control and Prevention. Retrieved October 2003, from http://www.cdphe.state.co.us/bt/2003borderstates/presentations/osaki/FacilitatorsManual.pdf. Perry, R.W., and Lindell, M. K. (2003). Preparedness for emergency response: Guidelines for the emergency planning process. Disasters, 27(4), 336350. Phreaner, D., Jacoby, I., Dreier, S., and McCoy, N. (1994). Disaster preparedness of home health care agencies in San Diego County. The Journal of Emergency Medicine, 12(6), 811818. Quarantelli, E. L. (1997).Ten criteria for evaluating the management of community disasters. Disasters, 21(1), 3956. Rekus, J. F. (1989). Disaster drills identify potential for problems in real emergencies. Occupational Health & Safety, 58(11) 50. 5256. Schweitzer, R. (2004, January 20). Hot wash debriefing format. Retrieved June 2005, from https://odp.esportals.com/member/libnew2/index.cfm (requires secure login ID). Simpson, D. M. (2002). Earthquake drills and simulations in community-based training and preparedness programmes. Disasters, 26(1), 5569. Skowronski, S., and Townes, D. (2003, November). Using tabletop exercises and drills to reveal training needs. Paper presented at the Health Distance Learning Summit. Retrieved April 2004, from http://www.phppo.cdc.gov/phtn/2003DLSummit/TabletopEx-Skowronski.pdf. Spain, E. L. (1995). Developing a simulated disaster. Nursing Management, 26(12), 48H. Taylor, M. (2003). Doing the drill. Modern Healthcare, 33(20), 22.
R e fe re n ce s a n d R e s o u rce s
23
Turnball, J., Gesteland, P., and Gardner, R. (2002). Bioterror drills show need to revise emergency preparedness plans. Hospital Peer Review, 27(6), 7376. Turner, S. J. (1991). Preparation for a fire disaster in a long-term care facility: A staff development perspective. Journal of Nursing Staff Development, 7(3), 134137. U.S. Department of Energy Office of Transportation and Emergency Management. (2002). Guidance for planning, conducting and evaluating transportation emergency preparedness tabletops, drills and exercises. Retrieved December 2003, from http://web.em.doe.gov/otem/ 09072v2.pdf. U.S. Department of Homeland Security. (2004, March). National Incident Management System.Washington, DC: http://www.nimsonline.com/nims_3_04/index.htm U.S. Department of Homeland Security, Office for Domestic Preparedness. (2003). Homeland security exercise and evaluation program,Vol. I: Overview and doctrine. Retrieved December 2003, from http://www.ojp.usdoj.gov/odp/docs/HSEEPv1.pdf. U.S. Department of Homeland Security, Office for Domestic Preparedness. (2003). Homeland security exercise and evaluation program,Vol. II: Exercise evaluation and improvement. Retrieved October 2003, from http://www.ojp.usdoj.gov/odp/docs/HSEEPv1.pdf. U.S. Department of Homeland Security, Office for Domestic Preparedness. Homeland security exercise and evaluation program,Vol. III: Exercise program management and exercise planning process. Retrieved March 2005, from http://www.ojp.usdoj.gov/odp/docs/HSEEPv3.pdf.
24
R e fe re n ce s a n d R e s o u rce s
APPENDICES
Appendix A
Exercise Flowchart
Appendix B
Menu of Criteria for Evaluating the Performance of Local Public Health Agency Emergency Drills and Exercises
Appendix C
Acronym Definitions
Appendix D
The Suite of 15 National Planning Scenarios
Appendix E
Exercise Planning Document Templates with Examples of Their Use
Appendix F
Exercise Data Collection/Evaluation Forms with Examples of Their Use
Appendix G
Sample Scenario, Full-scale Exercise Playbook, Tabletop Exercise Schedules, and Facilitator Questions
25
Appendix A:
Exercise Flowchart
The exercise process begins with the selection of the type of exercise to be conducted.The flowchart below illustrates this process.
Determine Objectives Determine Broad Goals Audience Scenario Focus of exercise Scope Scale Extent of play (suggest type) Format (type) Evaluation method Work plan Resource needs
Complete Scenario 1. research 2. draft & integrate 3. review 4. talk-through 5. finalization Identify Functional Roles to be tested for participating staff
Conduct Exercise
26
Appendix B:
Menu of Criteria for Evaluating the Performance of LPHA Emergency Drills and Exercises
Note: Select these criteria based on their relevance to the type of exercise you will be conducting. Acronyms are defined in Appendix C.
2 Identify and activate* all health department internal Incident Command System
(ICS) positions (e.g., public informational officer, liaison, safety officer, appropriate section chiefs, etc.) within 30 minutes, regardless of time of day (24/7/365).
Centralize all initial/available/relevant information to agencys ICS Planning Section using a situation board or equivalent within 15 minutes.
6 Retrieve and make available to ICS command staff portions of state/local public
health laws and codes pertaining to the specific emergency. rou7 Activate plan for operating/closingwithin tine health department operations 30 minutes of initial activation of internal ICS.
27
Communication
with 1 Establish liaisonminutesthe jurisdictional 5 Test backup communications JIC within 15 of notifying the procedures. IC that the JIC is operational. public information 2 Draft and approve of response within 2for anticipated phases hours of establishing the agencys EOC. a public 6 Identifyexperiencehealth spokesperson whose is applicable to the nature of the emergency (e.g., health director, health officer, epidemiologist, etc.).
3 Identify key partners (e.g., other health jurisdictions, law enforcement, hospitals,
etc.) and convey initial public health information to these partners no later than 1 hour after approval of such information by the agencys IC.
7 Develop and convey SOCO through the ICS structure. 8 Update and distribute SOCO (e.g., posted to situation boards) as needed, but at
least every 4 hours.
1 Establish event-specific surveillance with- 5 Complete epidemiology investigation 2 in 60 minutes of establishing the EOC. plan (including tools and forms) within
hours of establishing the agencys EOC.
prior to 6 Prepare field staff needed. deployment, including PPE if interval(s) for updating 7 Establish time investigation plan based on epidemiology reassessment of available information.
28
Sample Testing
resources and requireappro3 Ensure that case investigators are(via PPE) 1 Select laboratory agent/incident. ments specific to priately prepared and protected prior to deployment. and proce2 A. Develop targetedofprotocols within 60 dures for collection samples minutes of notification of incident by the IC. Protocols and procedures should pertain to the specific emergency. B. Disseminate developed protocols to involved staff prior to deployment. workers 4 Deploy fieldfinal IAP. to sites within 60 minutes of ship/transport samples in 5 Pack andconsistent with laboratory a manner requirements.
Evidence Management
evidentiary requirements with arrangements 1 Confirmagencies through jurisdiction- 2 Establish evidence priorfor maintaining relevant chain of to collection of wide NIMS partners prior to collecting personal or environmental samples/specimens. any samples/specimens.
adequate and in 2 Staff dispensing site(s) withmass dispensing 5 Ensure that system is fullystaff place for appropriate personnel for rotating and/or relieving throughout (including volunteer surge staff) prior to site opening. duration of site activation. all 6 Prepare and deliver siterequired recordkeeping supplies to coordinator prior to site opening.
Identify and request any just-in-time training needs (including use of PPE) at least 2 hours prior to site opening.
29
in 2 Staff mass care site(s) with adequate and 5 Ensure that system is fullystaff place for appropriate personnel (including volunrotating and/or relieving throughout teer surge staff) prior to site opening. duration of site activation.
and request any all 3 Identify needs (includingjust-in-time at 6 Prepare and deliver siterequired recordtraining use of PPE) keeping supplies to coordinator prior least 2 hours prior to site opening. to site opening.
Environmental Surety
for control 1 Develop/adapt strategyhazardous byofthe 3 Establish PPE criteria for staff. environment rendered event within 30 minutes of site identification. of affected 2 Identify specific characteristics30 minutes areas and report to IC within of arrival on site.
30
Appendix C:
Acronym Definitions
AAR BDS DHS EOC FE FSE HO HSEEP IAP IC ICS IP JAS JIC LLIS LPHA MSEL NIMS NRP POD PPE ODP SME SNS SOCO TTX After Action Report Biological Detection System Department of Homeland Security Emergency Operations Center Functional Exercise Full-scale Exercise Health Officer Homeland Security Exercise and Evaluation Program Incident Action Plan Incident Commander Incident Command System Improvement Plan Job Action Sheet Joint Information Center Lessons Learned Information Sharing Local Public Health Agency Master Scenario Event List National Incident Management System National Response Plan Point of Distribution Personal Protective Equipment Office of Domestic Protection Subject Matter Expert Strategic National Stockpile Single Overriding Communications Objectives Tabletop Exercise
31
Terminology Definitions
After Action Report (AAR)
Used to provide feedback on performance during an exercise. It summarizes what happened and analyzes the performance of critical tasks. It includes recommendations for improvements to be addressed in an improvement plan. It uses multiple sources of collected data, including observations and information.
Actors
Volunteers or other members of the LPHA who act as patients or victims.
Briefing
A meeting to inform participants on the ground rules of conduct and their roles and responsibilities. Briefings cover the exercise objectives and scope, the parameters and limits of play, simulations, and how and when the debriefing process will occur.They are held before an exercise begins. Actors, players, observers, and data collectors/evaluators usually attend separate briefings.
Controllers
Monitor the flow of the drill or exercise.Their role is to ensure that the exercise is conducted in accordance with the scenario and the timeline and within established exercise scope and parameters. May or may not be from within the LPHA.
Data Collectors/Evaluators
Observe and record player action during TTX, drills, and exercises, evaluating effectiveness based on defined objectives and evaluation criteria. May or may not be from within the LPHA, depending on the size and scale of the exercise. Usually evaluate an area consistent with their expertise.
Exercise Play
The actual conduct of the exercise from initiation to termination.
Facilitators
Lead TTX group discussions so that all scenario issues and questions are addressed.
Hot Wash
An immediate debriefing session between players and members of the exercise planning team to discuss their preliminary observations.This information will inform the After Action Report.
Improvement Plan
Converts the lessons learned from the exercise into measurable steps that will result in improvements in response capabilities.
32
Injects
The terms inject and messages are used interchangeably and sometimes together.They are associated with the MSEL and link simulation to action and enhance the exercise.They are formatted and presented to reflect the data that would be observed in a real event. Message injects are instructions to controllers to insert information and/or begin simulations, actions, and contingency messages. Contingency messages are injects that are used when expected response actions do not occu.They redirect play so exercise goals can be met.
Move
A discrete event within the exercise scenario (e.g., an emergency generator breaks down during the response).
Observers
Invited guests who have no official role in the conduct of a tabletop, drill, or full-scale exercise, although they may be asked to submit their observations.
Participants
All the people involved in carrying out the exercise. Includes actors, controllers, data collectors/evaluators, facilitators, and players. Does not include observers.
Player
An individual or member of the response organization (LPHA personnel) who is playing a defined functional role during an exercise under the incident command system (ICS)/National Incident Management System (NIMS) model.
Simulation/Simulation Cell
An umbrella term that refers to artificially produced conditions that replicate real-life emergencies.The cell is responsible for artificially duplicating or role playing response activities.
Time Keeper/Recorder
Notes critical events and times during exercise.
33
Appendix D:
1. Scenario Overview
a. General description Detailed scenario depicting various types of intentional events (e.g., biological, chemical, radiological, and other types of attacks) and natural disasters (e.g., hurricane, earthquake, etc.) b. Planning considerations Geographical considerations/description Timeline/events dynamics Meteorological conditions (when applicable) Assumptions Mission areas activated c. Implications Secondary hazards/events Fatalities/injuries Property damage Service disruption Economic impact Long-term health issues
2. Mission Areas
a. b. c. d. e.
34
Appendix E: 1. Planning ChecklistFull-scale Exercise with Example of Use 2. Planning ChecklistTabletop Exercise with Example of Use 3. Planning TemplateTabletop Exercise with Example of Use 4. Assignment and Location Form with Example of Use 5. Job Action Sheet (JAS) with Example of Use
35
Appendix E:
How to use
Fill in dates, names, and materials to be used for your specific exercise. Planning timeframe is dependent on the scale of exercise.
Lydia Cook, John Gilbert, Odalis Diaz, Marion Bell, Ken Gricell Start Date End Date Assigned Staff 2/01/06 2/01/06 2/03/06 2/14/06 2/14/06 2/03/06 2/10/06 2/21/06 2/21/06 L. Cook J. Gilbert O. Diaz M. Bell K. Gricell
Status
complete complete complete complete complete
2/03/06 2/01/06
2/10/06
Cook, Gilbert Cook, Gilbert Cook, Gilbert, Diaz Diaz Bell Cook, Gilbert Diaz
complete
Gricell
36
Start Date
End Date
Assigned Staff
Status
Assigned Staff
Status
Appendix E:
How to use
Fill in dates, names, and materials to be used for your specific exercise. X indicates steps needed for tabletop exercise.
FILL IN NAMES
Start Date
2/01/06 2/01/06 2/03/06
End Date
Assigned Staff
Add Names
Status
complete complete complete complete complete
2/03/06 2/10/06
n/a
2/16/06
n/a
n/a
39
Assigned Staff
Status
X X
X X
X X
X X X
40
Start Date
End Date
Assigned Staff
Status
Assigned Staff
Status
Appendix E:
How to use
Fill in dates, names, and materials as required for your specific exercise.
Purpose: The purpose of this exercise is to give the participants an opportunity to evaluate their current emergency response plans and capabilities for responding to a flood in Anytown. This exercise will focus on key local public health emergency responder coordination, critical decisions, and the integration of other response sectors necessary to protect the publics health and save lives following a [type of disaster/emergency] event.
Scope: The scope of this exercise will focus on Anytown Health Departments role in response to the potential consequences of a flood emergency. More important than minute details are processes and decision making. The emphasis should be on coordination, integration, problem identification, and problem resolution.
Objectives: Participants will demonstrate the ability to: 1. Identify priorities and responsibilities 2. Reorder priorities based on new information 3. Develop priorities in response to unexpected events
Narrative: On Monday afternoon, after two weeks of rainy weather, Anytowns rivers are at high levels. Weather forecasters are indicating that a strong storm front is rapidly approaching the region. Heavy rains are predicted to start by Tuesday early morning. Write opening narrative for scenario here.
Scenario Development (Move I) By 11 AM on Tuesday, the Anytown river begins to overflow its banks. The scenario and the chronological events continue here.
43
Problem Statements: Health Officer How will you adjust your priorities based on this new information?
Scenario Development (Move III) By Tuesday morning, shelters are operating in two regional high schools. However, at around 1 PM, rapidly rising floodwaters overtake a bus headed for a shelter, filled with patients from the Anytown Rehabilitation Centre. Before rescuers can reach the bus, several elderly and immunocompromised evacuees are exposed to contaminated floodwater. The scenario and chronological events continue here.
Problem Statements: Epidemiologist What are your priorities in response to this exposure?
44
Scope:
Objectives:
Players:
Narrative:
Problem Statements:
Problem Statements:
Appendix E:
How to use
During the exercise planning phase, fill in as illustrated. Use as a reference for conducting the exercise.
Response Site
EOC
Assignment
Controller
Anytown HS
POD Manager
EOC/HS
Transport
Anytown HS
Greeter
POD Registration Section Chief POD Evaluation Section Chief POD Distribution Section Chief
47
Appendix E:
How to use
Job action sheets are developed for the various functional roles played in an exercise. They list the elements of a particular job or occupation (e.g., purpose, duties, equipment used, qualifications, training, physical and mental demands, working conditions).
Role: POD Site Manager You Report to: Edwin Lewis, County Administrator Qualifications: General knowledge of ICS and community resources
Mission: Provide overall site command for POD location. Assure communication is maintained with the County Administrator, Anytown Situation Room, and local EOC.
Task Review Job Action Sheet. Meet with command staff officers to review plans and activities. Meet with chiefs from each of the four sections to review plans and activities. Communicate with safety officer and section chiefs on an ongoing basis.
Completed
Time 8:25 AM
8:30 9:00 Schedule every 2 hours
49
Mission:
Location Assigned:
Immediate Actions:
Task
Completed
Time
Appendix F:
Data Collection/Evaluation Forms with Examples of Their Use 1. Data Collector Observation Log 2. Role Evaluation Checklist with Example for Role of Clinic Manager (Flu Scenario) 3. Station-Specific Throughput Timesheet 4. Actor-Specific Throughput Timesheet 5. Participant Feedback Form 6. Hot Wash/Debriefing 7. After Action Report 8. Tracking Improvement Checklist
51
Appendix F:
the time required for a patient to travel through the site, if he/she was directed properly, and helps to gauge site capacity.
6. Hot Wash/Debriefing
Used after the exercise to capture the results from players and participants to improve future exercises.The hot wash is conducted by a facilitator and guided by discussion points.The proceedings are documented by a note-taker or recorded, then analyzed by the exercise team.
53
Appendix F:
Time
8:00 AM 8:15 AM 8:20 AM
Event Description/Assessment
Phone call received from Hospital A of unusual death from flu-like symptoms. Call received by (name/role of staff member). Health director/officer makes decision to activate the departmental EOC. Departmental IC notifies state department of health.
54
Time
Event Description/Assessment
Appendix F:
Part I. For each criterion, check the appropriate column and add comments as appropriate.
Met Not Not N/A Comments/ Met Observed Recommendations 1. Generic mass-dispensing strategy X Exceeded limit within adapted to specific event within 60 exercise time frame minutes of notification.
2. Dispensing site(s) staffed with adequate and appropriate personnel for mass dispensing (including volunteer surge staff) prior to site opening time. 3. Just-in-time training (including use of PPE) identified and requested at least 2 hours prior to site opening. 4. System in place to restock supplies throughout duration of site activation. 5. System in place to rotate or relieve staff throughout duration of site activation. 6. All required record-keeping supplies prepared and delivered to site coordinator prior to site opening. X X
LPHA Criteria
56
Mission: Oversee all POD functions. Met Not Not N/A Met Observed 1. Read entire JAS. X
Comments/ Recommendations
5. Briefed all POD staff on the current situation; communicated the Incident Action Plan (IAP). 6. Assigned JAS and tasks to the POD staff.
7. Ensured that all necessary paperwork and supplies were in place at work site in advance. 8. Received and forwarded all requests for additional personnel, equipment, supplies, and transportation. 9. Continually reassessed work flow and patient flow.
57
Mission: Oversee all POD functions. Met Not Not N/A Met Observed 10. Ensured that time and attendance X were communicated to mass care unit leader using appropriate forms.
11. Maintained written log of all activities and communications. X
Comments/ Recommendations
12. Briefed the assistant clinic managersclinical services and logistics on POD issues on a periodic basis. 13. Ensured that issues of concern were related to mass care unit leader ASAP. 14. Monitored staff for signs of stress and fatigue.
16. Prepared end-of-shift report for mass care director and incoming clinic manager. 17. Planned for the possibility of extended deployment.
58
There was insufficient information coming to the clinic manager from operations staff. The EOC was slow to help in contacting operations staff.
59
PART I. For each criterion, check the appropriate column and add comments as appropriate.
LPHA Criteria
Comments/ Recommendations
Mission:
Comments/ Recommendations
5. Participant Feedback
Name of Exercise: Participant Name: Agency: Role: Player Observer Facilitator Date:
Part I. Recommendations and Action Steps 1. Based on todays exercise and tasks identified, list important issues and/or areas for improvement.
2. Identify the steps needed to address the identified issues. For each one, rate it is a high, medium, or low priority.
4.What policies, plans, and procedures should be reviewed, revised, or developed? List in order and indicate the priority level for each.
2. How would you improve this exercise? What changes would you make?
Appendix F:
6. Hot Wash/Debriefing
Sample Hot Wash/Debriefing Format
Hot Wash/Debriefing Format
OVERVIEW
Date/Location: [Jurisdiction] hosted a [Type of Exercise] on [Date]. Attendees included representatives from: [List Attendees].
Hot Wash: After the exercises conclusion, exercise planners met briefly to discuss the exercise conduct and planning process. Discussion primarily focused on three aspects: expectations, after-action items, and the planning process.
DISCUSSION POINTS
1. Expectations:
2. After Action Items: Planning group members emphasized the following issues as critical to the After Action Report/Improvement Plans success:
3. Exercise Design: Exercise planners noted the following about the exercise planning process:
67
Appendix F:
2. Exercise Overview:
(who participated, including departments, agencies, jurisdictions; dates of play; location, etc.)
5. Analysis of Outcomes:
68
Appendix F:
CORRECTIVE ACTIONS
Improve methods for maintaining chain of evidence Improve mechanism of delivery of supplies S
P = Primary Responsibility
S = Secondary/Support
O = Oversight
C = Coordination Role
69
P = Primary Responsibility
S = Secondary/Support
C = Coordination Role
Appendix G:
71
Appendix G:
1. Sample Scenario
At [Hospital name]s emergency department, a doctor sees his first patient, a 22-year-old male student.The patients father states he has been complaining of weakness and chills and developed a temperature of 105 F.The father adds that during the past two days, the patient has experienced increased difficulty breathing and has a past medical history of severe asthma. Nothing in the patients recent history accounts for this sudden illness.The father thinks he may have caught a bug from one of his friends.The patient is admitted, but is unresponsive to medications. The male student admitted to the hospital earlier in the day develops severe respiratory complications and dies just after [time of day]. Hospital officials notify the medical examiners office. An autopsy is scheduled to determine the cause of his death. Due to the rapidly increasing number of patients presenting with unusual symptoms, some of whom have died, notifications of such have taken place within the emergency response, medical, and public health communities. Many of the patients do not seem to respond to decongestants, analgesics, antibiotics, or antiviral medication therapy.The lack of response to the initial treatment regimens and growing number of patients prompt physicians to seek advice and consultation from the public health department.The local health department alerts the state department of health. By late [time], approximately [number] patients have reported to area hospitals and clinics with this severe, flu-like syndrome.The most severe cases have been hospitalized; however, there are many more waiting in emergency rooms. Some hospitals have gone on diversion status. Some patients have died since admission. As a result, the medical examiners office has been called in to perform a growing number of autopsies. A story reporting the increase in flu-like illnesses and related deaths appears in the local news. Public health department officials and their public information officers (PIOs) begin meeting to develop their public information strategy.
72
Appendix G:
Purpose
The purpose of this exercise is to give the participants an opportunity to evaluate their current emergency response plans and capabilities for responding to a [type] event in the [your health department/communitys name].This exercise will focus on key local public health agency emergency response coordination, critical decisions, and the integration of other response sectors as necessary to protect the publics health and save lives following a [type of disaster/emergency event].
Scope
The scope of this exercise will focus on [your agencys name] role in response to the potential consequences of a [type of disaster/emergency event]. More important than minute details are processes and decision making.The emphasis should be on coordination, integration, problem identification, and problem resolution.
Objectives
The exercise will focus on the following objectives: Increase bioterrorism awareness Assess level of emergency preparedness in the health department and its ability to respond during a public health emergency Identify triggers for activating the incident command system (ICS) Evaluate effectiveness of ICS policies, procedures, and staff roles Update and revise the emergency management plan from lessons learned during the full-scale exercise.
Assumptions
Assumptions and artificialities may be necessary to complete play in the time allotted. During this exercise, the following apply: The scenario is plausible, and events occur as they are presented. Everyone receives information at the same time. Local exercise players will concentrate on the local response, assuming that federal and state responders have their own plans, procedures, and protocols in place and operating.
74
Appendix G:
3. Tabletop Exercise
Suggested Schedule 1 [Time] [Time] [Time] [Time] [Time] [Time] [Time] Welcome and introduction Player and participant briefings Exercise begins Lunch Exercise ends. Submit any exercise materials to [specify name] Hot wash beginsreport to: [site] Closing comments
Suggested Schedule 2 [Time] [Time] Welcome and introduction Module I Situation briefing Facilitated discussion Module II Initial response Situation update Breakout groups Lunch Module III Response and recovery Situation update Breakout groups Facilitated discussion Review and conclusion Closing comments
[Time]
[Time] [Time]
[Time] [Time]
75
Appendix G:
4. Tabletop Exercise
Sample Facilitator Guidance/Questions/Problem Statements
1. If the number of cases escalates, what actions will be taken to manage the increase in cases, given a scenario in which the scale of the public health emergency has not yet been defined? 2. What epidemiological and environmental expertise is needed to identify and contain the source of this public health emergency? Where and from whom would you seek assistance? Who will coordinate information? 3. When would clinical or environmental samples be collected? When would you expect to have the results back and how would you track them? 4. Are the area laboratories adequate to identify suspected biological agents? If not, where would you seek assistance? Who will coordinate this information? 5. Have you anticipated the kind of inquiries expected from the public and the media? 6. Identify your agencys established method of health surveillance.What other agencies will be involved in this effort? 7. Are there provisions for collecting data on new cases from private practice physicians and community health care agencies? How will this information be shared with the medical community?
76