Simulations and Brain Death: A Novel Approach to Evaluating Competency
Neil Dhruva1, Daniel Harrison1, Jenna Ford2, David Greer3, Sarah Wahlster4, Nikita Chhabra5, Ariane Lewis6, Lori Shutter7, Michael Rubin8, Panayiotis Varelas9, Katharina Busl10, Matthew Kirschen11, Thomas Nakagawa12, Paul Vespa13, Cherylee Chang14, David Bauer15, Carolina Maciel16, Michael Souter17, Fernando Goldenberg18, Conall Francoeur19, Thomas Bleck20, Gene Sung21, Sarah Nelson22, Lauren Koffman23, Evadne Marcolini24, Samuel Galvagno25, Christa O'hana Nobleza26, Brenda Fahy16, Ivan Rocha Ferreria da Silva16, Alejandro Rabinstein27, Abhay Kumar28, Jordan Bonomo29, Claude Hemphill30, Rahul Nanchal31, Bradley Dengler32, Nicholas Morris33
1Boston Medical Center, 2Northwestern, 3Boston University School of Medicine, 4University of Washington, Seattle, 5University of Michigan, Ann Arbor, 6NYU Langone Medical Center, 7UPMC Dept of Critical Care Medicine, 8UT Southwestern Medical Center, 9Albany Med-Department of Neurology, 10University of Florida, 11CHOP, 12University of Florida, College of Medicine, Jacksonville, 13UCLA, 14Duke University, 15Baylor College of Medicine, 16University of Florida, Gainesville, 17Harborview Medical Center, University of Washington, 18University of Chicago, 19McGill Univeristy, 20Northwestern University Department of Neurology, 21U.S.C. Neurology, 22Tufts Medical Center, 23Temple University Hospital, 24Geisel School of Medicine, Dartmouth, 25University of Maryland, School of Medicine, 26University of Tennessee Health Science Center, Memphis, 27Mayo Clinic, 28McGovern Medical School at UTHealth Houston, 29University of Cincinnati College of Medicine, 30Zuckerberg San Francisco General Hospital, 31Medical College of Wisconsin, Milwaukee, 32Uniformed Services University of the Health Sciences, 33University of Maryland Medical Center
Objective:
To develop a checklist, define critical actions, and set a minimal passing standard (MPS) for formative and summative assessment of brain death/death by neurologic criteria (BD/DNC) determination.
Background:
Clinician competence in BD/DNC determination is assumed but not established. Simulation-based mastery learning supports both training and assessment but requires a checklist and MPS supported by validity evidence, neither of which exists in BD/DNC.
Design/Methods:
A three-round modified Delphi consensus process defined checklist items, followed by a modified Angoff process to identify critical actions and establish the MPS. Delphi panelists included authors of the 2023 BD/DNC Consensus Guideline, World Brain Death Project, and experts recommended by these authors. Angoff panelists included United Council for Neurologic Subspecialties and Accreditation Council for Graduate Medical Education Neurocritical Care Examination Committee members. The steering committee generated candidate items, which Delphi panelists rated on a 5-point importance scale. Panelists were allowed to suggest new items and modifications during initial rounds. Items with >80% consensus were retained. Angoff panelists estimated the percentage of minimally competent learners expected to complete each checklist item during a BD/DNC case simulation. Items rated “100%” by >80% of panelists were designated critical (“can’t miss”). All others were deemed non-critical, allowing participants to miss these items and achieve competency if the MPS was met.
Results:

Ninety-eight checklist items were retained across four domains: prerequisites (23), clinical examination (28), apnea testing (36), and ancillary testing (11). Seven items were designated as critical actions. The remaining 91 items were assigned item average ratings. The minimum passing score for an assessment including all items was set at 89%.

Conclusions:

This guideline-concordant, consensus-derived checklist establishes an MPS for BD/DNC assessment, distinguishing critical from non-critical actions. Selective application of the checklist to simulated cases will facilitate assessment of competence and readiness for independent BD/DNC determination.

10.1212/WNL.0000000000215900
Disclaimer: Abstracts were not reviewed by Neurology® and do not reflect the views of Neurology® editors or staff.