Background

Point of Care Ultrasound (POCUS) has gained wider use in resuscitation of patients presenting with cardiac arrest. POCUS can play an important role in determining the etiology of arrest as well as being used to determine the presence or absence of mechanical activity. The REASON study demonstrated that patients with PEA or asystole without cardiac activity on POCUS are extremely unlikely to survive to hospital discharge though this study did not investigate the more important question of a survival with a good neurologic outcome. (Gaspari 2016). In light of this as well as other evidence, some have proposed that the absence of cardiac activity may be adequate to declare resuscitation futility and stop resuscitative efforts. However, there is a lack of agreement on what defines cardiac activity (see table 1). Due to this, and other factors, the level of agreement between physicians in interpretation of cardiac standstill is unknown.

Clinical Question

How much variability exists in the interpretation of cardiac standstill on POCUS amongst physicians?

Population

Survey respondents were residents, fellows and faculty attending ED-ICU combined ultrasound rounds at a combined conference (three academic institutions).

Outcomes

Primary: Variability in interpretation of cardiac standstill among respondents
Secondary: Variability among subgroups based on specialty, training level and self-described POCUS experience

Design

Cross-Sectional convenience sample survey
Participants were shown 15, 6-second deidentified ultrasound clips of patients with pulseless arrest and given up to 20 seconds to answer whether the clip demonstrated cardiac standstill or not.

Excluded

Physicians that did not register demographic information (specialty, training level etc).

Primary Results

Primary Results

  • Physician sonogrphers included: 127
    • Emergency Medicine: 94 (74%)
    • Critical Care: 15 (12%)
    • Cardiology: 4 (3%)
  • Training Level
    • Resident: 80 (63%)
    • Fellow: 11 (9%)
    • Attending: 24 (19%)
  • POCUS Skill Level
    • Basic: 68 (54%)
    • Advanced: 37 (29%)
    • Expert: 7 (6%)

Critical Findings

  • Interrater Agreement (Primary Outcome)
    • Overall: moderate agreement (alpha = 0.47)
    • Variable agreement across US clips
  • Interrater Agreement by Subgroup
    • Moderate agreement seen across specialty, training level and US experience
    • Fair agreement among critical care physicians

Definitions:

Krippendorff’s alpha = assessment of interrater reliability among physicians, similar to Fleiss’s kappa but thought to be more reliable in situations with missing data points

  • Range of 0 to 1
  • Score of 0: Poor agreement
  • Score of 1: Perfect agreement
  • Customary to require alpha ≥0.80 for agreement, but tentative conclusions can be drawn at alpha ≥0.667

Strengths

  • Study asks an important diagnostic question that has not been previously addressed
  • Majority of respondents self-reported “basic skill level” which may make study more generalizable (in comparison to just having expert level operators)

Limitations

  • Non-random, convenience sample of participants
  • Majority of respondents self-reported “basic skill level” which may skew analysis towards disagreement

Author's Conclusions

“According to the results of our study, there appears to be considerable variability in interpretation of cardiac standstill among physician sonographers. Consensus definitions of cardiac activity and standstill would improve the quality of cardiac arrest ultrasonographic research and standardize the use of this technology at the bedside.”

Our Conclusions

We agree with the authors that this study, though limited by it’s methodology and convenience sample, demonstrates significant disagreement between providers as to the interpretation of cardiac standstill on POCUS.

Potential Impact To Current Practice

This study cannot be used to impact clinical practice but should cause some pause for thought for providers who are currently using POCUS in cardiac arrest as part of their protocol for termination based on cardiac standstill.

Bottom Line

The use of POCUS to declare death and stop resuscitation is predicated on a clear ability to establish the presence of cardiac standstill. The low level of agreement of providers likely reflects the absence of a single definition of standstill as well as calls for increased training and assessment. A unified definition of standstill would be extremely helpful not only in future research but in cardiac arrest care as well.

Read More

Core EM: ED POCUS in OHCA – The REASON Study

Gaspari R et al. Emergency Department Point-Of-Care Ultrasound in Out-Of-Hospital  and in-ED Cardiac Arrest. Resuscitation 2016; 109: 33 – 39. PMID: 27693280