Decoding Mortality: How Well Do Pediatric Scoring Systems Work?
"A deep dive into the Paediatric Index of Mortality (PIM) scores and their effectiveness in assessing risk in intensive care units."
In pediatric intensive care units (PICUs), accurately assessing a child's risk of mortality is crucial for guiding treatment decisions and evaluating the quality of care. Various mortality risk assessment scores have been developed to aid in this process, with the Paediatric Index of Mortality (PIM) and its updated version, PIM 2, being among the most widely used.
These scores, initially created and validated in specific populations and timeframes, need to be carefully evaluated before being applied in different environments. A recent study examined the utility of PIM and PIM 2 in the Red Cross War Memorial Children's Hospital (RCWMCH) in South Africa, the only children's hospital in sub-Saharan Africa providing exclusive tertiary and quaternary services for children.
This article delves into the findings of the study, comparing the performance of PIM and PIM 2 in the RCWMCH PICU with their performance in the units where they were initially derived. By exploring the scores' discrimination and calibration, this analysis sheds light on their effectiveness as mortality risk assessment tools in a unique healthcare setting.
How Accurate Are PIM and PIM 2 Scores?
The study retrospectively audited case records and prospectively collected patient data from all admissions to the RCWMCH PICU during 2000 (for PIM) and 2006 (for PIM 2), excluding premature infants, children who died within 2 hours of admission, and those transferred to other PICUs. Researchers then analyzed this data to assess how well the PIM and PIM 2 scores predicted mortality in this specific population.
- Discrimination: Both PIM and PIM 2 demonstrated good discrimination, with AUC values of 0.849 and 0.841, respectively. This indicates that both scores are reasonably effective at distinguishing between patients who will survive and those who will not.
- Calibration: PIM showed poor calibration (x²=19.74; p=0.02), while PIM 2 demonstrated acceptable calibration (x²=10.06; p=0.35). This suggests that PIM 2's predicted mortality rates were more closely aligned with the actual observed mortality rates in the RCWMCH PICU than PIM's predictions.
- Standardized Mortality Risk Ratios (SMRs): The SMRs for age and diagnostic subgroups for both scores fell within wide confidence intervals. This makes it difficult to draw definitive conclusions about the scores' performance within specific patient subgroups.
Implications for Pediatric Intensive Care
The study highlights the importance of evaluating mortality risk assessment models in different healthcare settings before relying on them for clinical decision-making. While PIM and PIM 2 have been validated in various populations, their performance can vary depending on the specific characteristics of the patient population and the healthcare environment.
The finding that PIM 2 demonstrated better calibration than PIM in the RCWMCH PICU suggests that it may be a more appropriate tool for assessing mortality risk in this specific setting. However, the wide confidence intervals for SMRs in age and diagnostic subgroups indicate the need for further research to evaluate the scores' performance in specific patient populations.
Ultimately, mortality risk assessment models like PIM and PIM 2 can be valuable tools for benchmarking quality of care and identifying areas for improvement in pediatric intensive care units. By carefully evaluating and calibrating these models, healthcare professionals can ensure that they are providing the best possible care for critically ill children.