Development of an iterative validation process for a 30-day hospital readmission prediction index.

Document Type

Article

Publication Date

3-19-2019

Publication Title

American Journal of Health-System Pharmacy : AJHP : Official Journal of the American Society of Health-System Pharmacists

Abstract

PURPOSE: A study was conducted to determine if an iterative validation process could maintain or improve the discriminative and predictive capabilities of a 30-day hospital readmission prediction index over 2.5 years.

METHODS: Patient admissions were retrospectively identified using the electronic medical record. The receiver operating characteristic curve was used to assess model discrimination. Prediction index specificity, sensitivity, and positive and negative predictive values were also assessed. A rolling iterative validation process was developed in which patient admissions were divided into 3-month cohorts. Each cohort was analyzed individually and then included into the cumulative patient cohort and analyzed again.

RESULTS: From 121,277 patient visits, an iterative validation approach maintained the discrimination (0.71 to 0.72), predictive validity, and overall accuracy (80.9% to 81.7%) of the 30-day readmission prediction index over 2.5 years. Index sensitivity and negative predictive value increased from baseline while specificity and positive predictive value remained largely unchanged. None of the assessed index parameters diminished or became less useful over the course of the study.

CONCLUSION: An internal iterative validation process based on frequentist statistics maintained the discriminative ability and accuracy of a readmission index over 2.5 years despite numerous changes in the variables associated with readmission in the patient population.

Volume

76

Issue

7

First Page

444

Last Page

452

DOI

10.1093/ajhp/zxy086

ISSN

1535-2900

PubMed ID

31361819

Link to Full Text

Share

COinS