We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Automated identification of eviction status from electronic health record notes.
- Authors
Yao, Zonghai; Tsai, Jack; Liu, Weisong; Levy, David A; Druhl, Emily; Reisman, Joel I; Yu, Hong
- Abstract
Objective Evictions are important social and behavioral determinants of health. Evictions are associated with a cascade of negative events that can lead to unemployment, housing insecurity/homelessness, long-term poverty, and mental health problems. In this study, we developed a natural language processing system to automatically detect eviction status from electronic health record (EHR) notes. Materials and Methods We first defined eviction status (eviction presence and eviction period) and then annotated eviction status in 5000 EHR notes from the Veterans Health Administration (VHA). We developed a novel model, KIRESH, that has shown to substantially outperform other state-of-the-art models such as fine-tuning pretrained language models like BioBERT and Bio_ClinicalBERT. Moreover, we designed a novel prompt to further improve the model performance by using the intrinsic connection between the 2 subtasks of eviction presence and period prediction. Finally, we used the Temperature Scaling-based Calibration on our KIRESH-Prompt method to avoid overconfidence issues arising from the imbalance dataset. Results KIRESH-Prompt substantially outperformed strong baseline models including fine-tuning the Bio_ClinicalBERT model to achieve 0.74672 MCC, 0.71153 Macro-F1, and 0.83396 Micro-F1 in predicting eviction period and 0.66827 MCC, 0.62734 Macro-F1, and 0.7863 Micro-F1 in predicting eviction presence. We also conducted additional experiments on a benchmark social determinants of health (SBDH) dataset to demonstrate the generalizability of our methods. Conclusion and Future Work KIRESH-Prompt has substantially improved eviction status classification. We plan to deploy KIRESH-Prompt to the VHA EHRs as an eviction surveillance system to help address the US Veterans' housing insecurity.
- Subjects
ELECTRONIC health records; UNITED States. Veterans Health Administration; EVICTION; LANGUAGE models; HOUSING stability; SOCIAL determinants of health
- Publication
Journal of the American Medical Informatics Association, 2023, Vol 30, Issue 8, p1429
- ISSN
1067-5027
- Publication type
Article
- DOI
10.1093/jamia/ocad081