We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
VERTIcal Grid lOgistic regression (VERTIGO).
- Authors
Yong Li; Xiaoqian Jiang; Shuang Wang; Hongkai Xiong; Ohno-Machado, Lucila; Li, Yong; Jiang, Xiaoqian; Wang, Shuang; Xiong, Hongkai
- Abstract
<bold>Objective: </bold>To develop an accurate logistic regression (LR) algorithm to support federated data analysis of vertically partitioned distributed data sets.<bold>Material and Methods: </bold>We propose a novel technique that solves the binary LR problem by dual optimization to obtain a global solution for vertically partitioned data. We evaluated this new method, VERTIcal Grid lOgistic regression (VERTIGO), in artificial and real-world medical classification problems in terms of the area under the receiver operating characteristic curve, calibration, and computational complexity. We assumed that the institutions could "align" patient records (through patient identifiers or hashed "privacy-protecting" identifiers), and also that they both had access to the values for the dependent variable in the LR model (eg, that if the model predicts death, both institutions would have the same information about death).<bold>Results: </bold>The solution derived by VERTIGO has the same estimated parameters as the solution derived by applying classical LR. The same is true for discrimination and calibration over both simulated and real data sets. In addition, the computational cost of VERTIGO is not prohibitive in practice.<bold>Discussion: </bold>There is a technical challenge in scaling up federated LR for vertically partitioned data. When the number of patients m is large, our algorithm has to invert a large Hessian matrix. This is an expensive operation of time complexity O(m(3)) that may require large amounts of memory for storage and exchange of information. The algorithm may also not work well when the number of observations in each class is highly imbalanced.<bold>Conclusion: </bold>The proposed VERTIGO algorithm can generate accurate global models to support federated data analysis of vertically partitioned data.
- Subjects
LOGISTIC regression analysis; FEDERATED database systems; PARALLEL algorithms; MEDICAL coding; MEDICAL care; COMPUTATIONAL complexity
- Publication
Journal of the American Medical Informatics Association, 2016, Vol 23, Issue 3, p570
- ISSN
1067-5027
- Publication type
journal article
- DOI
10.1093/jamia/ocv146