We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Automatic piecewise linear regression.
- Authors
von Ottenbreit, Mathias; De Bin, Riccardo
- Abstract
Regression modelling often presents a trade-off between predictiveness and interpretability. Highly predictive and popular tree-based algorithms such as Random Forest and boosted trees predict very well the outcome of new observations, but the effect of the predictors on the result is hard to interpret. Highly interpretable algorithms like linear effect-based boosting and MARS, on the other hand, are typically less predictive. Here we propose a novel regression algorithm, automatic piecewise linear regression (APLR), that combines the predictiveness of a boosting algorithm with the interpretability of a MARS model. In addition, as a boosting algorithm, it automatically handles variable selection, and, as a MARS-based approach, it takes into account non-linear relationships and possible interaction terms. We show on simulated and real data examples how APLR's performance is comparable to that of the top-performing approaches in terms of prediction, while offering an easy way to interpret the results. APLR has been implemented in C++ and wrapped in a Python package as a Scikit-learn compatible estimator.
- Subjects
BOOSTING algorithms; PYTHON programming language; REGRESSION analysis
- Publication
Computational Statistics, 2024, Vol 39, Issue 4, p1867
- ISSN
0943-4062
- Publication type
Article
- DOI
10.1007/s00180-024-01475-4