In plain words: It builds a model from trees whose splits fade in gradually instead of snapping on, so you can compute how the prediction shifts as each input changes. On simulated and real data it recovers partial effects, which tree ensembles like Random Forests cannot give.
Abstract · BooST: Boosting Smooth Trees for Partial Effect Estimation in Nonlinear Regressions
In this paper, we introduce a new machine learning (ML) model for nonlinear regression called the Boosted Smooth Transition Regression Trees (BooST), which is a combination of boosting algorithms with smooth transition regression trees. The main advantage of the BooST model is the estimation of the derivatives (partial effects) of very general nonlinear models. Therefore, the model can provide more interpretation about the mapping between the covariates and the dependent variable than other tree-based models, such as Random Forests. We present several examples with both simulated and real data.
Yuri Fonseca, Marcelo Medeiros, Gabriel Vasconcelos, Alvaro Veiga
arXiv:1808.03698 · stat.ML, cs.LG, econ.EM, stat.ME · submitted Aug 10, 2018 · updated Jul 28, 2020
abstract · pdf · html