Strobl et al. (2007) Bias in Random Forest Variable Importance Measures

cartrandom-forestvariable-selectionvariable-importancemachine-learningconditional-inference-treebias

Summary

Random-forest variable importance measures (VIMs) are widely used for variable selection — for example, choosing genetic markers to predict a disease. Strobl et al. show that, while VIMs are sensible in many settings, they are not reliable when candidate predictors vary in their scale of measurement or number of categories: suboptimal predictors can be artificially preferred. Simulation studies illustrate the problem and trace it to two mechanisms, and the authors propose a solution — an alternative random-forest implementation of conditional-inference trees grown with subsampling without replacement — that yields unbiased variable selection and reliable VIMs.

Key Claims

Concepts Introduced or Extended

Entities Mentioned

Quotes

"Random forest variable importance measures … are not reliable in situations where potential predictor variables vary in their scale of measurement or their number of categories … We propose to employ an alternative implementation of random forests, that provides unbiased variable selection in the individual classification trees … using subsampling without replacement."

My Take

The paper that turned "random forests give you free variable importance" into "…but read the fine print." Its value is diagnostic precision: the bias is not a vague warning but two identifiable culprits — bootstrap-with-replacement and impurity-based split selection — each with a concrete fix (subsample without replacement; use significance-test-based conditional-inference splits). That makes it the canonical citation for the selection-bias caveat on the wiki's CART page, and a healthy corrective to the enthusiasm for tree-ensemble importance in applied work — including the ML-for-returns literature (Gu-Kelly-Xiu), where importance rankings are routinely reported. The caveat is scope-specific (mixed-type predictors), but exactly where practitioners are least likely to notice it.