Reference : Closed-form dual perturb and combine for tree-based models
Scientific congresses and symposiums : Paper published in a book
Engineering, computing & technology : Computer science
http://hdl.handle.net/2268/25764
Closed-form dual perturb and combine for tree-based models
English
Geurts, Pierre mailto [Université de Liège - ULg > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation >]
Wehenkel, Louis mailto [Université de Liège - ULg > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation >]
2005
Proceedings of the International Conference on Machine Learning (ICML 2005)
Yes
No
International
22nd International Conference on Machine Learning
2005
Bonn
Germany
[en] machine learning ; optimisation
[en] This paper studies the aggregation of predictions made by tree-based models for several perturbed versions of the attribute vector of a test case. A closed-form approximation of this scheme combined with cross-validation to tune the level of perturbation is proposed. This yields soft-tree models in a parameter free way, and reserves their interpretability. Empirical evaluations, on classification and regression problems, show that accuracy and bias/variance tradeoff are improved significantly at the price of an acceptable computational overhead. The method is further compared and combined with tree bagging.
http://hdl.handle.net/2268/25764
http://www.montefiore.ulg.ac.be/services/stochastic/pubs/2005/GW05

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
geurts-icml-2005.pdfPublisher postprint212.89 kBView/Open

Bookmark and Share SFX Query

All documents in ORBi are protected by a user license.