Reference : Dual Perturb and Combine Algorithm
Scientific congresses and symposiums : Paper published in a book
Engineering, computing & technology : Computer science
Dual Perturb and Combine Algorithm
Geurts, Pierre mailto [Université de Liège - ULg > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation >]
Proceedings of AISTATS 2001, Eighth International Workshop on Artificial Intelligence and Statistics
Key-West, Florida
Eighth International Workshop on Artificial Intelligence and Statistics
January 2001
[en] Machine Learning
[en] In this paper, a dual perturb and combine algorithm is proposed which consists in producing the perturbed predictions at the prediction stage using only one model. To this end, the attribute vector of a test case is perturbed several times by an additive random noise, the model is applied to each of these perturbed vectors and the resulting predictions are aggregated. An analytical version of this algorithm is described in the context of decision tree induction. From experiments on several datasets, it appears that this simple algorithm yields significant improvements on several problems, sometimes comparable to those obtained with bagging. When combined with decision tree bagging, this algorithm also improves accuracy in many problems.

File(s) associated to this reference

Fulltext file(s):

Open access
geurts-aistats2001.pdfPublisher postprint205.77 kBView/Open

Bookmark and Share SFX Query

All documents in ORBi are protected by a user license.