Reference : Ensembles on Random Patches
Scientific congresses and symposiums : Paper published in a book
Engineering, computing & technology : Computer science
Ensembles on Random Patches
Louppe, Gilles mailto [Université de Liège - ULg > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation >]
Geurts, Pierre mailto [Université de Liège - ULg > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation >]
Machine Learning and Knowledge Discovery in Databases
Lecture Notes in Computer Science, Vol. 7523
European Conference on Machine Learning (ECML 2012)
From 24/09/2012 to 28/09/2012
Prof. Peter Flach
Prof. Tijl De Bie
Prof. Nello Cristianini
United Kingdoms
[en] ensemble methods ; large-scale learning ; supervised learning
[en] In this paper, we consider supervised learning under the assumption that the available memory is small compared to the dataset size. This general framework is relevant in the context of big data, distributed databases and embedded systems. We investigate a very simple, yet effective, ensemble framework that builds each individual model of the ensemble from a random patch of data obtained by drawing random subsets of both instances and features from the whole dataset. We carry out an extensive and systematic evaluation of this method on 29 datasets, using decision tree-based estimators. With respect to popular ensemble methods, these experiments show that the proposed method provides on par performance in terms of accuracy while simultaneously lowering the memory needs, and attains significantly better performance when memory is severely constrained.
The original publication is available at

File(s) associated to this reference

Fulltext file(s):

Open access
glouppe12.pdfAuthor preprint1.2 MBView/Open

Additional material(s):

File Commentary Size Access
Open access
glouppe12-suppl.pdfSupplementary materials101.08 kBView/Open
Open access
poster.pdfPoster presentation11.19 MBView/Open
Open access
slides.pdfOral presentation22.93 MBView/Open

Bookmark and Share SFX Query

All documents in ORBi are protected by a user license.