Reference : Logical Analysis of Data: Classification with justification
Scientific journals : Article
Physical, chemical, mathematical & earth Sciences : Mathematics
Engineering, computing & technology : Computer science
Business & economic sciences : Quantitative methods in economics & management
http://hdl.handle.net/2268/90494
Logical Analysis of Data: Classification with justification
English
Boros, Endre [> >]
Crama, Yves mailto [Université de Liège - ULg > HEC-Ecole de gestion de l'ULg > QuantOM > >]
Hammer, Peter L. [> >]
Ibaraki, Toshihide [> >]
Kogan, Alexander [> >]
Makino, Kazuhisa [> >]
2011
Annals of Operations Research
Springer Science & Business Media B.V.
188
The Mathematics of Peter L. Hammer (1936-2006): Graphs, Optimization, and Boolean Models
33-61
Yes (verified by ORBi)
International
0254-5330
[en] classification ; data mining ; Boolean functions ; LAD
[en] Learning from examples is a frequently arising challenge, with a
large number of algorithms proposed in the classification, data mining
and machine learning literature. The evaluation of the quality of such
algorithms is frequently carried out ex post, on an experimental basis:
their performance is measured either by cross validation on benchmark
data sets, or by clinical trials. Few of these approaches evaluate the
learning process ex ante, on its own merits. In this paper, we dis-
cuss a property of rule-based classifiers which we call "justifiability",
and which focuses on the type of information extracted from the given
training set in order to classify new observations. We investigate some
interesting mathematical properties of justifiable classifiers. In partic-
ular, we establish the existence of justifiable classifiers, and we show
that several well-known learning approaches, such as decision trees or
nearest neighbor based methods, automatically provide justifiable clas-
sifiers. We also identify maximal subsets of observations which must
be classified in the same way by every justifiable classifier. Finally, we
illustrate by a numerical example that using classifiers based on "most
justifiable" rules does not seem to lead to over fitting, even though it
involves an element of optimization.
QuantOM
Researchers
http://hdl.handle.net/2268/90494
10.1007/s10479-011-0916-1

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
LeukerbadiaRevisedDecember2010.pdfAuthor preprint650.88 kBView/Open

Bookmark and Share SFX Query

All documents in ORBi are protected by a user license.