Mutual Information : an Adequate Tool for Feature Selection ?

Benoît Frenay, Université catholique de Louvain
vendredi 15 novembre 2013

Résumé : In the field of machine learning, mutual information (MI) has been widely used as a multivariate criterion to select relevant features. However, we have shown in several of our recent works that selecting the feature subset which maximises MI is not necessarily optimal. This talk first introduces MI from an information theory point of view. Then, the interest and use of MI in machine learning is discussed. We will study under which conditions this criterion can be safely used in classification and regression, showing that mutual information is in general a good choice, even if counterexamples can be obtained. Both theoretical and experimental results will support the discussion.


Cet exposé se tiendra en salle C20-13, 20ème étage, Université Paris 1, Centre Pierre Mendès-France, 90 rue de Tolbiac, 75013 Paris (métro : Olympiades).


Agenda

<<

2017

>>

<<

Juin

>>

Aujourd'hui

LuMaMeJeVeSaDi
2930311234
567891011
12131415161718
19202122232425
262728293012

Annonces

ESANN 2016 : European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning


STATLEARN 2016


ICOR 2016