Mutual Information : an Adequate Tool for Feature Selection ?

Benoît Frenay, Université catholique de Louvain
vendredi 15 novembre 2013

Résumé : In the field of machine learning, mutual information (MI) has been widely used as a multivariate criterion to select relevant features. However, we have shown in several of our recent works that selecting the feature subset which maximises MI is not necessarily optimal. This talk first introduces MI from an information theory point of view. Then, the interest and use of MI in machine learning is discussed. We will study under which conditions this criterion can be safely used in classification and regression, showing that mutual information is in general a good choice, even if counterexamples can be obtained. Both theoretical and experimental results will support the discussion.


Cet exposé se tiendra en salle C20-13, 20ème étage, Université Paris 1, Centre Pierre Mendès-France, 90 rue de Tolbiac, 75013 Paris (métro : Olympiades).


Agenda

<<

2017

>>

<<

Mars

>>

Aujourd'hui

LuMaMeJeVeSaDi
272812345
6789101112
13141516171819
20212223242526
272829303112

Annonces

ESANN 2016 : European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning


STATLEARN 2016


ICOR 2016