Feature selection for best mean square approximation of class densities

A criterion for linear feature selection is proposed which is based on mean square apporximation of class density functions. It is shown that for the widest possible class of approximants, the criterion reduces to Devijver's Bayesian distance. For linear approximants the criterion is equivalent to well known generalized Fisher criteria.