Select relevant subset of features for the task.
Can be divided into 3 categories.
Wrapper
Find all combinations of features and evaluate the usefulness of the subset using task’s performance criteria. (e.g., the predictive performance)
Filter
Use mutual Information or correlation with target class.
Embedded
Feature selection is part of the learning machine.
LASSO, SVM.
31