This paper conducts an empirical study to evaluate a selection of classification algorithms using 13 performance measures over 10 public-domain data sets from the NASA Metrics Data Program (MDP) repository [6]. The classification results are then analyzed using the MCDM methods to determine the best classifier for software defect prediction task.