Therefore, sorting algorithm categorized the fruits based on the external color of persimmons. The written algorithm captured an image, eliminated the noises, obtained binary image, removed the black spots, and ultimately extracted the color features. The best result for classifying the fruits was gained by QDA classifier with a high over all accuracy rate of 90.24%. Thus, it was concluded that external color features of persimmon fruits can be potentially used to classify the fruits with a proper probability.