ID3 Decision Tree The ID3 algorithm was invented by Ross Quinlan. It is a precursor to the c4.5 algorithm. We can create the decision tree in a given data set using this ID3 algorithm. This algorithm classifies the data using attributes. ID 3 follows the Occamss Razer Principle. It is used to create the smallest possible decision tree.