Diseases appear as spots on the fruits and if not treated on time, cause severe losses. Excessive uses of pesticide for fruit disease treatment increases the danger of toxic residue level on agricultural products and has been identified as a major contributor to the ground water contamination. Pesticides are also among the highest components in the production cost thus their use must be minimized. Therefore, we have attempted to give an approach which can identify the diseases in the fruits as soon as they produce their symptoms on the growing fruits such that a proper management application can be applied. Some common diseases of apple fruits are apple scab, apple rot, and apple blotch (Hartman, 2010). Apple scabs are gray or brown corky spots. Apple rot infections produce slightly sunken, circular brown or black spots that may be covered by a red halo. Apple blotch is a fungal disease and appears on the surface of the fruit as dark, irregular or lobed edges.