เIn this chapter we return to the subject of the entropy of a training set, which
was introduced in Chapter 5. The idea of entropy is not only used in data
mining; it is a very fundamental one, which is widely used in Information
Theory as the basis for calculating efficient ways of representing messages for
transmission by telecommunication systems.