You should make sure that you understand this form of output and what it is telling you about how well your classified image matched your independent 'ground truth' data. Make sure you understand the terms such as 'User' and 'Producer' accuracy and other reported statistics.
You might also like to examine various options for 'post classification filtering', such as clump and seive. See the envi manual for more details on these operators.