Pay attention to the warning signs.
Is the contractor usually late? Do you make several calls before he gets back to you? Does he delegate the job to one of his crew? Is he careless about keeping the job clean? Know when to draw the line. This is your home after all, not a construction site.