One type of rater training appears particularly promising.
Frame-of-reference training (Sulsky & Day, 1992) involves providing raters with common reference standards i.e., frames) by which to evaluate performance.
Raters are shown vignettes of good, poor, and average performances and are given feedback on the accuracy of their ratings of the vignettes.