the development of a rating format follows systematic job analysis, the identification of criteria and appropriate raters, and decisions about the timing of appraisal. although direct measures for performance appraisal are available for some jobs, by far the most widely used formats are judgmental.