The use of expert opinion in a given field was illustrated in a similar study by Cowles and Kubany (1959) to evaluate the performance of medical students. Experienced faculty members were interviewed to determine what they felt were the most important characteristics students should have in preparing for general practice, ultimately resulting in eight items. This appears quite similar to the first step taken by Brumback and Howell, which was labelled 'research ' ; indeed, the line between the two is a very fine one and the distinction somewhat arbitrary.
The important point is that, in both cases, information had to be gathered prior to the construction of the scale.