To assess the pretest scale reliability of the quantitative judgments made by the questionnaire respondents, item placement ratios measure was used as indicator to measure the observed proposition of agreement between judges that is greater than would be expected from chance.
The item placement ratios assess both the validity of the generated items and the reliability of the proposed measurement scales.
If there is a high degree of interjugde agreement,
then the percentage of items place in the target construct will also be high.
In addition, scales based on a high degree of construct validity and also exhibit the potential to be reliable.