Intermediate scores for each research question against the 5
criteria were computed as the sum of the scores for that particular
criterion divided by the total number of scorers. This
resulted in a number between 0–100% that captured the “collective
optimism” of the group of 91 scorers that a given research
question would fulfill each given criterion. The overall
research priority score (RPS) for each research question was
then computed as the mean of the intermediate scores calculated
for each of the five criteria: RPS = [(Criterion 1 score %)
+(Criterion 2 score %)+(Criterion 3 score %)+(Criterion 4
score %)+(Criterion 5 score %)]/5. The confidence interval
was calculated using the bootstrapping methods in STATA
version 11.2.