4. Computation of scores for competing research options
and ranking:
The intermediate scores were computed for each of the five
criteria and they could potentially range between 0–100%.
Those scores indicate the “collective optimism” of the group
of scorers that a given research question would fulfil each
given criterion. The overall research priority score for each
research question was then computed as the mean of the intermediate
scores. The average expert agreement scores were
also calculated (Online Supplementary Document).