4.1. Results from the expert survey
We conducted the survey during January and February 2012. The survey consisted of 68 assessments in two rounds, and
we got eight experts to go through both rounds. Since we used a LinkedIn search as a tool for recruiting the experts and thus
were unable to be sure about participants’ true level of expertise, as a first step in our analysis we wanted to verify that we
had not accidentally recruited a ‘‘non-expert’’ whose responses might deviate considerably from the others, causing disagreement.
To identify such outliers, we conducted standard principal component analysis (PCA) using the NCSS tool and
utilized graphical analysis of scatter plots of the most significant four factors, as shown in Fig. 2 below.