competence can be found in Aesaert et al. (2014). The items referring to the technical ICT skills were scored automatically, as the logged
information provided direct information as towhether the itemwas scored correctly or incorrectly. The decisionwhether a higher-order ICT
competencewas scored correctlyor incorrectly depended on the qualityof the content included in the answer. As these items requiredmore
judgment they were manually rated by a panel of test raters. In order to guarantee the quality of the scoring procedure of the higher-order
ICT competences, all test raters were selected from the expert panel and from a psychometric panel. Moreover, the test raters received
training in advance. After their initial development, all scoring keys were fine-tuned using the students' answers.