Performance is measured by the number of correct responses. For the less complex internal
control tasks, we counted the number of plausible errors listed and evaluated the substantive
procedures to determine if they would be useful in detecting the errors. Plausible errors were those
that could reasonably result from the internal control weaknesses. Substantive tests were evaluated
as correct if they would reasonably be expected to detect the error indicated as resulting from the
internal control weakness. Listing three appropriate financial statement errors and correctly
identifying two relevant substantive audit procedures would result in a performance score of 5 (0–5
points were assigned, based on the number of correctly identified errors and substantive
procedures). For the relatively complex ratio tasks, we counted the number of ratio changes that could be reasonably explained by the accounting error listed by the participant. Correct
identification of the target explanation for each case explains all the discrepancies in the ratios
and results in a score of 5 (0–5 points were assigned, based on the number of ratio changes
explained by the error listed).