This article compares the test results of two different performance-based assessments of critical
thinking: a constructed-response task from the Collegiate Learning Assessment (CLA) and a multiple-
choice questionnaire (MCQ). These tests ostensibly measure the same critical thinking skills, such as
analysing, interpreting and evaluating information and problem solving. The study utilised a mixed-
method approach to explore the differences in students’ (n = 330) test scores. The results showed that
the correspondence between the CLA and the MCQ was fully comparable in 45.5% of the students’ test
performances. Ten percent of the students had completely opposite test results. Explanations for the
inconsistent results are discussed in detail.