Each student scheduled an out-of-class meeting with one of us. The meetings
consisted of two parts. First, we discussed our observations and explained the grade that
we would give the student, giving them the opportunity to discuss differences of opinion.
Second, we showed them the sample application and asked them to "think aloud" to
explain its functionality and divine its purpose. This provided insight into not just student
capability, but also their approach. If students were unable to complete the task
satisfactorily, we provided some specific tips on how to practice, based on the mistakes
discovered.