It was here that they developed open-ended problems in order to evaluate students' activity. Open-ended problem refers to the problem that is formulated so as to have multiple correct answers.Shimada and others developed different open-ended problems such as "marble problem" and "water flask problem.