An automatic detection of rehabilitation protocols during rehabilitation process is, therefore, introduced. It can automatically guide the patients toward the actual rehabilitation protocol. In addition, the information can be applied to ensure that all the required steps or protocols, formally specified by tho therapist, are performed by tho patients.