Kaori’s expression was mix of embarrassment, worrying while she was expecting Hajime’s answer, and happiness coming from being able to convey her feelings to him. Thus, with those mixed feeling, she didn’t back away, displaying her determination.
That gaze, filled with determination and sincerity made Hajime answered her with serious eyes.