To begin with, the reason Hajime came here after hearing Endou’s story was his obligation to Kaori, and it had been accomplished. Thus, he went out of the room following Yue who pulled his hand. Shia followed after them without minding the others.
As such, the action of Hajime’s party made Kouki and the others stop.