They may not follow crew direction.
Passengers separated from families may panic.
In Andrea Doria Case the relatives and friend of passengers who had been killed in the collision try to find the missing persons. They could not follow direction from crew.
It was necessary for crew to be forceful.