Fear of isolation when the group or public realizes that the individual has a divergent opinion from the status quo.
Fear of reprisal or more extreme isolation, in the sense that voicing said opinion might lead to a negative consequence beyond that of mere isolation (loss of a job, status, etc.)