Don't care" means you don't care about what happens. It won't change your views at all.
"Don't mind" means you are allowing it to happen.
"It doesn't matter" means you don't think it can help you, or won't affect the outcome.
"Nevermind" means forget about the fact I ever said anything.