Instead, save it for a gentle pat down to dry off after rinsing off your cleanser. And make sure to hang it in a dry place (a.k.a. not the shower): Hammerman says that any moisture can be a breeding ground for bacteria and germs that can cause breakouts.