To eradicate bumps, Jaliman recommends using a body wash with benzoyl peroxide. While the ingredient is normally used as a spot treatment for zits, Jaliman says that it's a must for getting rid of folliculitis since it dries up and sloughs off the dead skin clogging the follicle. Try PanOxyl Benzoyl Peroxide Acne Creamy Wash ($11.99, walgreens.com).