There are a few precautions, when you go to the store to buy sweet potatoes. Always check the sweet potatoes before buying. Make sure that they are firm, without any bruises, cracks, holes (think worms) or soft spots. You should also avoid sweet potatoes stored in refrigerated aisles, as the colder temperature can affect the taste.