One possible minor side effect of drinking ginger tea is heartburn or stomach upset, similar to how you feel when you eat chilies or other spicy foods. You could mistake this irritation for a ginger allergy. However, you might have an allergy to ginger if you experience a rash or discomfort in your mouth or stomach after drinking ginger tea.