In terms of infectious diseases, germs make you sick, not the cold weather itself. You have to come in contact with rhinoviruses to come down with a cold and influenza virus to contract the flu. The rhinoviruses peak in spring and fall, and flu viruses in winter.
While researchers have not found a connection between being chilled and getting sick, cold air may contribute to conditions that lead to illness.