Hornworm damage usually begins to occur in midsummer and continues throughout the remainder of the growing season. The size of these garden pests allows them to quickly defoliate tomatoes, potatoes, eggplants, and peppers. Occasionally, they may also feed on green fruit. Gardeners are likely to spot the large areas of damage at the top of a plant before they see the culprit.