Add about a half gallon of bleach to your water supply. Allow the water to sit for about 12 hours and run the water until your water supply no longer contains bleach. This method is effective when the rust in your water supply is produced by bacteria.