Ag nanoparticles (NPs) have been extensively utilized in surface-enhanced Raman scattering (SERS) spectroscopy for bacterial identification. However, Ag NPs are toxic to bacteria. Whether such toxicity can affect SERS features of bacteria and interfere with bacterial identification is still unknown and needed to explore. Here, by carrying out a comparative study on non-toxic Au NPs with that on toxic Ag NPs, we investigated the influence of nanoparticle concentration and incubation time on bacterial SERS spectral variance, both of which were demonstrated to be closely related to the toxicity of Ag NPs. Sensitive spectral alterations were observed on Ag NPs with increase of NPs concentration or incubation time, accompanied with an obvious decrease in number of viable bacteria. In contrast, SERS spectra and viable bacterial number on Au NPs were rather constant under the same conditions. A further analysis on spectral changes demonstrated that it was cell response (i.e. metabolic activity or death) to the toxicity of Ag NPs causing spectral variance. However, biochemical responses to the toxicity of Ag were very different in different bacteria, indicating the complex toxic mechanism of Ag NPs. Ag NPs are toxic to a great variety of organisms, including bacteria, fungi, algae, protozoa etc., therefore, this work will be helpful in guiding the future application of SERS technique in various complex biological systems.