I was thinking about it, and I wouldn't include victorinox in the fashion watch-folder either. I would personally pair them with casio; affordable and durable utilitarian watches. Having never owned one myself, I suppose I can't be certain, but I've heard good things about their build quality aswell.
What exactly is the 'fashion' in fashion watches, though? Does it necessitate skimping on build quality/movements? Does it have to be made by known clothing/jewlery/what-have-you brands? Or is it just about making a good looking watch?
I get the stigma in watch circles. But I don't get all the bad rep. At the end of the day most people just want a stylish way to tell time.