This has always been a bit confusing to me.
For optimal job performance and to negate weather effects, you need to build housing near your industries.
Idealy, your market should be as centralized as possible to allow for easy acces and goods aquisition.
The area of effect of the market, means that (on most maps), it cannot be placed optimally.