There are rare exceptions, but you should only dress more casually if you are specifically told not to dress up. Even then you should pay attention to hygiene and not wear ratty or dirty clothing. This situation comes up most often for jobs that require outdoor manual labor.