Choose foods and adjust your diet in whatever way is most enjoyable, sustainable and all around preferable for you. Whatever you need to do to ensure you consistently eat the right total amount of calories and nutrients each day (and get those nutrients primarily from higher quality sources)… THAT’S what you should do.