I have been busy" implies that the period of busyness extends through the recent past up to the present time.
"I was busy" is referring to a past period of busyness which may have ended.
The word "lately" already tends to imply the former meaning, so I find "I have been busy lately" more harmonious. "I was busy lately" feels slightly mismatched to me. Different speakers may have different opinions about this.