Well, that's exactly what it means. "Did too" is a sort of slang way of saying "yes, you did", but it's quicker, so in an argument people often tack "too" onto the end of an affirmative. I think children started it, but you can hear lots of people saying it.