Have, not of
When forming the various perfect tenses, people sometimes write of when they should write have, probably because they are writing what they hear. I should've (should've is a contraction of should have) sounds a lot like I should of. But the proper form in writing is have, not of.