I did find and remove the CMOS battery, however I had problems locating the jumper/jumpers, they should be on the back on your hard disk drive right?
EDIT: Interesting, now when I start up after the first screen I still get POST error occurs window but in the upper left corner instead of keyboard error I get
"CMOS checksum error. Loading Default"