There is a function bound to another key that allows you to switch between sights while you are aiming. Really handy.
I personally moved the binding to "mouse wheel down" and removed the weapon switching since I just use '1' and '2' for that anyways.