As well as that thumb drive, I also have OS X installed on a couple of hard disks that connect to the Mac via USB. When I want to use one of these, I start the computer while holding down the Option key. That displays a screen with any bootable drive shown. I can select the one I want and the Mac starts up from that.