Origin
The phrase was originally 'Between the Devil and the deep sea' (and somes 'the Dead Sea' or 'the Red Sea'). The sea turned blue much later and the phrase became well-known via the title of a popular song Between the Devil and the Deep Blue Sea, written by Ted Koehler and Harold Arlen, and recorded by Cab Calloway in 1931.