He taught himself to play the harmonica and piano as a child, and began playing for silent films at age 14. He earned a B.A. in English at New York University and an M.A. in that subject at Columbia. Forced by his father, an attorney, to study law, Schwartz graduated from NYU Law School and was admitted to the Bar in 1924