Crude oil (called "petroleum") is easier to get out of the ground than coal, as it can flow along pipes. This also makes it cheaper to transport.
I ought to point out that some scientists are claiming that oil is not a 'fossil' fuel - that it is not the remains of prehistoric organisms after all. They claim it was made by some other, non-biological process. Currently this is not accepted by the majority of scientists.