It is also much simpler with neural networks to learn over custom data, e.g. mixing supervised and unsupervised learning (labeled and unlabeled examples), transfer learning, etc., because you can change your evaluation criterion and minimize it.
If you want to do deep learning, we have a much better understanding of how to do training using neural networks, particularly because we can train on such large datasets.