There were reports on the internet of Neo4j installations failing due to an error in the start script. On the systems I have installed, I have not run into this issue, however, THIS LINK will take you a blog post which discusses and addresses this issue.