Speaking and Listening are the two essential language skills. Without a speaker and an understander, there can be no language at all.
Reading and Writing allow us to preserve and archive language. If you are able to speak and listen, you can communicate - but you have no way to preserve such communication.
Speaking and listening is how we understand each other. Reading and Writing is how we build on that understanding.