The whole concept of virtual reality is based around immersion.
You've got a headset on, which literally takes over your entire field of view.
You're often wearing headphones, meant to block out the world around you and bring the sounds of the virtual world to your ears.
But when it comes to bringing anything other than your eyes and ears into VR, the system falls apart.