Release your mouse button when you’re over the New Layer icon. A copy of the layer will appear above the original. In my case, Photoshop made a copy of my Background layer and named it “Background copy”. Notice that it also made this new layer the active layer: