I've talked about this before but there's no need to make this an uncomfortable ride. There's no need to engage in awkward small talk. If you have a phone and want to check emails/texts that's fine. If you have a book, read it. There's no need to talk about the whether or sports. Unless the person you're on the elevator with is someone you've seen and have established small talk rights with, just keep to yourself.