“House of Memories” is about a past relationship that’s now over. The relationship was “built / On memories.” It was strong and beautiful, but something happened, and now it’s over. Urie doesn’t give us the details of the breaking up; he focuses on how hard life is now that his once lover is gone.