The son of a fashion model and a sewer contractor, Walker grew up in a working class, Mormon Los Angeles household. The oldest of five siblings, Walker's mother began taking him to auditions as a toddler. He was a child model beginning at the age of two.