What if you are visiting a neighborhood in Japan and have no idea what order the buildings were made? Is remaining in the same town or neighborhood one's entire life a common thing in Japan? In that case everyone would just know which house is which. In the US, moving to the next town or state over upon reaching adulthood is pretty common. Or even moving to the other side of the country. We do this to avoid our parents as much as possible.