The challenges involved include reliably sensing the trees despite sloped terrain, branches sticking out of the canopy, tall grass, and missing trees; localizing the vehicle within the row; following in and outside-the-row trajectories; and avoiding obstacles such as people and bins.