Web crawling is a many-faceted topic, and as with most interesting
topics it cannot be split into fully orthogonal subtopics. Bearing that
in mind, we structure the survey according to five relatively distinct
lines of work that occur in the literature: