Yes, the delay is singular, so it's a delay. The genitive five minutes' here is being used as a modifier. Genitives are usually specifiers (determiners), so they usually compete with other determiners such as a, some, two, but sometimes they can occur together:
a five minutes' delay
some stylish women's shoes
Oxford's two women's colleges
a glorious summer's day