The castle was founded before 1250 by the Lords of Krumlov, one of the branches of The powerful House of Vítkovci whose emblem was a five-petal rose. Its foundation is closely connected with name Vítek junior of Krumlov who used the predicate - "de Chrumbenowe" in 1253. There is a written document mentioning the place called "Krumbenowe" in the work "Frauendienst" by aristocrat Ulrich von Liechtenstein.