Layer soil over the gravel. You should fill the pot about halfway with soil, and the soil should be loosely packed. Use potting soil instead of dirt from your garden, since potting soil has less bacteria in it and contains more nutrients to help your flowers grow. A blend especially designed for tulips will work best.