Taming and milking horses started in Kazakhstan 5500 years ago and continues to this day, so it would seem Kazakhstan is a natural place for a horse riding adventure. Indeed, horses are a big part of the culture and you can find them everywhere once outside of the big cities. With limited time and budget, a horse riding tour is probably the best way to go.
If you have more time and would like to strike out on your own, you can organise to rent a horse yourself with the help of a local translator or guide if you don’t speak the language. If you’re planning a big, seasons-spanning horse-ride through Kazakhstan, you might consider buying horses.