Business gift giving in England is not part of the business culture. Your business colleague might be embarrassed to receive a gift. It is better to reserve a gift until the conclusion of a deal.
If you choose to give a business gift, make certain it is small and tasteful. Good gifts include: desk accessories, a paperweight with your company logo or a book about your home country.