To annex a territory, you first need to be allies. You can spend RP at your Tactical Map in game, or from the Kingdom Mode map view to ally with a territory. After doing this a new Quest will appear in your quest list which must be completed to annex that territory.