Although Henry Pomeroy enclosed a deer park here in 1207,[2] the first reference to a castle does not appear until 1496, when Elizabeth, widow of Richard Pomeroy, was assigned a third of both the castle and the capital messuage. The document makes it clear that these were on different sites; the messuage is now thought to have been on or near the site of Berry House in the nearby village.