Spirits do not Possess inanimate objects like houses or toys, they posses people. An inhuman spirit can attach itself to a place or object and this is what occurred in the Annabelle case. This spirit manipulated the doll and created the illusion of it being alive in order to get recognition. Truly, the spirit was not looking to stay attached to the doll, it was looking to posses a human host.