Abandoned in the 12th century. That in itself is intriguing. The first King Henry had lost his son and heir, so upon his death, Stephen of Blois, his sister's son, claimed the throne. Of course, the baronage accepted him--provisionally. Providing he didn't screw up. Henry died in 1135. He did leave quite a few children, and one of the few legitimate ones--Matilda of Normandy--was the dowager Holy Roman Empress. So she was known as Maud the Empress. Long before Henry's death, doubts about the succession lead to a period known as the Anarchy. This was exacerbated when Maud, unhappily married to the Count of Anjou, decided to contest the crown with Stephen, leading to a civil war from 1140 onward. As Stephen's very unpopular son and heir was killed while raiding church lands in 1153, and the Archbishop of Canterbury and most English Bishops would not support him, Stephen eventually accepted Maud's son, Henry Plantagenet, by then married to Eleanor of Aquitaine. (That set up all manner of grief which did not finally end until the dereat of the English in the Hundred Years War in 1453.
Henry was really the first Norman king, not excepting the first King William, to actually impose his will on the baronage. The Anarchy was truly a time of strife and uncertainty, and knights and barons were often able to run rampant over their neighborhoods. I'm sure a great many villages were abandoned in that time.