It is believed that the village was badly effected by the Black Death and the remaining population moved to Lullington Farm, this explains why there are so few buildings near the church.
Why there are so few buildings near the church. This is what this explains.