Isn't the pop thing (morale bonus?) more of an attack reduction rather than a defense boost?
yes, morale thing is a malus for attacker, not a bonus for defender.
according to simulator.
any village has 10 def strength minimum and can have about 1600~2000 maximum (depends on tribe).
which can kill Level 20 Equites Caesaris too.
destroy those buildings before farming.