I agree that borders are rather... spongey. I agree too that walls, palisades, and defensive structures should essentially block enemy border expansion. The parameter in TerritoryInfluence/Weight can be adjusted for this, but also there needs some territory code changes to help prevent the weird territory bubbles that form beyond those blocking structures.