Sure. But I like to manage XP, especially with my healers; so I like to gather my holy bunch ASAP and take it from there.
Probably because they're fully garrisoned, then it's a real pain: hard to capture, loads of arrows... If necessary I do "inhale, exhale": attack, if they garrison withdraw out of sight so they come out, rinse & repeat.