Even more annoying than that was armies of siege or armies of archers in AoE. Buildings should definitely be immune to archers... and perhaps if infantry will be given the ability to break down walls at least make the shovel a optional upgrade, not like every soldier went to war with shovels.