As a beginner player, I definitely find it easier to raid human players than even an AI set to Easy or Very Easy. I don't know whether that's a good or a bad thing, but the AI does oddly prioritize stone towers over, say, generating more soldiers.
If there were a fix needed, I'd think it would be less about how powerful towers are and more about nudging the AI away from lining its borders with them.