There is a problem with the concept of letting ur soldiers work.
Some people who spam skirmisher and spearmen, can let them work the whole time, while another player who focuses on horses, has half his army standing still doing nothing.
I always have to spend half my army collecting ressources, these units are missing in my army, while my opponent doesnt need to worry about this, he has full army/worker force.
Either make it that horsemen can get off their horse and work or change the whole concept. It cannot be that I need to worry about having too many horses or champions, while the player who just spams the cheapest unit has a full working force AND army!