Nah.
Walls should take some time to build.
Palissades are historically exactly what is used to slow down enemy attacks, especially cavalry.
Maybe get a tech "staked palissades" (or caltrops, maybe) that forbid cavalry to attack palissades (ideally, force them to dismount to attack palissades, but we don't have a dismounting mechanism - so maybe give the staked palissage a small aura that slow down cavalry).
What we want is spear infantry on choke points created by palissades to be able to destroy champion cavalry, while cavalry still being dominant on the open field against unarmored foes, and champion cavalry able to take on armored foes on open field in a somewhat equal foot.