It is quite easy to counter a single 'dancing' unit by manually giving targets for your units though - basically by microing yourself. If this 'bug' is changed at some point, I think an interesting element to the game will be lost.
Talking about realism: what about a formation of cavalry juking arrows at long range? That seems more than historically plausible, especially for lighter skirmisher cavalry.