You need to set your Combat Tactics for your thralls according to how you have them placed.
For archer thralls (and dancers, depending) - you most likely want to use the HOLD Combat Tactic. I posted about these with a pretty descriptive breakdown of how the work here.
Give Hold a try, and see if that solves your issue.