I believe this is by design. They are thralls, not heroes. Even with War Party the combined effort of the followers will never exceed that of a similarly equipped player.