The only issue with agility weapons on thralls is that they lack hyperarmor like maces. Which means if he is tanking for you, he’s going to get stunlocked more.
If you hold the attention of the enemy yourself, this shouldn’t be a problem.