I use the same tactics as you and yes it has caused a lot of problems. I’m also a sorcerer so I’m extra vulnerable to direct damage. I need my slaves to wake up and fight for me!
May Set be with you