I lost mine because I missed targeted the black blade and the system thought I commanded my followers to move to that spot. Within seconds, the followers died as they tried to rush the defenders to get inside.