You need to set them to guard after releasing them at your base or they will return to the cage when you log off.
That goes for all thralls, always remember to park them before you log off.