Have you set them on a guard spot in your base after you released them ? Ive not ther guard spot is somwher close to the cage you released them . You can check your follower list and let you show wher they are on map