And now I replaced him, and he physically disappeared. Follower list is showing him in that place, but he is invisible and I can not interact with him. :')
Tried rescuing him, I got the info note “he was rescued”, but he is nowhere to be seen.