They could have been built when you and your friends were offline, then as mentioned above, the builder deleted their character.