Seems your foundation was decayed and then it can be destroyed by anyone passing by. Make a bigger area of foundations to increase the decay time, suggest building a small outpost house on the site :slightly_smiling_face: