Jink, sorry for your problems, but it has plagued Conan Exiles for a long time. Solving it would require an enormous effort on the part of the devs and while it is on the priority list, my view is that it is not high enough.
Culled from many posts and personal experience, we have found the following avoids the problem most of the time. Please see the below and let us know if it helps.