It’s affecting all console players. Maybe before joining server go 1st to Settings and set Graphics to Performance mode and maybe try lowering drawing distance to minimum. If it works go away from other players base and avoid big builds. Stay in Performance mode untill it will get fix but you can try restoring drawing distance to original value.Maybe staying with very limited drawibg distance may be temporary solution, who knows.
Move out of your main base to one of your small outposts and play there.
Let’s hope this issue will choke them enormous base owners and they all will eventually dissapear.
This issue is well known and it got topic in PlayStation Bug Reports section of the Funcom forum: