This is a known, nasty issue our team is trying to squash. It’s been for the most part fixed on PC. Once we have a full fix ready, we’re going to deploy it to all consoles as a part of a bigger patch.
This is the thread we’ve been gathering info for the past few weeks: