There is a few mentions of it happening on vanilla server so probably Funcom will want to start investigating there.

But it does seem way more common on modded servers. As in, the mods make it worse but are not the root cause.