There are mods that give you a “go away” command. Excellent ones.
But Funcom apparently forgot to copy that idea when they reworked follower commands - and instead revamped the inventory for no apparent reason.