Let’s call it what it is. Time spent PVEing is wasted.
Take the PVE out of PVP and you solve the problem with raiding.