Maybe if we could have apple trees in the game we could tempt them to let us into the saddle quicker ? I do like that we can call them back though , thank you Devs for that.
I have this same issue 80-90% of the time and trying to mount the horse from the other side of the horse usually works as a workaround. Very strange bug though since 3.0 update