It happens to me as well, every time I invite my friend he gets disconnected after a while and I receive a pop-up message saying that my connection was lost and that I’m no longer in co-op mode but in single-player.

I did that some days ago for optimization purposes, got an error and fixed it, but my friend is still getting disconnected.