This has been going on for quite some time. Usually going out of render distance and coming back fixes it for me.