You know, maybe this could be it! The problem only started after I put the tavern in my base.
Well, if that really is the case, I hope FUNCOM can solve this soon in the next patch or update.