How does the degradation (wear / decay) of buildings work?

Are you absolutely sure about that? Anything I’ve seen and experienced just requires you to be close, it being worked or not has had absolutely no bearing on decay. And I do have free-standing “work tables” occasionally.