What things (that are NOT purge-related) can damage your buildings in PvE official?

That is interesting … though some of the damage on the spiked fences are not where I’d expect anyone to climb up and over. But I’m also finding varied low amounts of damage on non-spiked fences … such as stairs, foundations, walls.
I did report this in detail on the forums a while back: