Unless you’re a hardcore PvPer, just wear whatever armor is the most aesthetically appealing to you, screw the stats.
I wear heavy Vanir because I like the look. Sure Silent Legion has better stats and defense, but I don’t care. The extra stats and damage reduction are negligible in PvE. I’d rather enjoy my appearance.
I’m not saying Silent Legion looks ‘bad’ though, on the contrary, I quite like it. I just prefer heavy Vanir.
Also the elemental protection hardly matters except in extreme conditions and only if you need to climb, really. So I wear hot armor even in the desert and swamp, also on the volcano unless I need to climb. Heatstroke is weak, as is frostbite.