In the original Robert E. Howard stories, Conan was often wearing more than just a fur loincloth. In fact, more often than not he was wearing armor. The bare-chested image seems like it came with the comics, which then inspired the Arnold movie.
But of course, when one has the body of Arnold, of course one wants to show it off and not cover it in mail.