A common drop in very specific areas, not common to skeletons.
Doing the bat creature kill challenges I went through the unnamed city stomping skeletons. No rare spice.
Did the dreggs and got a bit, first time I have gotten rare spice in loot since they changed the loot tables for AoW.
I think rare spice should be found in chests at any pirate camp.