Sometimes.
Sometimes it is stored on the back.
Excellent catch. This one will have to try it with no sword anywhere in inventory.