Yeah, it would be a bit of a pain, countered instantly by the issuing of another bow. Plus durability of 1,000 or whatever, more than pays for itself in arrows.
For me, it’s always been immersion-breaking to have infinite arrows from thralls, so short of running ammo inventories, I don’t think any other present mechanism could immediately address it. Other people have previously suggested the prohibiting of the retrieval of arrows, which I think is a draconian measure. Don’t have much use for bows myself, but I like the fact that thralls do.