If you read the 16.06.2020 update, you will notice that they removed weapon penalties
· Removed the penalties for thralls who use attacks outside of their specialization
So don’t worry, it will still work fine, but if by crap you mean anything that you can’t control, then yes, it is absolute crap.
I understand some people get mad because of the negative perks, but i actually like them to be like this, maybe they could have done a better job, but somehow this system makes every thrall to be different of each other, and that’s fine for me, they have their stranghts and weakness, some more than others, i have no complains about this system but if it gets to be improved i would add encumbrance and grit to thralls. and they would cap their stats at 60 max