Please add a check box in the gameplay menu screen that disables harvesting by hand.
The Use command default ‘E’ key is loaded with lots of functionality. There comes a point where the last thing you want to do is pick up a rock in combat instead of issuing and order to a follower, and you do all your harvesting with tools.