there isn't much other than a very slight amount of friction to prevent the holder from slipping in the taper , not worth the risk in my opinion .
It's probably best to focus on getting your orientation corrected before running any cuts , or hand bomb your tools until you get things running properly