If the knurled nut on the collet was over tightened before closing the collet, it can take a fair amount of force on the handle to get it to release.
Especially if it sat for a long time and was able to squeeze the oil out of the mating parts.
I can't help you out on the VFD.