I actually figured it out. To my surprise, the torque of the cutting is putting so much down force on the bit that it is actually pulling it out of the collet. I am not really sure how to remedy that, as my collet is a relatively new ER20 1/2". Any suggestions??? I suppose the easiest thing is to just take smaller bites.