How did you put the collet in the ER nut? You don't just thread the nut over the collet, there is an eccentric in the nut that you need to snap the collet into. If you didn't and you torqued things down, who knows what might have happened. See the diagrams here: Accessories ER Collet
bob