Some possibilities are:
1. Conatamination in side the spindle--dirt, embeded chips, dings
2. Chips or dings on the tool holder taper
3. excessively grooved pull studs
4. Weak bellville washers not applying enough retention pressure.
5. A bad tool holder. re-test with a different holder.
Neal