It could be 100 different things, but it's NOT the software.
It sounds like your seeing resonance, which is causing the motors to stall.
What are the specs on the motors and drives, and what voltage are you running at?
If you run the Mach3 Drivertest.exe in the Mach3 folder, do you get a smooth, flat line, and a steady pulse rate?