It sounds like you've got your material cantitevered out into empty space. This, as you've noticed, is not conducive to smooth cutting. I'd suggest supporting the far end and clamping it down (or if it's on the fourth axis, providing a tailstock with a center point which fits into a hole on the end) to eliminate vibration. It shouldn't matter much which way it cuts first.