What are you using for stepper drivers? On a cheap board I had years ago, one of the axes was missing the first step after a direction change, only in one direction. So the axis very slowly drifted in one direction. Could test if it's that or something similar by just running the axis up and down a few hundred times and see if it returns to its original location.