What type of motors are these Brushed? DCBL? and make of driver.
Did you try without the belt on?
I am assuming you eliminated the possibility of slop in the pulley to shaft when you move it back and forth? IOW does the shaft move with the pulley? it is hard to see from the video.
Is the encoder disc loose maybe?