The first question is does it return to zero? Try rapid X moves and see if it returns to zero as well as Y moves and check for zero return.
Check motor belts to make sure teeth are not worn. Check pulleys to make sure they are tight on shafts.
The key is that it appears to be load related, thus something is slipping. That is why I am not going to cables and such.