I have one axis with the pulley on the angular bearing end and the other is on the radial bearing end.
No problem from either one of them! Remember, the pulley is transmitting only radial force. so the lead screw doesn't care which end it comes from. If your using a belt drive, the minimal thermal expansion will not make any difference to the accuracy of the machine.