That unit is a nice little setup,
If I am following you correctly you want to put your own motor on it?. A hand drill motor will not be what you want for even light milling, you are correct that end play is not a good thing, hand drill motors do not have the RPM you will need for milling, they also take very little side load, just not designed for it. Perhaps a laminate router???.