What kind of rpm does the shaft turn at? I cannot think of an antifriction (ball) bearing that will cope with both. I think you'd need to mount a ball bearing on/in a sliding bushing to accomplish this task. The ball bearing could cope with the higher rpm.
A slide fit is prone to locking up if the length/diameter ratio is near unity. Since most ball bearing inner races are not as long as their diameter, they are prone to binding. For a long lasting sliding fit, you'd be better off with a length to diameter ratio of 3:1 or greater. The lower the clearance between the slide and the shaft, the less it will want to bind, but then slight contamination issues will cause seizing.