I have this issue too. I switch a lot from chuck to collets. Other than saying, with practice you will get faster with the swap out;
The only thing I can think of that would be quicker (if it exsits) would be a a direct mount a2-5 3 jaw chuck. For that matter I would love a direct mount 4 jaw.
What I did was bored step chucks with the larger stock sizes I use.. 2",2.5" 3", etc.. I go easy when using these.
The other thing was getting a 4" 3-jaw with a 5C arbor on it for the quickie chuck need.
If you haven't tried them yet; Try using Hardinge step chucks with their closers. Nice, nice, nice.