Well, it took more than a few days and a few more improvements but it looks like a viable option. Changes include:
1. Added a slot on the plate and the bottom of the holder for a keyway to insure positive alignment.
2. Increased the tool holder length to 1.75".
3. Changed from individually drilled holders to MT-1. Individual holders proved to be a PITA and not as accurate.
Made the first holder today and drilled a 5.1 mm (for 1/4-20), worked like a champ. Next will be a MT-2 holder.
Now, will have to find the time to program the entire part.
Have turned over the plans to Novakon and they will search for a source to fabricate the fixtures.
See attached photos.