Can you use a 5C or some other form of collet in your 4t axis instead? For a job count that small I'd be tempted to use a a 5C hex collet block like this one:
https://www.shars.com/5c-collet-block-set
Along with a collet stop to make the head location repeatable under the spindle.