For my last few projects I would say 7-8 tools. The parts I have been making are fairly small and simple however most have several different size drilled holes that are needed.
As for tool holders there are never enough for either the mill or the lathe.... A pallet system sounds very cool.... Please share more on this idea.
Robert