On a more serious note. You are probably going to find some people think you are crazy, but I say go for it.
Now how much money do you expect to have available for the machine? (You don't need to tell me, that is a rhetorical question.) Do you have enough to buy a machine that can handle wood, plastics, metal and more when the more might include granite or something like that. By enough I mean in the ballpark of 100 grand plus a bit of change for tooling.
Do you (will you) have enough money to keep you housed, fed and warm for the two or five years it might take to get your new venture to the state of making money for you? Or do you have plans to work on the side, assuming you can get a job, and burn the candle at both ends to get your operation going.
I think you should plan on taking at least three years before your CNC enterprise becomes viable and you should expect my 100 grand figure above to double over those three years.
I am sure you will get some people who suggest my figures and time period are too extreme but I have found it best to plan for the long haul. That way if things work out better than expected you are laughing. If you start out too optimistic and don't have the reserves, both financial and physical/mental, to carry you through some low points you will not be laughing.
I started my business many years ago several younger than 52 and the first ten years were sometimes a struggle. Now I am as many years past 52, I am mostly retired and I own a business that supports me in the lifestyle I have come to enjoy.
Which is why I say go for it and build something you can turn over to family, or hire salaried employees to run it while you enjoy the benefits of your success.