I took a look at the drawing and I only would change one thing. The outside of the part I would make as one poly line. I'm still learning this CNC stuff and its new to me. Seems like if its one poly line it cuts more accurate then if its in line segments. Just my two cents worth and someone else can give better advice. Its just something you can try.
Hope you have a great day.