manakawari
It is hard to say what you can do without the size/shape of the inside of your part, you could mill out the center first, mount that on a fixture the same shape as the cutout, hold it in place with a small washer & screw, mill the outside
You could also mill a fixture to hold/clamp the outside shape,then mill the inside