If you can use flood coolant that should help since the plastic swells alot when it gets hot and then shrinks when it cools off. I have only really had good luck with holes being accurate when I finish an undersized hole with a boring bar. Shoot for thicker chips(more
like an old telephone cord) and drill fast enough to get a similar chip. The thicker the chip the faster the heat is disipated from the material.