Concentricity has to do with the accuracy of chucking the part. But I'll assume that you're saying that its just generally not a good bore.
What style of insert are you using? Are you having chip wrap nest problems that scuff the surface up? What feedrate and sfm?