anyone who tells brass is difficult just doesn't know what they're doing, brass machines like butter....but like kaka said you have to make sure all cutting tools have zero rake.
here's some pics on what that looks like at the end of a drill. I keep sets of #, letters and fractions ground for brass as its a pita to have grind one back for steel
