That looks more-or-less normal for an up-cut spiral in MDF. You may be able to get slightly better results by adjusting the speeds & feeds, but it will never give you a perfect crisp edge.
I usually "break" the surface with a 1/8" or 1/4" down-cut spiral, to a depth of about 1/10". I then do the full depth cuts with a larger diameter up-cut spiral. (The concept is similar to using a scoring saw on a panel saw to prevent chips along the edge.) I do this in any material where tearout is likely to be an issue.