CF dust is very fine. Consider using a respirator like you would for painting instead of dust mask. A finer than usual filter on your vac would also be a good idea.
When you clean up, us cold water as this will help keep the pores in your skin closed. This will cut down on the amount of CF dust that clings to your arms.