"maybe", but I don't think I would bother.
I did little mahogany and ebony boxes similar to how you described as and xmas present. Ideally, you want to leave the top ledge for last, reclamp it to relieve stress (warp), then machine the top surface. This does somewhat depend on how you are fixturing in the first place. You also want to make sure the longest side of the box is in line with the grain... assuming its not square