Yes, you can cut aluminum dry.
What diameter tool are you considering?
What is the maximum shank size are you capable of holding?
Are you wanting to do face cuts with the end of the tool?
Or are you wanting to do side milling or both?
Do you want to use carbide or HSS.
Carbide will last longer but if your cuts are very small a HSS cutter will work.