I've cast flexible polyurethane foam into silicone rubber molds; it released fine and I could use the mold repeatedly. It had a shell I could close off to retain pressure. What's different about your project?
If you really need a one-use mold, try machinable wax for that. It machines quickly, releases well from most things, and can be recycled by melting and recasting.
ComputerSculpture.com — Home Page for Discount Hardware & Software