Using a BoB makes the connections easier, so it is not just about isolation and protection, but sure, if you want to eliminate the BoB it isn't a big issue, as long as you know which wire is which. Though, I really don't understand any good reason to skip the BoB. It's a $5 saving unless you plan on buying a very expensive luxury one, so what's the point?