Why wouldn't it be ok? In the usual configuration, the DC voltage on the positive side of the cap is always higher than the DC voltage on the negative side.
Even if you connect it with no bias, electrolytics can still withstand a small reverse voltage. It's only after they are reversed continuously at 1 V or more that the dielectric starts to degrade. See http://en.wikipedia.org/wiki/Electrolytic_capacitor#Polarity http://en.wikipedia.org/wiki/Capacitive_coupling