A voltage regulator is an analog circuit that produces a stable output voltage that doesn't vary with input voltage or load changes. Switching regulators are much more efficient than linear ones.
Linear regulators have a minimum "drop out" voltage; the input must be at least this much higher than the output.
Further reading: