I found a circuit where in the classical Graetz rectifier capacitors were added in parallel to each diode.
It looked something like this:

After the rectifier itself, there was the usual huge capacitor and regulator and so on.
So why the smaller capacitors near the diodes?