Before digital processing got fast and cheap enough to do convolutions, various ways were developed to do it in analog electronics. If you want to convolve two arbitrary signals, then you're out of luck unless you are willing to make a lot of compromises and/or spend a lot of money. Historically, analog convolutions were limited to convolving one real time signal by a pre-determined fixed signal, called the "filter kernel". Either way, some storage is required for each signal, but with one signal fixed it can be implemented by a "permanent" memory, which allows for a lot more possibilities than doing it on the fly.
You still have the problem of storing some portion of the live signal, since some interval of that needs to be multiplied by the kernel as the signal passes by. Systems have been developed that do this with delay lines, traveling electron beams, bucket-brigage charges on a CCD, and accoustic waves. There are probably others that I am not aware of or forgot about.
Once you can somehow store a snapshot of the live signal wide enough to match the filter kernel, you will have to then multiply it by that kernel and sum up the products. In delay line systems, this would be done with "taps" at regular intervals. The signal at each tap would be multiplied by a fixed gain (the filter kernel value at that tap), then all these resulting signals summed. CCDs had split pickups over each charge bucket so that the gain for each bucket was set by where the split was located. This would be set when the chip was made, so there were CCD filter chips with certain pre-determined filters. The most common use was for a sync filter, which is a low pass filter with a sharp frequency cutoff. Surface accoustic wave devices had the signal propagate accross the chip accoustically, which is much slower than light so a large enough time snapshot would be on the chip at any one time. Like with CCD, the pickups were arranged on the chip with pre-determined gains. These parts were typically used for IF and RF notch filters at a well tuned frequency.