Actually, I'd say that both of the other answers are half-wrong. The true answer is:
it depends.
Basically, there are 3 possible options (although they aren't the only ones possible):
1a) (most common) a LED receives a current through a current-limiting resistor, the current path ends after the LED (ground etc);
In this case you can safely remove the LED, making it open-circuit. You can keep the resistor, the current won't flow through it anyway.
1b) a LED receives a limited current through a constant or current-limited current supply, the current path ends after the LED.
In this case, you won't find a current-limiting resistor - but you can still remove the LED without any side effects other than small overall current consumption reduction. note: while most (if not all) current sources have some kind of open-circuit protection, in very rare cases you may end with it pushing the drive voltage to the extreme, possibly damaging it
2) a LED receives a unlimited current, but with a limited voltage. You may find this solution in some low-end electronics OR in cases where the supply voltage is about Vd of the diode.
In this case, since the entire voltage drop happens on the diode, it's rather impossible that the current powers anything else, so you can usually safely unplug/unsolder it.
3) a LED receives a current and the current path doesn't end after the LED. It may be used as a rectifier or voltage dropper.
In this case, removing a LED with disable and/or damage the whole circuit dependent on the current. It is rare, but not entirely impossible to find. The current will probably not be limited by resistor in this case, but rather by some current driving IC, although you may find a limiting resistor in this case (note that since it actually reduces the maximum current of the whole path, it is even rarer IMO). You may consider replacing it with a series of non-LE diodes, usually 3 or 4 would be okay, depending on the exact colour of LED etc.
Also, bear in mind that the visual signal from the LED may be used by an optic receiver somewhere (computer mouse LEDs come to mind here), so you may (although unlikely) end with an appliance not sending required feedback signal, thus not working properly or at all.
Now, how to distinguish those cases? The simplest way is to unplug/unsolder the diode, check the results. In 99% of the cases everything will work as usual.
Note 1: doing a short circuit would damage solution 2), increase current consumption slightly (due to omission of diode's internal resistance) in cases 1a/b) and 3) and possibly stress/damage (although unlikely) some components in cases 1b) & 3). Doing an open circuit would disable all parts in series with the diode in case 3).
Note 2: burnt LEDs behaviour depends on the actual damage done to LED - although they usually simply increase their internal resistance heavily, so they approach open circuit after some time (like a fuse).
tl;dr in 99% of the cases simply remove the LED and don't worry about anything else. If the circuit malfunctions and the removal was done properly, either reattach the diode and cover it mechanically/visually OR use a series of non-LE diodes with Vd ~equal to Vd of your diode. YMMV.