I would say that this is not great practice, but is probably ok for non-critical applications. There will be applications where its not ok to do that, but it depends in what configuration you are using your opamp, and how clean the signal needs to be.
If you are using it in any sort of negative feedback situation (like an inverting amplifier), noise on the non-inverting input will lead to noise on the output. Connecting the non-inverting input to power other devices will likely introduce such noise. If you are doing this, you should filter that input, like this:
simulate this circuit – Schematic created using CircuitLab
The values are a bit arbitrary, and you might not need two capacitors, but I might do it just to be safe. If you have a specific opamp in mind, you should check the input current leakage specification, and you may be able to increase R1 to add more filtering.