It's all about you keyboard, from what I understand. If you have a keyboard that you really want to keep, you can still replace the USB head of your keyboards USB wire with a soldering gun and a spare wire (See my post: How to "frankenstine" wires?How to "frankenstine" wires?)
Also, the USB port of your computer might be silghtly damaged, try plugging other things in it and see what happened (I've never heard of sounds unintentionally coming from connected USB ports!).
Finally, you should just get a new keyboard... XD.