if the USB cable is providing power for your audio device and not just sending audio signals out the device then yes that will be a source for interference as well.

to test it, you can take aluminum foil, wrap the cable up with it leaving only the ends exposed and see what that does. If it works, you know what to do next.