I never felt the need to remove them. I do a fair amount of night riding so I want to be seen. If the guy doing the inspection in NJ notices there are no reflectors on you bike, you wont pass. NJ even requires reflectors on your helmet to pass inspection. Most just barrow one and go back to using their own.
I only took off the frame down tube ones. The one on the right melted when I went to a tru- dual set up. I don't think they look bad and realistically do help those idiots with night blindness see you better at night. I also just installed a signal dynamics XP2 brake light modulater.