Turn it upside down on a soft surface and using a hammer & center punch tap the outter ring down in a few spots.
It will stop the rattle but it will still be ugly, I upgraded to the flush mount aviation style and it looks a lot better and is more secure as you need the key to remove it.
You can get a cap much cheaper from say....Dennis Kirk for instance.
And on my departed Sportster, the one from DK held up better the replacement I got from the moco. But, that was just my experience.
Mine did the same thing after I lifted the tank. It was very annoying rattling right in my face... Cover the cap in the rag and crimp the edge all the way round'. I think it looks better, plus gives it character.