I had the same problem with my Road King Classic. I found that most of the wind was coming up from below the windshield. Installing a set of chrome wind deflectors was a great improvement.
I am 6'0" and I run the standard windshield and this below fork deflector. I ride with a 3/4 helmet w/visor and it is so calm for me I could smoke cigars. Not a fan of the "walrus tusk" deflectors as far as appearance goes. If you don't have this lower fork deflector get and try it before you buy the "tusks".