I LOVE the salt and pepper look. It just looks so distinguished and is one of the more attractive attributes of an aging man. As it get further into the salt part, the attraction doesn't start to go away, you just look older, and is replaced with a different attractiveness. I've seen some guys who were pure white in the hair, and they were sexy as hell.
If the color, or lack there of, bother you, try changing the style that you think fits the color, and something you find comfortable having on your head.