The guys I've been out with have ranged from 5'5" to 6'7" thus far. As I stand at a height most are comfortable with, I get the advantage that taller men don't see me as unduly short, nor do shorter men have issues with me towering past them. For me, height is something like eye color--I have a slight preference for a given range, but the preference is only slight and *way* less important than a lot of other features, mental, character, or physical.
That being said, I can easily understand why people who are either very short or very tall do have strong height preferences. At the extremes, there are some practical issues involved. I'm reminded of a very tall friend from high school (doublebassist here) being very happy one day he spent shadowing someone in his chosen profession because that man was taller than him, and it was a relief to his neck and back to be looking up rather than down for a change.