My paradoxical dating advice to the very short and very tall, based on the ups and downs of my dating experience as 6'2" guy:
Average height guys are the most likely to prefer guys around their own height. Because average height guys are the most common, excluding guys outside their average range does not damage their dating pool. On the other hand, guys who are outside this average range -- the short and the tall -- have limited power to exclude guys outside their own height range because they are less common. Unlike average height guys, they consistently see most people being shorter or taller than themselves. This, coupled with the fact that they are more often rejected because of their height than average height guys, makes short and tall guys less likely to reject because of height.
I have had more dates and I was more appreciated by 5'5" guys than by 5'9"-5'10" guys. Average height guys are the ones who reject me the most in spite of being the most common.
TL;DR: If you are very tall or very short, guys outside the average range are less likely to reject you because of your height than average height guys.