There are such things as dialects. I don't know why people don't understand this.
As far as the pronunciation of H is concerned, it should be known that H's go in and out of existence in languages. To me, not saying the H sounds like you are from old money east coast United States, like you went to 'Ahvahd (Harvard) or something. Like when people say "an historical". I personally find dropping H's grating on my ears, and it sounds just a tad pretentious. My favorite is when people say "an" but still pronounce the H anyway. I think the increasing popularity of these few words may be due to hypercorrection: https://en.wikipedia.org/wiki/Hypercorrection
It's where people think something is a rule for "proper" speech, and then apply it everywhere it doesn't belong.
A sample quote from this article, which happens to talk about H's!H-adding
Some British accents, such as Cockney, drop the initial "h" from words, e.g. have becomes 'ave. A hypercorrection associated with this is H-adding, adding an "h" to a word which would not normally have an initial "h". An example of this can be found in the speech of the character Parker in Thunderbirds, e.g. "We'll 'ave the h'aristocrats 'ere soon" (from the episode "Vault of Death"). Parker's speech was based on a real person the creators encountered at a restaurant in Cookham.
So, there you go. It's the same thing, but in reverse. A member of a dialect who lost word-initial H's wanted to sound smart, and knew that the upper class pronounced H's, so he started inserting them wrongly. In the U.S., not pronouncing H's sounds smart and rich and east coast, so people increasingly drop them.