It's not so much that you call them average as it is how much you assume about how they feel about their lives, that I think bother people.
When I was 15 I decided to drop out of "high school". I had big dreams, and I couldn't see how school would help me realize them. I started my first business a year later and have been a business owner since (7 years now).
Up until 2 years ago it was a struggle. Many times I didn't knew if I'd be able to pay next months rent, and it was hard to be taken seriously. I remember at one time a business man didn't even want to rent me a storage. He told me flat out that he thought I should go back to school. He wasn't being mean, I could tell he felt honest worry (however I doubt he would feel the same urge to rescue me if I was an 18 year old boy and not a blue eyed blonde... Sometimes it's an advantage, sometimes not).
Today I can't even believe how lucky I am to have the life that I have, spending most of the time doing things I love. But at the same time I can't imagen going through the first 5 years of pain if I wasn't wired the way I am. I was always an outcast and a dreamer and preferred spending Friday nights running, reading a book or working on an idea over going to a party.