It is your choice shows what you truly are far more than your abilities. Therefore, if you believe you're doing the right thing, you should ignore the noise around you.
I have learned how to live the life with passion and happiness. I see many people complain too much because of living the life without passion and happiness. Also, I know that working hard and working smart are the key of success. Aside from that, I understand the reason why people shouldn't value other's opinons on themselves rather than their opinons on themselves.