The value of the kind of work you do, even the kind of work possible, is most certainly derived from the level of the society.
Being a nuclear physicist in a destitute village in Somalia won't make you a contributing member of that society. But Man is almost infinitely adaptable, so, if willing and physically able, the physicist can, in extremis, become a subsistence farmer, so long as he is supported through that education by a kind sponsor, in lieu of family.
It is unlikely the Somali farmer's son will have the overriding vision to aspire to being a scientist much less have ready access to the years of specialized education required, but there are some surprisingly easy ways to access education and opportunity even in the most desolate areas for the brilliant and determined few. Talent does have a way of outing itself. And there are many that seek to support those who might aspire to greatness.
I work with two guys, war orphans and refugees, who did not get more than the most cursory educations as kids. Natural geniuses, they started formal schooling in their late teens in missionary settings and were PhDs by their mid-20s.
The idea of economic freedom is moderated or channeled necessarily from the circumstances one finds oneself in by birth or, in more fortunate cases, by choice as in the case of a mobile international executive or engineer trained to function outside a strict geographical boundary.
The idea of freedom in work is a simple one - you still need to function at the level of the society you are born to, at least at first, but your achievements should only be limited by your own abilities and not those of others. All should have a chance but none are guaranteed success.
Of course, I am only expressing the "conservative" position here. Others can and do argue that those who excel do so only unfairly/unjustly on the backs of others that achieve less or differently.
Extrapolating here, those who excel must then, of societal necessity, be disallowed special recognition or reward or such reward must be used for the benefit (ie money) of those less successful or capable to allow all to achieve at least the most modest level of mediocrity. After all, feelings will most certainly be hurt if one does better than another.
The jealousy thing is something most people never outgrow. And the excuses for a failure to strive are legion.