Much the same applies to the so-called "natural rights".

I quote, because it is too warm to type much:

"Natural rights are exactly as knowable as invisible pink unicorns: anybody can fantasize them any way they want. During the Enlightenment, when liberalism was invented, liberal natural rights were a propaganda tool used to undermine the equally fictitious natural rights of kings. But even among liberals there was no agreement about whether slaveholding was a natural right or not, because natural rights are really just words.”

The only rights you are born with, including the right to being treated "fairly", are the ones your group enforces for you. YMMV greatly here, because reasons you give.