Morality applies to actions, which differ, but always have an objective representation in reality. Observing what actions do allows us to determine if they are moral or not. It's not based on subjective whims or wants. There is an objective reality of how actions affect others.