It's definitely conditioning and habit, like with many things. Nice to hear I'm not the only one, and that we're making conscious decisions about it. You can also use the peels to make stock (just freeze them until you have enough), so that you'd still get the nutrients. I know some skins can be bitter/hard but if the veg is edible, how likely is the skin to be poisonous? Following you too! :)