You have explained the difference in a greater way bro, allergy and intolerance. Immune system attacks directly on allergic elements and does not recognise intolerance food; which is gonna affect your stomach by causing certain problems.

You're misconceptions about food is right; peanut doesn't cause any type of allergy, in our house kids eat peanuts but they are not affected with it or have shown allergic output.