One can also look at research done with fruit flies, where many generations and genetic inheritance can be viewed to gain insights in how genetics are passed on, and variations can spread in successive generations.
Your ant allegory does a good job of representing intuitively how environment can influence selection. That coupled with the observations that genes, our genetic instructions are passed on from generation to generation with occasional mutations, I personally think is enough to warrant at least a critical view.