As you point out, in the summer time, you burn more calories because you are more likely to be more active.

Humans used to spend the harvest months packing on the fat in order to survive the lean harvest and cold months of the year. Now, since a lot of people are inactive all year round, due to not needing to hunt and gather, we have a problem of keeping off excess fat, even in the abundance months.