Rabbits are a symbol of fecundity (they fuck alot). It is a pagan tradition celebrating the spring and new life. The church took over the traditions of the conquered and amalgamated it with their own dogma so the population would accept the new order. The original meaning was forgotten, but you still have aspects held onto, especially when they involve candy. And we won't even get into the birthday cakes and witchcraft....