They were larger bore so you could shoot someone's mount out from under them, they would carry them on their saddles, consider how much a good cavalry horse was worth compared to how much a soldier cost.

The model 1855 provided so much power, it was possible for the soldier to shoot at the horse of an enemy, thereby taking his victim out of the fight.

http://civilwarhandgun.com/harper.htm