The right to assemble?

While most of the world is in some form of a quarantine or shelter-in-place order, it is crazy to see how liberties that Americans have can be quickly taken away. I can see the need for social distancing, but at what point is it going too far? Is there a too far? Not being allowed to have a huge party at Disneyland is one thing, but not allowed to have friends over to your house?