It's more on how the tree will benefit from it's immediate climate. Too cold and it won't survive. As from as low as 20°F, the tree will start experiencing minor leaf damage however, it will still survive - lower than that, it would become hazardous to the tree's survival. Keeping in mind that this is for decent sized trees - younger ones, I would say, should be kept in either a green/hot house or indoors.