It is dangerous but it will not destroy the people. When playing with fire, we use a lot of fuses. See nuclear powerplants. In my country, talking exclusively about electricity, they have about 4 sources, which can replace each other fully. Only one working is necessary for the plant to work.

It is true though that in theory - singularity is very dangerous. Set it to grow rice and maybe, it will come to a conclusion that if it removes humans, it will have more room to grow rice, therefore it will grow more.