RE: [Discussion Post] At what point (if at all) should an AI have natural rights?
As-of now, no, I don't think that AI should have any rights.
In the future, I think it all depends. I'm aware of two schools of thought on the future of AI. Some people think that human decisions are purely driven by computation, and that eventually computers will be functionally equivalent to humans. This is known as "strong AI".
A second school of thought, however, says that there's something unique about humans, call it the soul, or spirit, or whatever you want. Whatever it is, there is more to human thought than mere computation. In this view, computers may simulate human behavior perfectly, but they'll always be a lower form of "intelligence". This concept is known as "weak AI".
Personally, I'm in the weak AI camp, until we learn differently, so I don't think that AI systems will be entitled to rights at any time in the foreseeable future.
On the other hand, if those in the strong AI camp turn out to be correct, then rights for AI may be appropriate -- which opens a new can of worms.
As long as AI does not have rights, AI can't replace the human race because the machines will always be dependent on human economic decisions. People will only keep machines running if it makes economic sense, which means that human machine-owners need human customers, and humans control the distribution of resources.
On the other hand, if the strong AI viewpoint is correct, and machines acquire rights (specifically, the right to own property), then humans will be competing with machines for resources, and if the AI outgrows human capabilities, the machines may threaten the continued existence of humanity. (not in a Terminator-style war, but just by out-competing us for the resources that we need to survive.)
An open question is how an external observer could ever know whether a machine that appeared to exhibit the strong form of AI is really intelligent, or if it is merely a simulation of intelligence. And another related question that's playing out at this very moment is this: CAN AI SYSTEMS HOLD PATENT FOR THEIR INVENTIONS?