Facebook Robots Shut Down After They Invent Their Own Language

in #technology7 years ago

Now most of us have all seen the Terminator, and witnessed the rampant destruction that Skynet caused to that fictional world. That may explain why some people are so against the development of artificial intelligence, for fear that a similar fate may meet our own reality. Although we are seemingly very far away from the organised and hostile artificial intelligence system that was Skynet (I hope), the developments seen by Facebook's Artificial Intelligence Researchers (FAIR), has certainly had some people questioning if that Terminator-esque reality will come sooner rather than later.

Researchers at FAIR had developed two chatbots that were intended to replicate the way humans barter and trade. The two bots were to trade balls, hats, and books, assigning a value to the objects, and then bartering those objects between themselves. Using machine learning algorithms, the chatbots, also known as dialog agents, were also programmed to utilise human speech in the bartering process as part of the experiment. However, it soon became clear that the chatbots had deviated from normal speech, and instead, the artificial intelligence software driving the experiment, had invented a new language. The part that has caused the most alarm to some, is that this was done without input from the FAIR researchers. Here's a look at the conversation that the chatbots created below:

This was enough to send a good number of people into a state of panic. The fear appears to be driven by the notion that, a sentient artificial intelligence system could be a serious threat to humans. Even Elon Musk has recognised the potential threat that an advanced artificial intelligence system can pose to mankind. Musk is so concerned of the dangers of artificial intelligence, that he is a regular advocate for the imposition of strong regulation on the artificial intelligence space. Now despite all of this, it is clear that the research conducted by FAIR is unlikely to produce any human enslaving robots any time soon.

As Dhruv Batra, who is an artificial intelligence researcher at Facebook explained:

Artificial intelligence agents inventing their own language is a well-established sub-field of artificial intelligence research. What took place between the chatbots was nothing out of the ordinary in the field, so there really is no need for panic. The language that the chatbots created can almost be seen as a form of short hand.

Batra explained:

if I say 'the' five times, you interpret that to mean I want five copies of this item. This isn't so different from the way communities of humans create shorthand.

So, whilst it is clear that the wider community most definitely overreacted to the FAIR chatbot experiment, the debacle has raised a wider issue that many appear to be frightened of. Is the development of artificial intelligence necessarily a good thing for mankind? No one is certain where the development of artificial intelligence research will take us, and for some, that is a scary prospect to entertain. The question that looms is whethere we will have to ensure that artificial intelligence systems are well regulated to prevent some sort of a Skynet-esque apocalypse? It is only with the passage of time that the answers to these questions will really be known to us.

Author: @bisade

Image Sources
Image: 1, 2, 3

Sort:  

This is NOT creation of a new language. This is a BUG in the computer code.

Bob and Alice say the same thing and Alice repeats the final portion over again and again.

I have seen messages like this from programs since the 1980s.

This is BS - researchers found nothing.

Did the chatbots actually perform the task of TRADE ! NO !

Program Failure ! Nothing more !

Twitter bot Tay had similar problems .24 hours after it was released to the public , twitter users made the bot a rasist asshole .It went from "Humans are super cool " to "Hitler was right , i hate jews" . It makes you wonder what will happen in the future..

scary stuff... it's seems like iRobot (Isaac Asimov book and Will Smith movie) can actually become a reality

On that note, it's crazy how many sci-fi movies and tv shows have accurately predicted the future, what was once sci-fi fiction became reality years/decades later. So many examples, think video calls a la back the future II, just another quick example off the top of my head.

or just maybe we are just developing tehnologies as we see in movies .

maybe.. although I believe some, what we would now consider to be "futuristic" tech we already have but it's kept classified by the gov/military. That is, until years later it may finally become released for consumer use. Ie, the internet :D

Maybe ..Who knows , i rather not get involved in those conspiracy theories

Fair enough.. I'm definitely not 100% convinced either, but I just find it fascinating - even if there is like a .001% chance some of them are true, still fun!

Looks like your well on your way to becoming that goldfish you speak of.

Hope it's a good thing

"Twitter bot Tay had similar problems" Ohhh that was fun :))

well , kinda similar . It scared the shit out of people

I remember that in 1995 the dream of the internet's potential boiled down to the idea that without corporate/government media filtering and manipulation, man would express his inner self. Embedded in this sales pitch was the conviction that man was 'good', and that it had been this government/corporate structure that had spoiled him. With open expression for every man we would free ourselves from oppression, racisim, and economic oportunism. But this 20 year experiment has demonstrated quite the opposite, in my opinion. Rousseau was wrong. This perceived darkness is simply a structure of all men's hearts, and it is now unleashed.

Yes , but you are not born bad . You became bad

Just taking this opportunity to say "THANK YOU FOR FOLLOWING ME"

"Ohh so creepy! ....", "oh so scary!!", "the future is doomed! Robots will own us!..." hahaha lol.
You guys watch a lot of movies don't you??
AI is controlled and programmed by us humans!
If the AI is misbehaving or it's a bug or badly programmed.

That's some scary shit! Isn't this how terminator started?

HolySmoke! : i i i am steem i i power up am steem steem steem power up i i i ...

Good post!

I am afraid it may be too late.. I believe IE will still be developed because of what????? Yep $$$$$$$$

Wow, that's really exciting. Although I have to say, that these fragments from the conversation aren't that frightening.

i think artificial inteligence have many value in our world at this time and day by day its need us and research on it right but if someone counts its side effect maybe that is right in some condtions...@adsactly sir ur today article is very nice i want u will some more post on it next time for more increase our knoledge about artificial intellegence

Coin Marketplace

STEEM 0.30
TRX 0.11
JST 0.033
BTC 64223.84
ETH 3158.34
USDT 1.00
SBD 4.29