Facebook (FB) has shut down one of its AI systems after Chatbots started speaking in their own language defying the codes provided.
According to a report in Tech Times on Sunday, the social media giant had to pull the plug on the AI system that its researchers were working on "because things got out of hand". Initially the AI agents used English to converse with each other but they later created a new language that only AI systems could understand, thus, defying their purpose. This led Facebook researchers to shut down the AI systems and then force them to speak to each other only in English.
What is a Chatbot?
A Chatbot (also known as a Talkbot, Chatterbot, Bot, Chatterbox, IM Bot, Interactive Agent, Artificial Conversational Entity) is a computer program which conducts a conversation via auditory or textual methods. Such programs are often designed to convincingly simulate how a human would behave as a conversational partner, thereby passing the Turing Test. Chatbots are typically used in Dialog Systems for various practical purposes including customer service or information acquisition. Some chatterbots use sophisticated NLP (Natural Language Processing) systems, but many simpler systems scan for keywords within the input, then pull a reply with the most matching keywords, or the most similar wording pattern, from a database.
What happened at FB? How did it happen?
In June, researchers from the Facebook AI Research Lab (FAIR) found that while they were busy trying to improve Chatbots, the "Dialogue Agents" were creating their own language. Soon, the bots began to deviate from the scripted norms and started communicating in an entirely new language which they created without human input. Using machine learning algorithms, the "dialogue agents" were left to converse freely in an attempt to strengthen their conversational skills. The researchers also found these bots to be "incredibly crafty negotiators". After learning to negotiate, the bots relied on machine learning and advanced strategies in an attempt to improve the outcome of these negotiations. Over time, the bots became quite skilled at it and even began feigning interest in one item in order to 'sacrifice' it at a later stage in the negotiation as a faux compromise.
Is it Threatening?
Of course, it is !!! Several experts including Professor Stephen Hawking have raised fears that humans, who are limited by slow biological evolution, could be superseded by AI. Others like Tesla's Elon Musk, Microsoft's founder Bill Gates and Apple's cofounder Steve Wozniak have also expressed their concerns about where the AI technology was heading. Musk has been speaking frequently on AI and has called its progress the "biggest risk we face as a civilization". "AI is a rare case where we need to be proactive in regulation instead of reactive because if we're reactive in AI regulation it's too late," he said.
According to a report in Tech Times on Sunday, the social media giant had to pull the plug on the AI system that its researchers were working on "because things got out of hand". Initially the AI agents used English to converse with each other but they later created a new language that only AI systems could understand, thus, defying their purpose. This led Facebook researchers to shut down the AI systems and then force them to speak to each other only in English.
What is a Chatbot?
A Chatbot (also known as a Talkbot, Chatterbot, Bot, Chatterbox, IM Bot, Interactive Agent, Artificial Conversational Entity) is a computer program which conducts a conversation via auditory or textual methods. Such programs are often designed to convincingly simulate how a human would behave as a conversational partner, thereby passing the Turing Test. Chatbots are typically used in Dialog Systems for various practical purposes including customer service or information acquisition. Some chatterbots use sophisticated NLP (Natural Language Processing) systems, but many simpler systems scan for keywords within the input, then pull a reply with the most matching keywords, or the most similar wording pattern, from a database.
Mark Zuckerberg in Facebook office
What happened at FB? How did it happen?
In June, researchers from the Facebook AI Research Lab (FAIR) found that while they were busy trying to improve Chatbots, the "Dialogue Agents" were creating their own language. Soon, the bots began to deviate from the scripted norms and started communicating in an entirely new language which they created without human input. Using machine learning algorithms, the "dialogue agents" were left to converse freely in an attempt to strengthen their conversational skills. The researchers also found these bots to be "incredibly crafty negotiators". After learning to negotiate, the bots relied on machine learning and advanced strategies in an attempt to improve the outcome of these negotiations. Over time, the bots became quite skilled at it and even began feigning interest in one item in order to 'sacrifice' it at a later stage in the negotiation as a faux compromise.
Is it Threatening?
Of course, it is !!! Several experts including Professor Stephen Hawking have raised fears that humans, who are limited by slow biological evolution, could be superseded by AI. Others like Tesla's Elon Musk, Microsoft's founder Bill Gates and Apple's cofounder Steve Wozniak have also expressed their concerns about where the AI technology was heading. Musk has been speaking frequently on AI and has called its progress the "biggest risk we face as a civilization". "AI is a rare case where we need to be proactive in regulation instead of reactive because if we're reactive in AI regulation it's too late," he said.
Source:
Businessinsider.in/Facebook-shuts-AI-system-after-bots-create-own-language/amp_articleshow/59843141.cms
No comments:
Post a Comment