A new test could tell us whether an AI has common sense

Virtual assistants and chatbots don’t have a lot of common sense. It’s because these types of machine learning rely on specific situations they have encountered before, rather than using broader knowledge to answer a question. However, researchers at the Allen Institute for AI (Ai2) have devised a new test, the Arc Reasoning Challenge (ARC) that can test an artificial intelligence on its understanding of the way our world operates.

Humans use common sense to fill in the gaps of any question they are posed, delivering answers within an understood but non-explicit context. Peter Clark, the lead researcher on ARC, explained in a statement, “Machines do not have this common sense, and thus only see what is explicitly written, and miss the many implications and assumptions that underlie a piece of text.”

The test asks basic multiple-choice questions that draw from general knowledge. For example, one ARC question is: “Which item below is not made from a material grown in nature?” The possible answers are a cotton shirt, a wooden chair, a plastic spoon and a grass basket.

If machine learning can successfully pass the Arc Reasoning Challenge, it would mean that the system has a grasp of the common sense that no AI currently possesses. It would be a huge step forward, leading to smarter artificial intelligence, and move these systems closer to one day taking over the world.

Source: MIT Technology Review

Source: Engadget - Read the full article here

Author: Daily Tech Whip

This article is part of our 'News Tiles' service. The site is currently in Beta. When it is fully operational you will be able to search through and arrange the 'Tiles' to display a keyword, product or technology over your chosen time period. For example you would be able to display all of the leading tech articles on the new Kindle Fire, in one spot in real time. You will also have access to our own original reporting and analysis as well as a polished place to post your own thoughts & reviews here, amongst the Daily Tech Whip Community. Please let us know if you have any feedback via the contact form or via Twitter. Don't forget to come back next week and see our full site and claim your name and your own free tech blog.

Share This Post On