{"id":340961,"date":"2017-05-15T23:59:58","date_gmt":"2017-05-15T15:59:58","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1489862"},"modified":"2017-05-15T23:59:58","modified_gmt":"2017-05-15T15:59:58","slug":"facebooks-parlai-is-where-researchers-will-push-the-boundaries-of-conversational-ai","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/facebooks-parlai-is-where-researchers-will-push-the-boundaries-of-conversational-ai\/","title":{"rendered":"Facebook\u2019s ParlAI is where researchers will push the boundaries of conversational AI"},"content":{"rendered":"

<\/p>\n

To most of us, communication is a single task. But in\u00a0reality, it\u2019s not and if you\u2019re a machine trying to replicate dialog, you need to be good\u00a0at\u00a0lots of tasks like\u00a0answering questions, completing sentences and even having small talk. It\u2019s common for research in each of these areas to be done independently, to the detriment of anyone trying to put the pieces together to create a conversational AI. The Facebook AI Research (FAIR) lab\u2019s open source ParlAI<\/a> serves as a home for dialog research, addressing this deficiency by making it easy to train models to complete multiple tasks with an assortment of commonly used datasets.<\/p>\n

Pulling a dataset into a workflow with ParlAI is as easy as throwing down some command line. This gives researchers quick access to benchmarking datasets like SQuAD<\/a>, bAbI tasks<\/a> and WebQuestions<\/a>. This isn\u2019t to say that the AI research community was unable to do this work before, but FAIR is trying to incentivize teams to regularly bring more datasets into their work. ParlAI also connects to Amazon Mechanical Turk<\/a> so researchers can collect new data seamlessly.<\/p>\n

\"\"<\/p>\n

The New York-based FAIR team behind ParlAI.<\/p>\n<\/div>\n

Jason Weston, a researcher at Facebook\u2019s AI Research (FAIR) lab<\/a>, told me in an interview that some of the inspiration for ParlAI came from watching researchers make progress on the WebQuestions dataset only to see the work largely ignored when it became clear that it was overly specialized and not applicable to other tasks.<\/p>\n

One of the challenges of following AI research is that it\u2019s really hard to read papers at their face value. In nearly every paper, researchers claim to have achieved a new state of the art after benchmarking their fancy model against commonly used tests.<\/p>\n

The problem is that there are so many factors that can lead to a given outcome that achievements really only have value if they can be reproduced. ParlAI takes some of the work out of reproducing research to instill healthier habits for the AI community. The FAIR team hopes to add in its own leaderboard in the future to help make sense of progress in the ecosystem.<\/p>\n

ParlAI is similar in form to other training and testing solutions like OpenAI\u2019s Gym<\/a> and DeepMind\u2019s Lab.<\/a> But while Gym and Lab are optimized for reinforcement learning, ParlAI is focused squarely on dialog. Some of the supervised learning that underpins work in the dialog space is less sexy than trendy reinforcement learning, but its incredibly fundamental to the field of machine learning.<\/p>\n

FAIR plans to use its own ParlAI internally for research. Facebook\u2019s work in dialog underpins many of its services, the most obvious one being \u201cM,\u201d its human + AI-powered assistant<\/a>. Eventually, Weston tells me that a service like M might be able to learn from talking to people and receiving feedback, much like how babies and young children learn.<\/p>\n

But the only way to get there is to break artificial silos and combine research to solve large scale problems. You can find ParlAI on GitHub<\/a> \u2014 the FAIR team will be maintaining it into the foreseeable future.<\/p>\n

Featured Image: Buena Vista Pictures<\/small><\/p>\n","protected":false},"excerpt":{"rendered":"

\"\" To most of us, communication is a single task. But in\u00a0reality, it’s not and if you’re a machine trying to replicate dialog, you need to be good\u00a0at\u00a0lots of tasks like\u00a0answering questions, completing sentences and even having small talk. It’s common for research in each of these areas to be done independently, to the detriment of anyone trying to put the pieces together… Read More<\/a><\/p>\n

\n<\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a>\n<\/div>\n

\"\"\/ <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-340961","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/340961","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=340961"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/340961\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=340961"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=340961"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=340961"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}