﻿{"id":6282,"date":"2019-01-01T21:06:34","date_gmt":"2019-01-01T13:06:34","guid":{"rendered":"http:\/\/www.nlpir.org\/wordpress\/?p=6282"},"modified":"2019-01-08T23:52:06","modified_gmt":"2019-01-08T15:52:06","slug":"curriculum-learning-for-natural-answer-generation","status":"publish","type":"post","link":"http:\/\/www.nlpir.org\/wordpress\/2019\/01\/01\/curriculum-learning-for-natural-answer-generation\/","title":{"rendered":"Curriculum Learning for Natural Answer Generation"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\" style=\"text-align:center\" id=\"mce_0\">NLPIR SEMINAR Y2019#1<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"mce_1\"><strong>INTRO\ufeff<\/strong><\/h3>\n\n\n\n<p> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; In the new semester, our Lab, Web Search Mining and Security Lab, plans to hold an academic seminar every Wednesdays, and each time a keynote speaker will share understanding of papers published in recent years with you. <\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"mce_3\"><strong>Arrangement<\/strong><\/h3>\n\n\n\n<p> This week&#8217;s seminar is organized as follows:<br>1. The seminar time is <strong>1.pm, Wed.<\/strong>, at Zhongguancun Technology Park ,Building 5, 1306. <br>2. The lecturer is <strong>Baohua Zhang<\/strong>, the paper&#8217;s title is <strong>Curriculum Learning for Natural Answer Generation<\/strong>. <br>3. The seminar will be hosted by  Zhaoyang Wang. <br>4. Attachment is the paper of this seminar, please download in advance.  <br><br><\/p>\n\n\n\n<p> Anyone interested in this topic is welcomed to join us. the following is the abstract for this week\u2019s paper.<\/p>\n\n\n\n<p>\n\t<div style=\"border:dotted windowtext 1.0pt;padding:1.0pt 4.0pt 1.0pt 4.0pt;\">\n\t\t<p class=\"MsoNormal\" align=\"center\" style=\"text-align:center;\">\n\t\t\tCurriculum Learning for Natural Answer Generation\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\" align=\"center\" style=\"text-align:center;\">\n\t\t\tCao Liu,&nbsp;&nbsp;&nbsp;&nbsp; Shizhu He, &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Kang\nLiu,&nbsp;&nbsp;  Jun Zhao\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\" align=\"center\" style=\"text-align:center;\">\n\t\t\tAbstract\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\">\n\t\t\t<span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; By reason of being able to obtain natural\nlanguage responses, natural answers are more favored in real-world Question\nAnswering (QA) systems. Generative models learn to automatically generate\nnatural answers from large-scale question answer pairs (QA-pairs). However,\nthey are suffering from the uncontrollable and uneven quality of QA-pairs\ncrawled from the Internet. To address this problem, we propose a curriculum\nlearning based framework for natural answer generation (CL-NAG), which is able\nto take full advantage of the valuable learning data from a noisy and\nuneven-quality corpora. Specifically, we employ two practical measures to\nautomatically measure the quality (complexity) of QA-pairs. Based on the\nmeasurements, CLNAG firstly utilizes simple and low-quality QApairs to learn a\nbasic model, and then gradually learns to produce better answers with richer\ncontents and more complete syntaxes based on more complex and higher-quality\nQA-pairs. In this way, all valuable information in the noisy and unevenquality\ncorpora could be fully exploited. Experiments demonstrate that CL-NAG\noutperforms the state-of-the-art, which increases 6.8% and 8.7% in the accuracy\nfor simple and complex questions, respectively.<\/span>\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\">\n\t\t\t<span><\/span>\n\t\t<\/p>\n\t<\/div>\n<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"954\" height=\"370\" src=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/20190101-\u4e0b\u5348-084432.jpg\" alt=\"\" class=\"wp-image-6283\" srcset=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/20190101-\u4e0b\u5348-084432.jpg 954w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/20190101-\u4e0b\u5348-084432-300x116.jpg 300w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/20190101-\u4e0b\u5348-084432-768x298.jpg 768w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/20190101-\u4e0b\u5348-084432-80x31.jpg 80w\" sizes=\"(max-width: 954px) 100vw, 954px\" \/><\/figure>\n\n\n\n<div class=\"wp-block-file\"><a href=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/Curriculum-Learning-for-Natural-Answer-Generation.pdf\">Curriculum Learning for Natural Answer Generation<\/a><a href=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/Curriculum-Learning-for-Natural-Answer-Generation.pdf\" class=\"wp-block-file__button\" download>\u4e0b\u8f7d<\/a><\/div>\n\n\n\n<!--nextpage-->\n\n\n\n<h2 class=\"wp-block-heading\" style=\"text-align:center\"><strong>NLPIR SEMINAR 14th ISSUE COMPLETED<\/strong><\/h2>\n\n\n\n<p>Last week, BaohuaZhang gave a presentation about the paper, C<strong>urriculum Learning for Natural Answer Generation<\/strong>, and shared some opinion on it.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"768\" src=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/IMG_20190102_2-1024x768.jpg\" alt=\"\" class=\"wp-image-6602\" srcset=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/IMG_20190102_2-1024x768.jpg 1024w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/IMG_20190102_2-300x225.jpg 300w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/IMG_20190102_2-768x576.jpg 768w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/IMG_20190102_2-200x150.jpg 200w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/01\/IMG_20190102_2-80x60.jpg 80w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption>hdr<\/figcaption><\/figure>\n\n\n\n<p> After the presentation, several questions were asked. The Q&amp;As are listed as following: <\/p>\n\n\n\n<p>Q1: Does the Chinese and English have the same model? A1: No, the model is only for Chinese.<\/p>\n\n\n\n<p>Q2: Is the accuracy of this model not higher the basic model?<br>\nA2: Most of the model&#8217;s anwsers are right, and the answers are more natural and closer to our human&#8217;s expressions.<\/p>\n\n\n\n<p>Q3: This paper is about curriculum leaning, what&#8217;s the difference between it and general deep learning?<br>\nA3: Curriculum learning starts from easy instances and then gradually handles harder ones. In this paper the author uses instance scheduler, the instance contains target instances and common instance, and trains the model from common instances to target instances.<\/p>\n\n\n\n<p>Q4: Which model does NAG use?<br>\nA4: NAG uses gold topic entities to simplify the model.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>NLPIR SEMINAR Y2019#1 INTRO\ufeff &nbsp;&#038;nbsp &hellip; <a href=\"http:\/\/www.nlpir.org\/wordpress\/2019\/01\/01\/curriculum-learning-for-natural-answer-generation\/\">\u7ee7\u7eed\u9605\u8bfb <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":862,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[37,38],"tags":[],"_links":{"self":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/6282"}],"collection":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/users\/862"}],"replies":[{"embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/comments?post=6282"}],"version-history":[{"count":6,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/6282\/revisions"}],"predecessor-version":[{"id":6603,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/6282\/revisions\/6603"}],"wp:attachment":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/media?parent=6282"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/categories?post=6282"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/tags?post=6282"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}