﻿{"id":6864,"date":"2019-04-21T20:45:32","date_gmt":"2019-04-21T12:45:32","guid":{"rendered":"http:\/\/www.nlpir.org\/wordpress\/?p=6864"},"modified":"2019-04-28T21:16:31","modified_gmt":"2019-04-28T13:16:31","slug":"end-to-end-sequence-labeling-via-bi-directional-lstm-cnns-crf","status":"publish","type":"post","link":"http:\/\/www.nlpir.org\/wordpress\/2019\/04\/21\/end-to-end-sequence-labeling-via-bi-directional-lstm-cnns-crf\/","title":{"rendered":"End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\" style=\"text-align:center\"><strong>NLPIR SEMINAR Y2019#11<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"> INTRO <\/h3>\n\n\n\n<p>        In the new semester, our Lab, Web Search Mining and Security Lab, plans to hold an academic seminar every Monday, and each time a keynote speaker will share understanding of papers on his\/her related research with you.<br><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Arrangement<br><\/h3>\n\n\n\n<p>This week&#8217;s seminar is organized as follows: <\/p>\n\n\n\n<ol><li>The seminar time is 1.pm, Mon, at Zhongguancun Technology Park ,Building 5, 1306.<\/li><li>The lecturer is <strong>Zhaoyang Wang<\/strong> , the paper&#8217;s title is <strong>End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF<\/strong>.<\/li><li>The seminar will be hosted by Qinghong Jiang.<\/li><li>Attachment is the paper of this seminar, please download in advance.<\/li><\/ol>\n\n\n\n<p>Everyone interested in this topic is welcomed to join us. the following is the abstract for this week\u2019s paper.<\/p>\n\n\n\n<p>\n\t<div style=\"border:dashed windowtext 1.0pt;padding:1.0pt 4.0pt 1.0pt 4.0pt;\">\n\t\t<p class=\"MsoNormal\" align=\"center\" style=\"text-align:center;\">\n\t\t\t<span>End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF<\/span>\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\" align=\"center\" style=\"text-align:center;\">\n\t\t\t<span>Xuezhe Ma and Eduard Hovy<\/span>\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\" align=\"center\" style=\"text-align:center;\">\n\t\t\t<span>Abstract<\/span>\n\t\t<\/p>\n\t\t<p class=\"MsoNormal\" style=\"text-indent:21.0pt;\">\n\t\t\t<span>State-of-the-art sequence labeling\nsystems traditionally require large amounts of task-specific knowledge in the\nform of handcrafted features and data pre-processing. In this paper, we\nintroduce a novel neutral network architecture that benefits from both word-\nand character-level representations automatically, by using combination of\nbidirectional LSTM, CNN and CRF. Our system is truly end-to-end, requiring no\nfeature engineering or data preprocessing, thus making it applicable to a wide\nrange of sequence labeling tasks. We evaluate our system on two data sets for\ntwo sequence labeling tasks \u2014 Penn Treebank WSJ corpus for part-of-speech (POS)\ntagging and CoNLL 2003 corpus for named entity recognition (NER). We obtain\nstate-of-the-art performance on both datasets\u201497.55% accuracy for POS tagging\nand 91.21% F1 for NER.<\/span>\n\t\t<\/p>\n\t<\/div>\n<\/p>\n\n\n\n<div class=\"wp-block-file aligncenter\"><a href=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/04\/End-to-end-Sequence-Labeling-via-Bi-directional-LSTM-CNNs-CRF.pdf\">End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF<\/a><a href=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/04\/End-to-end-Sequence-Labeling-via-Bi-directional-LSTM-CNNs-CRF.pdf\" class=\"wp-block-file__button\" download>\u4e0b\u8f7d<\/a><\/div>\n\n\n\n<!--nextpage-->\n\n\n\n<h2 class=\"wp-block-heading\" style=\"text-align:center\" id=\"mce_0\"><strong>NLPIR SEMINAR 24th ISSUE COMPLETED<\/strong><\/h2>\n\n\n\n<p>        Last Monday, <strong>Zhaoyang Wang<\/strong>  gave a presentation about the paper, <strong>End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF<\/strong>, and shared some opinion on it.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"709\" height=\"401\" src=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/04\/ppt.png\" alt=\"\" class=\"wp-image-6897\" srcset=\"http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/04\/ppt.png 709w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/04\/ppt-300x170.png 300w, http:\/\/www.nlpir.org\/wordpress\/wp-content\/uploads\/2019\/04\/ppt-80x45.png 80w\" sizes=\"(max-width: 709px) 100vw, 709px\" \/><\/figure>\n\n\n\n<p>In the picture, dashed arrows indicate dropout layers applied on both the input and output vectors of BLSTM. One is that a dropout layer applied before character embeddings are input to CNN. Another is that dropout layers are applied on both the input and output vectors of BLSTM. The dropout layers can reduce overfitting. <\/p>\n\n\n\n<p>The LSTM-CNN-CRF model can also be applied to ancient Chinese sentence tagging.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>NLPIR SEMINAR Y2019#11 INTRO In the new  &hellip; <a href=\"http:\/\/www.nlpir.org\/wordpress\/2019\/04\/21\/end-to-end-sequence-labeling-via-bi-directional-lstm-cnns-crf\/\">\u7ee7\u7eed\u9605\u8bfb <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":862,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[37,38],"tags":[],"_links":{"self":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/6864"}],"collection":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/users\/862"}],"replies":[{"embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/comments?post=6864"}],"version-history":[{"count":5,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/6864\/revisions"}],"predecessor-version":[{"id":6899,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/6864\/revisions\/6899"}],"wp:attachment":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/media?parent=6864"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/categories?post=6864"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/tags?post=6864"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}