Incorporating New Words Detection with Chinese Word Segmentation

热度1553票  浏览368次 【共0条评论】【我要评论 时间:2011年4月17日 19:58
自然语言处理与信息检索共享平台,dw9U+a8_~

Hua-Ping ZHANG,Jian GAO,Qian MO,He-Yan HUANG.Incorporating New Words Detection with Chinese Word Segmentation.In Proceedings of CIPS-SIGHAN Joint Conference on Chinese Language Processing (CLP 2010).Beijing, China.2010.8 .p249-251.
自然语言处理与信息检索共享平台[Fu1R gu/J5`

Abstract自然语言处理与信息检索共享平台qW {OO

自然语言处理与信息检索共享平台b;S ^U]#Vw

With development in Chinese words segmentation, in-vocabulary word segmentation and named entity recognition achieves state-of-art performance. However, new words become bottleneck to Chinese word segmentation. This paper presents the result from Beijing Institute of Technology (BIT) in the Sixth International Chinese Word Segmentation Bakeoff in 2010. Firstly, the author reviewed the problem caused by the new words in Chinese texts, then introduced the algorithm of new words detection. The final section provided the official evaluation result in this bakeoff and gave conclusions.

6V*C ?O0d v'z?:C0 自然语言处理与信息检索共享平台*?*u f2T(G~@+s@hcv

WordSegmentation-BIT0723.pdf(80.5 KB)

~"Dn z6i4Zn4fEu0
TAG: Chinese segmentation word ICTCLAS2011
顶:109 踩:111
对本文中的事件或人物打分:
当前平均分:-0.33 (439次打分)
对本篇资讯内容的质量打分:
当前平均分:-0.42 (415次打分)
【已经有479人表态】
97票
感动
54票
路过
49票
高兴
53票
难过
49票
搞笑
58票
愤怒
48票
无聊
71票
同情
上一篇 下一篇
发表评论
换一张

网友评论仅供网友表达个人看法,并不表明本网同意其观点或证实其描述。

查看全部回复【已有0位网友发表了看法】