Incorporating New Words Detection with Chinese Word Segmentation

热度1660票  浏览383次 【共0条评论】【我要评论 时间:2011年4月17日 19:58

.]'g1N(luv0

Hua-Ping ZHANG,Jian GAO,Qian MO,He-Yan HUANG.Incorporating New Words Detection with Chinese Word Segmentation.In Proceedings of CIPS-SIGHAN Joint Conference on Chinese Language Processing (CLP 2010).Beijing, China.2010.8 .p249-251.

UE;{pr1o0

Abstract自然语言处理与信息检索共享平台 [X'ohp J~_v

自然语言处理与信息检索共享平台 Y5e;`/gX

With development in Chinese words segmentation, in-vocabulary word segmentation and named entity recognition achieves state-of-art performance. However, new words become bottleneck to Chinese word segmentation. This paper presents the result from Beijing Institute of Technology (BIT) in the Sixth International Chinese Word Segmentation Bakeoff in 2010. Firstly, the author reviewed the problem caused by the new words in Chinese texts, then introduced the algorithm of new words detection. The final section provided the official evaluation result in this bakeoff and gave conclusions. 自然语言处理与信息检索共享平台 q7b:vCXv/o`W

自然语言处理与信息检索共享平台9w$ji7Hg!q d

WordSegmentation-BIT0723.pdf(80.5 KB)

m!Y;F*p/W t0
TAG: Chinese segmentation word ICTCLAS2011
顶:119 踩:118
对本文中的事件或人物打分:
当前平均分:-0.31 (467次打分)
对本篇资讯内容的质量打分:
当前平均分:-0.43 (443次打分)
【已经有513人表态】
114票
感动
55票
路过
53票
高兴
57票
难过
51票
搞笑
62票
愤怒
49票
无聊
72票
同情
上一篇 下一篇
发表评论
换一张

网友评论仅供网友表达个人看法,并不表明本网同意其观点或证实其描述。

查看全部回复【已有0位网友发表了看法】