NLPIR\/ICTCLA2018 ACADEMIC SEMINAR 5th ISSUE<\/span><\/span><\/b><\/p>\n

\nr!F(t.p0~5U:D9m.`7l,G0<\/span><\/p>\n

INTRO<\/span><\/span><\/b><\/p>\n

\u0002@\u0004};z\u001fD\u0007V3D0<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 In the new semester, our Lab, Web Search Mining and Security Lab, plans to hold an academic seminar every Wednesdays, and each time a keynote speaker will share understanding of papers published in recent years with you.<\/span><\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f0’~\u001bf1h6c\u0013t7o<\/span><\/p>\n

\u00a0<\/span><\/span><\/p>\n

3J\u0002t3S\u001aS!D\u001fH0<\/span><\/p>\n

Arrangement<\/span><\/span><\/b><\/p>\n

-N\u0010X![:c\u0002d0<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 This week’s seminar is organized as follows:<\/span><\/span><\/span><\/p>\n

\u0001k,I\bp\u0010I\u0001y\u000b\\0<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 1. The seminar time is 1.pm, Wed<\/b>, at Zhongguancun Technology Park ,Building 5, 1306.<\/span><\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f09^!c\/n;b”l\u0003G n!|<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 2. The lecturer is Qinghong Jiang<\/b>, the paper’s title is Towards Designing Better Session Search Evaluation Metrics<\/b>.<\/span><\/span><\/span><\/p>\n

\u0013V+w$^2s+s\u0010g e0<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 3. The seminar will be hosted Shen Li.<\/span><\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f0\u001ci\u001fv5L0n s(q’X\fm0B\u0001e#PR<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 4. Attachment is the paper of this seminar, please download in advance<\/span><\/span><\/span><\/p>\n

*{\u001b~\u0014a\u000fv\u001f@,p1E\u001fI\u0012C\u0014T0<\/span><\/p>\n

\u00a0<\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f0.z\u0003T
\nk\u001ed\u0003D\u001es:{3]\u0019g!A'{<\/span><\/p>\n

\u00a0 \u00a0 \u00a0 \u00a0 Everyone interested in this topic is welcomed to join us. the following is the abstract for this week\u2019s paper <\/span><\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f0\u0010X,s
\nq7O\u0019Z\u0016?&j\u001fl<\/span><\/p>\n

\u00a0<\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f09P(\\
\nY\u0005W)|)v\u000fH<\/span><\/p>\n

\n
Towards Designing Better Session Search Evaluation Metrics<\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f06D\/@\u001ao3\\\u0012Q\u001cu<\/span><\/p>\n
Mengyang Liu, Yiqun Liu<\/span><\/span>\u2217<\/span>, Jiaxin Mao, Cheng Luo, Shaoping Ma<\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f0\u0007v2K3P\u0014u-o!L\u0014y i<\/span><\/p>\n
Abstract<\/span><\/span><\/p>\n
5U\u001bE2J2x0{\u000fx l0<\/span><\/p>\n
\u00a0 \u00a0 \u00a0 \u00a0 User satisfaction has been paid much attention to in recent Web search evaluation studies and regarded as the ground truth for designing better evaluation metrics. However, most existing studies are focused on the relationship between satisfaction and evaluation metrics at query-level. However, while search request becomes more and more complex, there are many scenarios in which multiple queries and multi-round search interactions are needed (e.g. exploratory search). In those cases, the relationship between session-level search satisfaction and session search evaluation metrics remain uninvestigated. In this paper, we analyze how users\u2019 perceptions of satisfaction accord with a series of session-level evaluation metrics. We conduct a laboratory study in which users are required to finish some complex search tasks and provide usefulness judgments of documents as well as session-level and query level satisfaction feedbacks. We test a number of popular session search evaluation metrics as well as different weighting functions. Experiment results show that query-level satisfaction is mainly decided by the clicked document that they think the most useful (maximum effect). While session-level satisfaction is highly correlated with the most recently issued queries (recency effect). We further propose a number of criteria for designing better session search evaluation metrics.<\/span><\/span><\/span>\u81ea\u7136\u8bed\u8a00\u5904\u7406\u4e0e\u4fe1\u606f\u68c0\u7d22\u5171\u4eab\u5e73\u53f0\u000ez\u0002S
\nR*_\u001al\u0006U {.k
\nj&_\u0011l<\/span><\/p>\n<\/div>\n
\u00a0<\/span><\/span><\/p>\n
\u001cWR\u0014x,R\u0005U$@0<\/span><\/p>\n
\u00a0<\/span><\/span><\/p>\n
\u001cT+u\u001ea*h1E6[&a\fA\u000bZ\bV0<\/span><\/p>\n
Towards Designing Better Session Search Evaluation Metrics.pdf<\/a>(1.8 MB)<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"
NLPIR\/ICTCLA2018 ACADEMIC SEMINAR 5th IS … \u7ee7\u7eed\u9605\u8bfb →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[38],"tags":[],"_links":{"self":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/1094"}],"collection":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/comments?post=1094"}],"version-history":[{"count":1,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/1094\/revisions"}],"predecessor-version":[{"id":1095,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/posts\/1094\/revisions\/1095"}],"wp:attachment":[{"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/media?parent=1094"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/categories?post=1094"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.nlpir.org\/wordpress\/wp-json\/wp\/v2\/tags?post=1094"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}