TY - JOUR
T1 - Extended Overview of ChEMU 2022 Evaluation Campaign
T2 - 2022 Conference and Labs of the Evaluation Forum, CLEF 2022
AU - Li, Yuan
AU - Fang, Biaoyan
AU - He, Jiayuan
AU - Yoshikawa, Hiyori
AU - Akhondi, Saber A.
AU - Druckenbrodt, Christian
AU - Thorne, Camilo
AU - Afzal, Zubair
AU - Zhai, Zenan
AU - Machi, Kojiro
AU - Yoshioka, Masaharu
AU - Jang, Youngrok
AU - Song, Hosung
AU - Lee, Junho
AU - Kim, Gyeonghun
AU - Kim, Yireun
AU - Choi, Stanley Jungkyu
AU - Lee, Honglak
AU - Bae, Kyunghoon
AU - Mahendran, Darshini
AU - Tang, Christina
AU - McInnes, Bridget
AU - Baldwin, Timothy
AU - Verspoor, Karin
N1 - Publisher Copyright:
© 2022 Copyright for this paper by its authors.
PY - 2022
Y1 - 2022
N2 - In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2022, part of the Conference and Labs of the Evaluation Forum 2022 (CLEF 2022). The ChEMU campaign focuses on information extraction tasks over chemical reactions in patents. The ChEMU 2020 lab provided two information extraction tasks, named entity recognition and event extraction. The ChEMU 2021 lab introduced one more task, anaphora resolution. This year, we re-run all the three tasks with new test data. Together, the tasks support comprehensive automatic chemical patent analysis. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the methods employed by participants of this lab and the results obtained across 22 runs from 3 teams, finding that several submissions achieve better results than the baseline methods prepared by the organizers.
AB - In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2022, part of the Conference and Labs of the Evaluation Forum 2022 (CLEF 2022). The ChEMU campaign focuses on information extraction tasks over chemical reactions in patents. The ChEMU 2020 lab provided two information extraction tasks, named entity recognition and event extraction. The ChEMU 2021 lab introduced one more task, anaphora resolution. This year, we re-run all the three tasks with new test data. Together, the tasks support comprehensive automatic chemical patent analysis. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the methods employed by participants of this lab and the results obtained across 22 runs from 3 teams, finding that several submissions achieve better results than the baseline methods prepared by the organizers.
KW - Chemical patents
KW - Information Extraction
KW - Text mining
UR - http://www.scopus.com/inward/record.url?scp=85136933378&partnerID=8YFLogxK
M3 - Artículo de la conferencia
AN - SCOPUS:85136933378
SN - 1613-0073
VL - 3180
SP - 758
EP - 781
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
Y2 - 5 September 2022 through 8 September 2022
ER -