TY - JOUR
T1 - Extended overview of ChEMU 2021
T2 - 2021 Working Notes of CLEF - Conference and Labs of the Evaluation Forum, CLEF-WN 2021
AU - Li, Yuan
AU - Fang, Biaoyan
AU - He, Jiayuan
AU - Yoshikawa, Hiyori
AU - Akhondi, Saber A.
AU - Druckenbrodt, Christian
AU - Thorne, Camilo
AU - Afzal, Zubair
AU - Zhai, Zenan
AU - Baldwin, Timothy
AU - Verspoor, Karin
N1 - Publisher Copyright:
© 2021 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
PY - 2021
Y1 - 2021
N2 - In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2021, part of the Conference and Labs of the Evaluation Forum 2021 (CLEF 2021). The ChEMU evaluation lab focuses on information extraction over chemical reactions from patent texts. As the second instance of our ChEMU lab series, we build upon the ChEMU corpus developed for ChEMU 2020, extending it for two distinct tasks related to reference resolution in chemical patents. Task 1 - Chemical Reaction Reference Resolution - focuses on paragraph-level references and aims to identify the chemical reactions or general conditions specified in one reaction description referred to by another. Task 2 - Anaphora Resolution - focuses on expression-level references and aims to identify the reference relationships between expressions in chemical reaction descriptions. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the results obtained in this lab, finding that one submission achieves substantially better results than our baseline models.
AB - In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2021, part of the Conference and Labs of the Evaluation Forum 2021 (CLEF 2021). The ChEMU evaluation lab focuses on information extraction over chemical reactions from patent texts. As the second instance of our ChEMU lab series, we build upon the ChEMU corpus developed for ChEMU 2020, extending it for two distinct tasks related to reference resolution in chemical patents. Task 1 - Chemical Reaction Reference Resolution - focuses on paragraph-level references and aims to identify the chemical reactions or general conditions specified in one reaction description referred to by another. Task 2 - Anaphora Resolution - focuses on expression-level references and aims to identify the reference relationships between expressions in chemical reaction descriptions. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the results obtained in this lab, finding that one submission achieves substantially better results than our baseline models.
KW - Anaphora resolution
KW - Chemical patents
KW - Information extraction
KW - Reaction reference resolution
KW - Text mining
UR - http://www.scopus.com/inward/record.url?scp=85113428208&partnerID=8YFLogxK
M3 - Artículo de la conferencia
AN - SCOPUS:85113428208
SN - 1613-0073
VL - 2936
SP - 693
EP - 709
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
Y2 - 21 September 2021 through 24 September 2021
ER -