Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents

Yuan Li; Biaoyan Fang; Jiayuan He; Hiyori Yoshikawa; Saber Akhondi; Christian Drukenbrodt; Camilo Thorne; Zubair Afzal; Zenan Zhai; Timothy Baldwin; Karin  Verspoor

doi:10.1007/978-3-030-85251-1_20

Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents

Yuan Li, Biaoyan Fang, Jiayuan He, Hiyori Yoshikawa, Saber Akhondi, Christian Drukenbrodt, Camilo Thorne, Zubair Afzal, Zenan Zhai, Timothy Baldwin, Karin Verspoor

Research output: Contribution to journal › Article › peer-review

Abstract

In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2021, part of the Conference and Labs of the Evaluation Forum 2021 (CLEF 2021). The ChEMU evaluation lab focuses on information extraction over chemical reactions from patent texts. As the second instance of our ChEMU lab series, we build upon the ChEMU corpus developed for ChEMU 2020, extending it for two distinct tasks related to reference resolution in chemical patents. Task 1—Chemical Reaction Reference Resolution—focuses on paragraph-level references and aims to identify the chemical reactions or general conditions specified in one reaction description referred to by another. Task 2—Anaphora Resolution—focuses on expression-level references and aims to identify the reference relationships between expressions in chemical reaction descriptions. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the results obtained in this lab, finding that one submission achieves substantially better results than our baseline models.

Original language	American English
Pages (from-to)	292-307
Number of pages	16
Journal	International Conference of the Cross-Language Evaluation Forum for European Languages
DOIs	https://doi.org/10.1007/978-3-030-85251-1_20
State	Published - 2021

Keywords

Anaphora resolution
Chemical patents
Information extraction
Reaction reference resolution
Text mining

Access to Document

10.1007/978-3-030-85251-1_20License: Unspecified

Cite this

Li, Y., Fang, B., He, J., Yoshikawa, H., Akhondi, S., Drukenbrodt, C., Thorne, C., Afzal, Z., Zhai, Z., Baldwin, T., & Verspoor, K. (2021). Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents. International Conference of the Cross-Language Evaluation Forum for European Languages, 292-307. https://doi.org/10.1007/978-3-030-85251-1_20

@article{b27d8bfa121349f3b4b41f79ac7e1008,

title = "Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents",

abstract = "In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2021, part of the Conference and Labs of the Evaluation Forum 2021 (CLEF 2021). The ChEMU evaluation lab focuses on information extraction over chemical reactions from patent texts. As the second instance of our ChEMU lab series, we build upon the ChEMU corpus developed for ChEMU 2020, extending it for two distinct tasks related to reference resolution in chemical patents. Task 1—Chemical Reaction Reference Resolution—focuses on paragraph-level references and aims to identify the chemical reactions or general conditions specified in one reaction description referred to by another. Task 2—Anaphora Resolution—focuses on expression-level references and aims to identify the reference relationships between expressions in chemical reaction descriptions. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the results obtained in this lab, finding that one submission achieves substantially better results than our baseline models.",

keywords = "Anaphora resolution, Chemical patents, Information extraction, Reaction reference resolution, Text mining",

author = "Yuan Li and Biaoyan Fang and Jiayuan He and Hiyori Yoshikawa and Saber Akhondi and Christian Drukenbrodt and Camilo Thorne and Zubair Afzal and Zenan Zhai and Timothy Baldwin and Karin Verspoor",

note = "Funding Information: Acknowledgements. Funding for the ChEMU project is provided by an Australian Research Council Linkage Project, project number LP160101469, and Elsevier. We acknowledge the support of our ChEMU-Ref annotators, Dr. Sacha Novakovic and Colleen Hui Shiuan Yeow at the University of Melbourne, and the annotation teams supporting the reaction reference task annotation. Funding Information: for the ChEMU project is provided by an Australian Research Council Linkage Project, project number LP160101469, and Elsevier. We acknowledge the support of our ChEMU-Ref annotators, Dr. Sacha Novakovic and Colleen Hui Shiuan Yeow at the University of Melbourne, and the annotation teams supporting the reaction reference task annotation. Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.",

year = "2021",

doi = "10.1007/978-3-030-85251-1_20",

language = "American English",

pages = "292--307",

journal = "International Conference of the Cross-Language Evaluation Forum for European Languages",

}

Li, Y, Fang, B, He, J, Yoshikawa, H, Akhondi, S , Drukenbrodt, C , Thorne, C, Afzal, Z, Zhai, Z, Baldwin, T & Verspoor, K 2021, 'Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents', International Conference of the Cross-Language Evaluation Forum for European Languages, pp. 292-307. https://doi.org/10.1007/978-3-030-85251-1_20

TY - JOUR

T1 - Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents

AU - Li, Yuan

AU - Fang, Biaoyan

AU - He, Jiayuan

AU - Yoshikawa, Hiyori

AU - Akhondi, Saber

AU - Drukenbrodt, Christian

AU - Thorne, Camilo

AU - Afzal, Zubair

AU - Zhai, Zenan

AU - Baldwin, Timothy

AU - Verspoor, Karin

N1 - Funding Information: Acknowledgements. Funding for the ChEMU project is provided by an Australian Research Council Linkage Project, project number LP160101469, and Elsevier. We acknowledge the support of our ChEMU-Ref annotators, Dr. Sacha Novakovic and Colleen Hui Shiuan Yeow at the University of Melbourne, and the annotation teams supporting the reaction reference task annotation. Funding Information: for the ChEMU project is provided by an Australian Research Council Linkage Project, project number LP160101469, and Elsevier. We acknowledge the support of our ChEMU-Ref annotators, Dr. Sacha Novakovic and Colleen Hui Shiuan Yeow at the University of Melbourne, and the annotation teams supporting the reaction reference task annotation. Publisher Copyright: © 2021, Springer Nature Switzerland AG.

PY - 2021

Y1 - 2021

N2 - In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2021, part of the Conference and Labs of the Evaluation Forum 2021 (CLEF 2021). The ChEMU evaluation lab focuses on information extraction over chemical reactions from patent texts. As the second instance of our ChEMU lab series, we build upon the ChEMU corpus developed for ChEMU 2020, extending it for two distinct tasks related to reference resolution in chemical patents. Task 1—Chemical Reaction Reference Resolution—focuses on paragraph-level references and aims to identify the chemical reactions or general conditions specified in one reaction description referred to by another. Task 2—Anaphora Resolution—focuses on expression-level references and aims to identify the reference relationships between expressions in chemical reaction descriptions. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the results obtained in this lab, finding that one submission achieves substantially better results than our baseline models.

AB - In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2021, part of the Conference and Labs of the Evaluation Forum 2021 (CLEF 2021). The ChEMU evaluation lab focuses on information extraction over chemical reactions from patent texts. As the second instance of our ChEMU lab series, we build upon the ChEMU corpus developed for ChEMU 2020, extending it for two distinct tasks related to reference resolution in chemical patents. Task 1—Chemical Reaction Reference Resolution—focuses on paragraph-level references and aims to identify the chemical reactions or general conditions specified in one reaction description referred to by another. Task 2—Anaphora Resolution—focuses on expression-level references and aims to identify the reference relationships between expressions in chemical reaction descriptions. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the results obtained in this lab, finding that one submission achieves substantially better results than our baseline models.

KW - Anaphora resolution

KW - Chemical patents

KW - Information extraction

KW - Reaction reference resolution

KW - Text mining

UR - http://www.scopus.com/inward/record.url?scp=85115843127&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-85251-1_20

DO - 10.1007/978-3-030-85251-1_20

M3 - Article

SP - 292

EP - 307

JO - International Conference of the Cross-Language Evaluation Forum for European Languages

JF - International Conference of the Cross-Language Evaluation Forum for European Languages

ER -

Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Information Extraction for Chemical Reactions with University of Melbourne

Cite this

Overview of ChEMU 2021: Reaction Reference Resolution and Anaphora Resolution in Chemical Patents

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Projects

Information Extraction for Chemical Reactions with University of Melbourne

Cite this