Learning to Rank Research Articles: A case study of collaborative filtering and learning to rank in ScienceDirect

Daniel Kernshaw, Benjamin Pettit, Maya Hristakeva, Kris Jack

    Research output: Contribution to conferencePaperpeer-review


    Online academic repositories help millions of researchers discover relevant articles, a domain in which there are many potential signals of relevance, including text, citation links, and how recently an article was published. In this paper we present a case study of prodictionizing learning to rank for large scale recommendation, which utilises these diverse feature sets to increase user engagement. We first introduce item-to-item collaborative filtering (CF), then how these recommendations are rescored with a LtR model. We then describe offline and online evaluation, which are essential for productionizing any recommender. The online results show that learning to rank significantly increased user engagement with the recommender. Finally we show through post-hoc analysis that the original CF solution tended to promote older articles with lower traffic. However, by learning from subjective user interactions with the recommender system, our relevance model reversed those trends.

    Original languageAmerican English
    Number of pages14
    StatePublished - 2020
    EventEuropean Conference on Information Retrieval - Lisbon, Portugal
    Duration: Apr 14 2020Apr 17 2020


    ConferenceEuropean Conference on Information Retrieval
    Internet address


    Dive into the research topics of 'Learning to Rank Research Articles: A case study of collaborative filtering and learning to rank in ScienceDirect'. Together they form a unique fingerprint.

    Cite this