Meta-Research: Large-scale language analysis of peer review reports

Bahar Mehmani, Ivan Buljan, Daniel Garcia-Costa, Francisco Grimaldo, Flaminio Squazzinioni, Ana Marusic

Research output: Contribution to journalArticlepeer-review

Abstract

Peer review is often criticized for being flawed, subjective and biased, but research into peer review has been hindered by a lack of access to peer review reports. Here we report the results of a study in which text-analysis software was used to determine the linguistic characteristics of 472,449 peer review reports. A range of characteristics (including analytical tone, authenticity, clout, three measures of sentiment, and morality) were studied as a function of reviewer recommendation, area of research, type of peer review and reviewer gender. We found that reviewer recommendation had the biggest impact on the linguistic characteristics of reports, and that area of research, type of peer review and reviewer gender had little or no impact. The lack of influence of research area, type of review or reviewer gender on the linguistic characteristics is a sign of the robustness of peer review.
Original languageAmerican English
JournaleLife
DOIs
StatePublished - 2020

Fingerprint Dive into the research topics of 'Meta-Research: Large-scale language analysis of peer review reports'. Together they form a unique fingerprint.

Cite this