0000000001031970
AUTHOR
Bahar Mehmani
Unlock ways to share data on peer review
Peer review is the defining feature of scholarly communication. In a 2018 survey of more than 11, 000 researchers, 98% said that they considered peer review important or extremely important for ensuring the quality and integrity of scholarly communication.
Measuring the Developmental Function of Peer Review: A Multi-Dimensional, Cross-Disciplinary Analysis of Peer Review Reports from 740 Academic Journals
Reviewers do not only help editors to screen manuscripts for publication in academic journals; they also serve to increase the rigor and value of manuscripts by constructive feedback. However, measuring this developmental function of peer review is difficult as it requires fine-grained data on reports and journals without any optimal benchmark. To fill this gap, we adapted a recently proposed quality assessment tool and tested it on a sample of 1.3 million reports submitted to 740 Elsevier journals in 2018–2020. Results showed that the developmental standards of peer review are shared across areas of research, yet with remarkable differences. Reports submitted to social science and economic…
The effect of publishing peer review reports on referee behavior in five scholarly journals
To increase transparency in science, some scholarly journals are publishing peer review reports. But it is unclear how this practice affects the peer review process. Here, we examine the effect of publishing peer review reports on referee behavior in five scholarly journals involved in a pilot study at Elsevier. By considering 9,220 submissions and 18,525 reviews from 2010 to 2017, we measured changes both before and during the pilot and found that publishing reports did not significantly compromise referees’ willingness to review, recommendations, or turn-around times. Younger and non-academic scholars were more willing to accept to review and provided more positive and objective recommend…
No Tickets for Women in the COVID-19 Race? A Study on Manuscript Submissions and Reviews in 2347 Elsevier Journals during the Pandemic
During the early months of the COVID-19 pandemic, the submission rate to scholarly journals increased abnormally. Given that most academics were forced to work from home, the competing demands for familial duties might have penalised the scientific productivity of women. To test this hypothesis, we looked at submitted manuscripts and peer review activities for all Elsevier journals between February and May 2018-2020, including data on over 5 million authors and referees. Results showed that during the first wave of the pandemic, women submitted proportionally fewer manuscripts than men. This deficit was especially pronounced among younger cohorts of women academics. The rate of the peer-rev…