6533b82ffe1ef96bd12948ab

RESEARCH PRODUCT

Attitudes of referees in a multidisciplinary journal: An empirical analysis

Francisco GrimaldoNiccolò CasniciNigel GilbertFlaminio Squazzoni

subject

Medical educationInformation Systems and ManagementbiasrefereesComputer Networks and CommunicationsPeer reviewrefereesbiasconsensusJASSS05 social sciencesLibrary and Information Sciences050905 science studiesJASSSPeer reviewTask (project management)Multidisciplinary approachconsensus0509 other social sciences050904 information & library sciencesPsychologySet (psychology)DisciplineInformation SystemsSocial simulation

description

This paper looks at 10 years of reviews in a multidisciplinary journal, The Journal of Artificial Societies and Social Simulation (JASSS), which is the flagship journal of social simulation. We measured referee behavior and referees' agreement. We found that the disciplinary background and the academic status of the referee have an influence on the report time, the type of recommendation and the acceptance of the reviewing task. Referees from the humanities tend to be more generous in their recommendations than other referees, especially economists and environmental scientists. Second, we found that senior researchers are harsher in their judgments than junior researchers, and the latter accept requests to review more often and are faster in reporting. Finally, we found that articles that had been refereed and recommended for publication by a multidisciplinary set of referees were subsequently more likely to receive citations than those that had been reviewed by referees from the same discipline. Our results show that common standards of evaluation can be established even in multidisciplinary communities.

10.1002/asi.23665http://hdl.handle.net/11379/485156