Changes in scholarly publishing have resulted in a move toward openness. To this end, new, open models of peer review are emerging. While the scholarly literature has examined and discussed open peer review, no established definition of it exists, nor are there uniform implementations of open peer review processes. This article examines the literature discussing open peer review, identifies common open peer review definitions, and describes eight common characteristics of open peer review: signed review, disclosed review, editor-mediated review, transparent review, crowdsourced review, prepublication review, synchronous review, and post-publication review. This article further discusses benefits and challenges to the scholarly publishing community posed by open peer review, and concludes that open peer review can and should exist within the current scholarly publishing paradigm.
Several market research studies have evaluated peer review in recent years. A goal of the present research, commissioned by PRE, is to extend those findings to provide insight into the indicators of quality of peer review. In January, 2016 Wicherts proposed that transparency of the peer review process may be seen as an indicator of the quality of peer review. By testing a questionnaire tool with several audiences with different methods, he concludes that the tool has promising reliability and validity in assessing transparency of the peer-review process as an indicator of peer-review quality. In this market research, we ask respondents to rate the helpfulness of several criteria based in part on Wicherts’ 14-item tool which rates the transparency of a journal’s peer review process, regardless of peer review model, open or blinded, pre-publication or post-publication.
Council of Science Editors
Peer review is the principal mechanism by which the quality of research is judged. Most funding decisions in science and the academic advancement of scientists are based on peer-reviewed publications. Because the number of scientific articles published each year continues to grow, the quality of the peer-review process and the quality of the editorial board are cited as primary influences on a journal’s reputation, impact factor, and standing in the field. Scientific journals publishing peer-reviewed articles depend heavily on the scientific referees or reviewers who typically volunteer their time and expertise. In most circumstances, at least 2 reviewers are solicited to evaluate a manuscript; some journals request 3 reviews. This may be required in situations where review by a statistician is needed. In cases of controversy or strong disagreement regarding the merits of the work, an additional review may also be solicited or one of the journal’s editors might give an evaluation. More than 3 reviewers are sometimes used if reviewers from several fields are needed to obtain a thorough evaluation of a paper. In addition to fairness in judgment and expertise in the field, peer reviewers have significant responsibilities toward authors, editors, and readers.
Diane Harley, Sophia Krzys Acord, Sarah Earl-Novell, Shannon Lawrence, C. Judson King
Copyright: Center for Studies in Higher Education, UC Berkley
Since 2005, the Center for Studies in Higher Education (CSHE), has been conducting research to understand the needs and practices of faculty for in-progress scholarly communication (i.e., forms of communication employed as research is being executed) as well as archival publication. This report brings together the responses of 160 interviewees across 45, mostly elite, research institutions in seven selected academic fields: archaeology, astrophysics, biology, economics, history, music, and political science. The overview document summarizes the main practices explored across all seven disciplines: tenure and promotion, dissemination, sharing, collaboration, resource creation and consumption, and public engagement. In this report, readers can search various topics within and across case studies. The report identifies five key topics, addressed in detail in the case studies, that require real attention:
Peer review is the practice by which the worth of research is evaluated by those with demonstrated competence to make a judgment. It is the traditional means by which research quality is guaranteed in academic studies. The British Academy was concerned that the role peer review plays in underpinning the success of the UK research enterprise in the humanities and social sciences needed to be better understood by policy-makers.
Page 1 of 2