Diane Harley, Sophia Krzys Acord, Sarah Earl-Novell, Shannon Lawrence, C. Judson King
Copyright: Center for Studies in Higher Education, UC Berkley
Since 2005, the Center for Studies in Higher Education (CSHE), has been conducting research to understand the needs and practices of faculty for in-progress scholarly communication (i.e., forms of communication employed as research is being executed) as well as archival publication. This report brings together the responses of 160 interviewees across 45, mostly elite, research institutions in seven selected academic fields: archaeology, astrophysics, biology, economics, history, music, and political science. The overview document summarizes the main practices explored across all seven disciplines: tenure and promotion, dissemination, sharing, collaboration, resource creation and consumption, and public engagement. In this report, readers can search various topics within and across case studies. The report identifies five key topics, addressed in detail in the case studies, that require real attention:
Council of Science Editors
Peer review is the principal mechanism by which the quality of research is judged. Most funding decisions in science and the academic advancement of scientists are based on peer-reviewed publications. Because the number of scientific articles published each year continues to grow, the quality of the peer-review process and the quality of the editorial board are cited as primary influences on a journal’s reputation, impact factor, and standing in the field. Scientific journals publishing peer-reviewed articles depend heavily on the scientific referees or reviewers who typically volunteer their time and expertise. In most circumstances, at least 2 reviewers are solicited to evaluate a manuscript; some journals request 3 reviews. This may be required in situations where review by a statistician is needed. In cases of controversy or strong disagreement regarding the merits of the work, an additional review may also be solicited or one of the journal’s editors might give an evaluation. More than 3 reviewers are sometimes used if reviewers from several fields are needed to obtain a thorough evaluation of a paper. In addition to fairness in judgment and expertise in the field, peer reviewers have significant responsibilities toward authors, editors, and readers.
British Academy
Peer review is the practice by which the worth of research is evaluated by those with demonstrated competence to make a judgment. It is the traditional means by which research quality is guaranteed in academic studies. The British Academy was concerned that the role peer review plays in underpinning the success of the UK research enterprise in the humanities and social sciences needed to be better understood by policy-makers.
Bev Acreman, Peter Berkery, Caroline Black, Chis Bourg, Becky Brasington Clark, Angela Cochran, Kevin Davies, Rachel Dresbeck, Catriona MacCallum, Paul Peters, Bobby Schnabel, Francisco Valdés Ugalde
The Open Scholarship Initiative 2016 (OSI2016) Peer Review workgroup focused on peer review in the context of open scholarship. The group agreed that greater openness and transparency would improve accountability, minimize bias, and encourage collaboration, but did not underestimate the challenges of openness, nor the variation in readiness across disciplines and publishing models. The group recommended facilitation of peer review outside the traditional publication process—for example, in the context of preprint servers and after publication—with incentives for broad participation. These incentives need to include a cultural shift in recognition of peer review as a valid activity contributing to career progression.
Diane Harley, Sophia Krzys Acord with contributions from Sarah Earl-Novell, Shannon Lawrence, and Elise Herrala
Copyright: Center for Studies in Higher Education, UC Berkley
A project report and associated recommendations, proceedings from a meeting and background papers.
House of Commons Science and Technology Committee
Peer review in scholarly publishing, in one form or another, has always been regarded as crucial to the reputation and reliability of scientific research. In recent years there have been an increasing number of reports and articles assessing the current state of peer review. In view of the importance of evidence-based scientific information to government, this report covers a detailed examination of the current peer-review system as used in scientific publications. Both to see whether it is operating effectively and to shine light on new and innovative approaches. In addition. it explores some of the broader issues around research impact, publication ethics and research integrity.
http://www.publications.parliament.uk/pa/cm201012/cmselect/cmsctech/856/856.pdf
PRE (Peer Review Evaluation)
Several market research studies have evaluated peer review in recent years. A goal of the present research, commissioned by PRE, is to extend those findings to provide insight into the indicators of quality of peer review. In January, 2016 Wicherts proposed that transparency of the peer review process may be seen as an indicator of the quality of peer review. By testing a questionnaire tool with several audiences with different methods, he concludes that the tool has promising reliability and validity in assessing transparency of the peer-review process as an indicator of peer-review quality. In this market research, we ask respondents to rate the helpfulness of several criteria based in part on Wicherts’ 14-item tool which rates the transparency of a journal’s peer review process, regardless of peer review model, open or blinded, pre-publication or post-publication.
http://www.pre-val.org/wp-content/uploads/2016/09/PRE-surveywhitepaper.pdf
Adam Smith (This report has been produced within a contract with the European Commission.)
The European Commission joined many other research funders in 2013 when it announced that one central requirement of future research grantees of Horizon 2020 would be that their research publications be made freely available to all. The Commission’s vision is open access for research outputs, as announced in its 2012 Communication. This states: “Information already paid for by the public purse should not be paid for again each time it is accessed or used, and […] should benefit European companies and citizens to the full.”
The Commission has no preferred model for how to achieve open access. It is searching for innovation wherever it may be found, from traditional commercial publishers, new organisations, distributed academic networks, and research libraries. The goal of achieving open access is a public one that sits above private interests. This sometimes means that businesses are obliged to evolve and adapt in light of the project to move towards open access.
The move to open access scholarly publishing has been accelerating for many years. It is driven by many factors, including: the emergence and expansion of the internet, which enables the fast and free dissemination of research outputs; the fact that many academic libraries are reporting the rising cost of subscription journals and the declining number of journals they can subscribe to; a moral case that publicly funded research should be freely available for all to see; and a case that more dissemination of knowledge will lead to more innovation and therefore economic growth.
https://ec.europa.eu/futurium/en/system/files/ged/oa_report.pdf
the Research Information Network
This guide has been produced by The Research Information Network to provide researchers with an understanding of the peer review process and some of the current issues surrounding the debate about peer review.
http://rin.ac.uk/system/files/attachments/Peer-review-guide-screen.pdf
The Royal Society
The Science as an open enterprise report highlights the need to grapple with the huge deluge of data created by modern technologies in order to preserve the principle of openness and to exploit data in ways that have the potential to create a second open science revolution.
Exploring massive amounts of data using modern digital technologies has enormous potential for science and its application in public policy and business. The report maps out the changes that are required by scientists, their institutions and those that fund and support science if this potential is to be realised.
https://royalsociety.org/topics-policy/projects/science-public-enterprise/report/
