We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Peer Review in a General Medical Research Journal Before and During the COVID-19 Pandemic.
- Authors
Perlis, Roy H.; Kendall-Taylor, Jacob; Hart, Kamber; Ganguli, Ishani; Berlin, Jesse A.; Bradley, Steven M.; Haneuse, Sebastien; Inouye, Sharon K.; Jacobs, Elizabeth A.; Morris, Arden; Ogedegbe, Olugbenga; Perencevich, Eli; Shulman, Lawrence N.; Trueger, N. Seth; Fihn, Stephan D.; Rivara, Frederick P.; Flanagin, Annette
- Abstract
Key Points: Question: How did peer review change from before to during the first year of the COVID-19 pandemic at a large open-access general medical journal? Findings: In this cohort study of 5013 manuscripts reviewed and peer reviews invited by an open-access general medical journal, peer review turnaround time was slightly shorter and editor-reported review quality was modestly increased during the first year of the pandemic. Meaning: This study found that peer review at a large, open-access general medical journal remained resilient during the first 15 months of the pandemic despite shifts in in the dynamics of the review process. This cohort study quantifies changes in rates of peer reviewer acceptance of invitations to review manuscripts and review quality at an open-access general medical journal before and during the COVID-19 pandemic. Importance: Although peer review is an important component of publication for new research, the viability of this process has been questioned, particularly with the added stressors of the COVID-19 pandemic. Objective: To characterize rates of peer reviewer acceptance of invitations to review manuscripts, reviewer turnaround times, and editor-assessed quality of reviews before and after the start of the COVID-19 pandemic at a large, open-access general medical journal. Design, Setting, and Participants: This retrospective, pre-post cohort study examined all research manuscripts submitted to JAMA Network Open between January 1, 2019, and June 29, 2021, either directly or via transfer from other JAMA Network journals, for which at least 1 peer review of manuscript content was solicited. Measures were compared between the period before the World Health Organization declaration of a COVID-19 pandemic on March 11, 2020 (14.3 months), and the period during the pandemic (15.6 months) among all reviewed manuscripts and between pandemic-period manuscripts that did or did not address COVID-19. Main Outcomes and Measures: For each reviewed manuscript, the number of invitations sent to reviewers, proportions of reviewers accepting invitations, time in days to return reviews, and editor-assessed quality ratings of reviews were determined. Results: In total, the journal sought review for 5013 manuscripts, including 4295 Original Investigations (85.7%) and 718 Research Letters (14.3%); 1860 manuscripts were submitted during the prepandemic period and 3153 during the pandemic period. Comparing the prepandemic with the pandemic period, the mean (SD) number of reviews rated as high quality (very good or excellent) per manuscript increased slightly from 1.3 (0.7) to 1.5 (0.7) (P <.001), and the mean (SD) time for reviewers to return reviews was modestly shorter (from 15.8 [7.6] days to 14.4 [7.0] days; P <.001), a difference that persisted in linear regression models accounting for manuscript type, study design, and whether the manuscript addressed COVID-19. Conclusions and Relevance: In this cohort study, the speed and editor-reported quality of peer reviews in an open-access general medical journal improved modestly during the initial year of the pandemic. Additional study will be necessary to understand how the pandemic has affected reviewer burden and fatigue.
- Subjects
PROFESSIONAL peer review; MANUSCRIPTS; CONFIDENCE intervals; RETROSPECTIVE studies; REGRESSION analysis; PRE-tests &; post-tests; DESCRIPTIVE statistics; DATA analysis software; COVID-19 pandemic; MEDICAL research; LONGITUDINAL method
- Publication
JAMA Network Open, 2023, Vol 6, Issue 1, pe2253296
- ISSN
2574-3805
- Publication type
Article
- DOI
10.1001/jamanetworkopen.2022.53296