Web of Science: 15 citations, Scopus: 19 citations, Google Scholar: citations,
Adherence to reporting guidelines increases the number of citations : the argument for including a methodologist in the editorial process and peer-review
Vilaró, Marta (Universitat Politècnica de Catalunya. BarcelonaTech)
Cortés, Jordi (Universitat Politècnica de Catalunya)
Selva O'Callaghan, Albert (Hospital Universitari Vall d'Hebron)
Urrutia, Agustín (Institut Germans Trias i Pujol. Hospital Universitari Germans Trias i Pujol)
Ribera, Jose-Maria (Institut Germans Trias i Pujol. Institut de Recerca contra la Leucèmia Josep Carreras)
Cardellach, Francesc (Hospital Clínic i Provincial de Barcelona)
Basagaña, X (Centro de Investigación Biomédica en Red de Epidemiología y Salud Pública)
Elmore, Matthew (Universitat Politècnica de Catalunya)
Vilardell, Miquel 1946- (Hospital Universitari Vall d'Hebron)
Altman, Douglas (University of Oxford, Botnar Research Centre. Centre for Statistics in Medicine)
González, José-Antonio (Universitat Politècnica de Catalunya)
Cobo, Erik (Medicina Clínica, Elsevier-Barcelona)
Universitat Autònoma de Barcelona

Date: 2019
Abstract: From 2005 to 2010, we conducted 2 randomized studies on a journal (Medicina Clínica), where we took manuscripts received for publication and randomly assigned them to either the standard editorial process or to additional processes. Both studies were based on the use of methodological reviewers and reporting guidelines (RG). Those interventions slightly improved the items reported on the Manuscript Quality Assessment Instrument (MQAI), which assesses the quality of the research report. However, masked evaluators were able to guess the allocated group in 62% (56/90) of the papers, thus presenting a risk of detection bias. In this post-hoc study, we analyse whether those interventions that were originally designed for improving the completeness of manuscript reporting may have had an effect on the number of citations, which is the measured outcome that we used. Masked to the intervention group, one of us used the Web of Science (WoS) to quantify the number of citations that the participating manuscripts received up December 2016. We calculated the mean citation ratio between intervention arms and then quantified the uncertainty of it by means of the Jackknife method, which avoids assumptions about the distribution shape. Our study included 191 articles (99 and 92, respectively) from the two previous studies, which all together received 1336 citations. In both studies, the groups subjected to additional processes showed higher averages, standard deviations and annual rates. The intervention effect was similar in both studies, with a combined estimate of a 43% (95% CI: 3 to 98%) increase in the number of citations. We interpret that those effects are driven mainly by introducing into the editorial process a senior methodologist to find missing RG items. Those results are promising, but not definitive due to the exploratory nature of the study and some important caveats such as: the limitations of using the number of citations as a measure of scientific impact; and the fact that our study is based on a single journal. We invite journals to perform their own studies to ascertain whether or not scientific repercussion is increased by adhering to reporting guidelines and further involving statisticians in the editorial process. The online version of this article (10. 1186/s12874-019-0746-4) contains supplementary material, which is available to authorized users.
Grants: Ministerio de Economía y Competitividad MTM2015-64465-C2-1-R
European Commission 676207
Agència de Gestió d'Ajuts Universitaris i de Recerca 2017SGR622
Rights: Aquest document està subjecte a una llicència d'ús Creative Commons. Es permet la reproducció total o parcial, la distribució, la comunicació pública de l'obra i la creació d'obres derivades, fins i tot amb finalitats comercials, sempre i quan es reconegui l'autoria de l'obra original. Creative Commons
Language: Anglès
Document: Article ; recerca ; Versió publicada
Subject: Reporting guidelines ; Peer-review ; Reproducibility ; Transparency ; Number of citations
Published in: BMC Medical Research Methodology, Vol. 19 (may 2019) , ISSN 1471-2288

DOI: 10.1186/s12874-019-0746-4
PMID: 31151417


7 p, 823.3 KB

The record appears in these collections:
Research literature > UAB research groups literature > Research Centres and Groups (research output) > Health sciences and biosciences > Institut d'Investigació en Ciencies de la Salut Germans Trias i Pujol (IGTP) > Josep Carreras Leukaemia Research Institute
Articles > Research articles
Articles > Published articles

 Record created 2020-07-06, last modified 2023-12-05



   Favorit i Compartir