BMJ papers audit

BMJ papers audit


Prepared by Sara Schroter, Senior Researcher, BMJ 

The BMJ receives over 3,000 research paper submissions each year (Table 1) but only accepts a very small proportion.  It is the BMJ’s vision to be the world's most influential and widely read medical journal and we also aim to publish material that will help doctors to make better decisions.  It is difficult to measure the influence of a medical journal but we feel that there has been too much emphasis on the number of citations that papers generate and journal impact factors.  We want our research papers to be scientifically valid, highly visible, widely read, clinically relevant and of interest to international readers as well as being frequently cited.  As such, we now track a series of indicators for our published research papers.  By collecting and reporting data routinely we can: 

i)                     evaluate the effects of changes in our editorial policies e.g. we can assess whether we are attracting papers that are well read and clinically relevant;

ii)                   become better informed about the type of research we publish e.g. are we publishing more international research and is it reflective of the areas we want to attract, etc?;

iii)                  show prospective authors average citation and download figures to encourage submissions

iv)                  identify our “best” papers – what are the characteristics of papers that are most widely read, cited, and picked up in secondary sources, etc; and 

v)                    routinely assess our turnaround times for published research papers enabling us to identify any bottlenecks, etc. 

Table 2 presents data for all BMJ research papers published between 2004 and 2008 (excluding the Christmas issues).  It includes the following indicators: 

  • Total number of accesses on bmj.com (including Online Firsts, abstracts, full text, PDF)
              o        In month of publication plus one month
              o        In first 12 months after publication
  • Page impressions in first week of publication (full text + PDF)
  • Pickups in secondary sources
              o        BMJ Updates
              o        Journal Watch (General Medicine)
              o        ACP Journal Club
              o        Evidence Based Medicine Journal
              o        Evidence Based Nursing Journal
              o        Evidence Based Mental Health Journal
              o        Faculty 1000 Medicine
  • Rapid responses in first 12 months after publication (we acknowledge that not all rapid responses are positive but regard this measure as an indicator of visibility.  We have excluded authors’ responses from the counts).
  • Number of aggregate citations
              o        In year of publication plus one calendar year
              o        In year of publication plus two calendar years
              o        In year of publication plus three calendar years 

Table 2 also includes the proportion of international research and various study designs, and average turnaround times:

  • Proportion of international research (based on address of corresponding author)
  • Proportion of papers reporting randomised controlled trials
  • Proportion of papers reporting systematic reviews and meta analysis
  • Turnaround times
             o        Interval in days between acceptance to online publication
             o        Interval in days between acceptance and print publication 

Table 1: BMJ Research paper submissions and acceptance rates 2003 to 2007

Year

Total number of submissions

Number (%) accepted papers

2003

3477

203 (5.8)

2004

3738

163 (4.4)

2005

4052

173 (4.3)

2006

3400

85 (2.5)

2007

3214

120 (3.7)

 



BMJ in the Media