This is the first of four guest posts by the Editors of Analysis. The Editors' aims are to "give some guidance to prospective authors and to contribute to public debate about philosophy publishing."
It is hoped that the first three posts (beginning with this one) will generate some discussion. Then in the fourth and final post the Editors plan to respond to some of the comments received.
Please note that the Editors will not respond to comments in this thread. But please do weigh in and discuss below – the better the discussion, the more illuminating the final response post by the Editors is likely to be!
—–
What sort of referee reports does the profession need?
By Stacie Friend, David Liggins, and Lee Walters
Every professional philosopher is familiar with the problems that the philosophy journal publication system is facing. The system is simply overwhelmed with submissions, and this makes finding referees for them increasingly difficult. The situation is frustrating for everyone: for authors trying to get their papers accepted, for journal editors trying to make timely decisions, and for potential referees, who often find themselves bombarded with requests for reports.
Philosophers are nothing if not reflective, so there has been plenty of discussion about what to do about this situation. But here we would like to highlight one question that has hardly been touched on: what sort of referee reports does the profession need? We don’t have a solution to the crisis in philosophy journal publishing, but we do think that answering that question will do something to help.
Some referee reports that we see are clearly written with the main intention of helping the author. But we suggest that, in the current context, what journals most need are reports that are aimed at helping editors to make good decisions on papers in a reasonable time.
When we say this, what sorts of reports do we have in mind?
Reports that explicitly assess the quality and overall significance of the paper, and set out any suggested changes, are very helpful to editors. Less helpful are reports that consist of a string of comments on specific passages.
It’s widely agreed that many papers are longer than they need to be. Referees can help by offering ways of shortening over-long papers.
Another feature of good referee reports is frankness. Often referees do not say anything very negative in the main body of the report – but give a candid negative evaluation in part of the report that is not for the author to see. No doubt this often is from a laudable impulse to avoid discouraging authors. But we know, from the correspondence we have received from authors, that authors can be confused and disconcerted when they receive a sympathetic report on their paper along with news that the paper has been rejected. So we advise referees to include their overall evaluation in the main body of the report, if at all possible.
When we teach, we have all found ways of expressing negative evaluations gently; this skill is useful for us as referees too. One important piece of advice is to evaluate the paper, rather than its author (‘The paper does not take into account relevant work by X’ rather than ‘The author has clearly never heard of X’). We are pleased that the vast majority of reports we see already do this.
Sometimes referee reports begin with a summary of the paper. Unless the journal specifically asks for this, you can save yourself time by leaving it out. (That said, if the abstract is misleading then it’s useful to flag that up.)
Refereeing is part of professional philosophers’ professional role. But it’s rarely the case that a philosopher is clearly obliged to referee a particular paper – and even if there are such obligations, journals have no way of enforcing them. In that sense, referees are volunteers. As the editors of a journal, it is very difficult for us to tell referees to write briefer reports intended to help editors rather than longer reports intended to help authors. Perhaps writing more detailed reports is more satisfying than writing the other sort. We can see that it often embodies great kindness and patience. Even so, writing the other sort would help with the current crisis. We are not laying down the law about what colleagues should do – just discussing what sort of report would help most to alleviate the current crisis.
Perhaps you take on fewer refereeing jobs than you otherwise would because you write long commentaries on the papers you referee. Or perhaps your refereeing jobs take longer than they otherwise would because you are going into more detail than the editors need, rather than writing the shorter type of report we have in mind. Then you can help to alleviate the crisis in publishing by taking on more refereeing jobs and writing shorter reports for journals.
We do not claim that this would solve the crisis. But we think that it might give everyone a little more breathing space, and so make the situation a bit less awful.
(Thanks to an audience in Leeds for discussion of the ideas in this blog post.)
Leave a Reply