Last Friday, I ran a thread asking readers what kinds of things bug them as journal referees. I've found the thread really informative so far, and hope readers continue to weigh in. In today's post, I'd like to run a thread on the other side of things: namely, things that authors feel like they've learned to be important in terms of getting positive reviews from referees. Of course, having a strong and interesting argument helps–but here I'm thinking of other things: specifically, ways of writing papers that tend to fare better in the review process than others. My own experience here is that this is a lot of what I had to learn early in my career to publish successfully, and I am curious whether other readers who have learned to publish successfully have had similar experiences.
So then: do you have any tips for writing papers in ways that are likely to go over well with referees? If so, what are they? Conversely, do you have any tips for things to avoid–things that don't go over well with referees? I'm really curious to see people's responses in the comments section. Allow me to kick things off with a few tips I think I've learned:
Tip 1 – 'For all x, if x is a possible way to misunderstand your argument–no matter how silly–make sure you take steps to prevent referees from interpreting you as saying or implying x': This may be the single most important publishing lesson I think I've learned. Early in my career, when I wasn't having much luck publishing, I was continually surprised at how easily referees can misunderstand a paper's argument–often, it seems, in the least charitable way possible. I also know that I'm not alone in this. I've heard more stories than I count count where people have recounted things like this: "I literally write in the paper, 'I am not saying X', and reviewer 2 recommended rejecting my paper on the grounds that I say X." How is this possible? The most plausible answer I can think of is that a good number of referees probably try to get their reviews done as quickly as possible, skimming them rather than reading closely or carefully. In any case, ever since learning this lesson, my papers have fared much better in the review process.
Tip 2 (corollary of tip 1) – Head off potential misinterpretations and objections as soon as possible in the body of the paper, rather than in footnotes or an objection section late in the paper: I've had cases of papers, and heard other people recount similar cases, where it doesn't seem like a reviewer even got to the end of the paper. A typical case: the reviewer raises an objection O to an argument on page 5, presenting it as grounds for rejecting the paper–despite the fact that you explicitly raise and respond to O later in the paper (e.g. page 25, in an 'Objections and Replies' section). This happened to me enough times that I learned that it's important not just to address potential misinterpretations and objections, but head them off before they can fester in the reviewer's head. In fact, one thing that I've often resorted to in recent papers–and seen other published papers do as well–is to briefly head off misunderstandings and objections in your introduction. Even if it is just saying something like, "The final section of this paper will address objection(s) X, Y, and Z", my experience is that this can be important for at least getting in your reviewer's mind that you plan to address the objections they will have when reading the paper. Otherwise, again, they may not even read far enough (or carefully enough) to see that you address their 'devastating' concern. Finally, my experience is that in general (though not always), it's best not to leave objections to a final 'Objections and Replies' section of the paper or merely address them in footnotes/endnotes (which reviewers may not read or read carefully). As a general rule, I've found it works best to address any potential misinterpretations or objections in the body-text of a paper as soon as a reader is likely to have them.
I'm probably forgetting a bunch of other tips at the moment. However, these are probably the two most important things I've learned for getting papers to go over better with referees. What are your tips? What have you learned works well/doesn't work well with referees?
Leave a Reply to historygrrrlCancel reply