This year, I have reviewed 12 papers (and more if you include revise and resubmits) for various journals. As I was reflecting on my work as a reviewer (for my end-of-year report of teaching, service, and research), I saw this interesting question on Twitter. Gui Sanches de Oliveira asked: 

Is it always bad to ID oneself as reviewer? I like the paper! BUT it overlooks discussion about X that's crucial for their argument on Y. I dealt with X in detail, so I'll bring up my paper, but it's hard to pretend I didn't write it. What can go wrong if I'm open about who I am?

Is it OK to reveal one's identity to an author as a reviewer to their paper?

I am inclined to say "no," especially if one does not habitually sign one's name to papers, but I think no in most cases. 

I don't deny there aren't goods to be obtained from more transparency in review. Reviewing is something of a collaborative venture, with often significant input from reviewers in the final product, and knowing identities mutually could further help to build fruitful collaborations. Moreover, it can be heartening to hear someone say they liked your paper if one is early-career. I recall as a grad student when I had my first paper accepted to a journal (this was not a philosophy paper, but a theoretical cognitive science paper), I was at a conference about a year after, and one of the founding people in evolutionary psychology told me they had reviewed my paper and really liked it. It felt so wonderful to hear this endorsement of my work at this stage. 

But I think on the whole the negatives outweigh the positives. In the case of the question on Twitter, I think it's perfectly fine to write "Discussion of topic X by Author Y (date) is crucial for this part of the argument" without specifying that you are Author Y. In fact, I often recommend that authors look into papers by other people and in some cases one might think the reviewer was one of those people. One cannot just assume that if a reviewer recommends to look into the literature to a specific paper, that that paper is written by the person who authored the referee report. 

My biggest problem with outing oneself as the author of a referee report is power relations.  Journal publications are high-stakes zero-sum games particularly for early-career people for whom it can make the difference to get a tenure track job, a postdoc, or tenure. In some cases, there is a large disparity in seniority between the author and reviewer. The author might be a grad student, the reviewer a tenured professor, or vice versa. In both of those situations knowing identities (mutually or one-way) creates peculiar dynamics that I don't think help to make the review process better. A more senior author might feel resentful about some suggestions for changes made by someone with less experience. Or a more junior author might feel more deferential, less willing to push back against some suggestions, if it turns out the reviewer is someone really eminent or someone she admires. I'm not saying these sorts of dynamics are common or exhaustive, they are just examples where I think the veil of mutual ignorance is really better for both parties. 

A second worry I have is that signing one's name to a review report makes it hard to be honest. As a reviewer, I try my best to be respectful and constructive. I do not think it is my job to be a quiet co-author, so my reports tend to be brief and tend to focus on what I think the biggest issues are. Obviously, authors won't always agree with my judgments (particularly if the Editor's final verdict is rejection), but they might be unhappy or begrudge those well-meaning criticisms. Sometimes, a paper is really terrible and I think a reviewer's comments should convey that the reviewer thought the paper was weak (without being snarky or horrible) and specifying why it is weak.  I am just not sure if I could be that forthright if I signed my name to reviews. I know some people have no problem doing this, but if signing one's name to referee reports became the norm then people who would not like to risk grudges and ires would simply stop reviewing. 

Suppose I would only sign my name to positive referee reports. Would that be better? I don't think so. Revealing one's identity  can create an undesirable sense of indebtedness. Suppose, for instance, I see a really wonderful paper appear in print that I remember reviewing earlier and I write to the author "I loved your paper! I was the reviewer who recommended accept". What motivation could one have for writing this and not just "I read your paper on XX that just came out in Journal Y and I really loved it" when it appears in print? Recommending Accept or Minor/Major Revisions (or even Reject but with useful feedback) is helpful for the author, but one does not do the author a favor by recommending Accept! One only does the author a favor insofar as reviewing is an act of altruism. Reviewing is an altruistic endeavor (that for-profit journals take advantage of) that we engage in to make sure that journal publishing as an institution can survive. We do our fair part in the process, trying to be fair, impartial, and dispassionate, judging papers on merit and how much they would be of interest to readers in the relevant subject area. That institution requires the veil of anonymity to work well (I am still very enthusiastic about anonymous reviewing, though this is a separate issue from the topic at hand here). Any sort of attempt to build connection with the author of a paper you reviewed by letting them know you're the author does not benefit that institution.

I am all for more collaboration, more interaction, more engagement. But there are better ways of doing this than to out oneself as a reviewer. I think it's great, for instance, to contact people about their work and to engage in conversation about it but it doesn't need to be at the review stage. We can do this connection building earlier, for instance, when we send a paper to some friends, colleagues and other peers for friendly feedback before we send it to a journal. Or we can do it later, once the paper is in print. But I think the review process itself is best done unencumbered by knowing identities, both as a reviewer and as an author. 

Posted in

7 responses to “On why reviewers and authors should remain mutually anonymous”

  1. anon

    there are (not so) subtle ways to out oneself as a reviewer. you do it by suggesting the author to refer to paper by X, published the year YYYY.
    Sometimes it is nice. I recently had a paper accepted in a good journal and, on the second round of reviews, reviewer#1 suggested to refer to X (yyyy). Since I particularly admire X, I am very happy to imagine that X was one of the reviewer. Should I now write to them to thank them?
    Similarly, over the past summer, I had another paper rejected because I was not referring to Z (yyyy), Z (kkkk), Z (nnnn). Something tells me Z did the review. and I now have some animosity towards Z (who might well not have been the reviewer) because of that rejection (for the record, I think the reviewer really misunderstood the paper which will eventually come out anyway, hopefully even in a more appreciated venue).

  2. I wrote a paper on the repugnant conclusion as a graduate student and Derek Parfit reviewed the paper and recommended rejection. Parfit had no trouble being respectful and constructive. And I was honored and greatly helped by his three pages of single-spaced comments. Also, I don’t see any problem arising from the disparity of power between us. Given it was a rejection, there was no pressure to be deferential. The only other time that I remember a journal reviewer identifying his or herself was another very famous philosopher (still alive – so I won’t use his or her name) who recommended revise and resubmit but who wasn’t at all heavy-handed in his or her comments. The reviewer made clear that he or she could be wrong on various points and was open to being convinced otherwise. In any case, I don’t really see the discrepancy in power to be a major concern. After all, at conferences and workshops, there is often a huge discrepancy of power between the audience member voicing some criticism and the author/presenter. And I don’t think that it would be better if audience questions/criticisms were presented anonymously. And I know a lot of people who have no problem being quite up front and honest in their criticisms even when their identity is known. So I think that it’s often okay to reveal your identity, but that you certainly mention things that one should consider before they do.

  3. Helen De Cruz

    Doug: that’s a good point–I do think that dynamics at conferences etc suffer from power imbalance. For example, I once was at a talk with a famous and prominent philosopher who gave a comment on a presentation by a postdoc. The postdoc was very deferential toward the prominent philosopher. But the prominent philosopher was hugely dismissive, saying that he would shorten his comment from 20 minutes to 5 minutes because he saw no merit in the paper. It was really dreadful. We were shocked and aghast. It reflected poorly on the prominent philosopher, not on the postdoc (who had a very competent paper).

  4. Junior Scholar

    The exchange in the comments between Doug and Helen makes me think about the emergence of 360 degree evaluations in business settings. How are people in authority roles (including as journal reviewers) held accountable for doing a fair job, being respectful, etc.? I don’t think abolishing blind review is the only way to increase accountability, or even the best way, but I should hope that some mechanisms regarding transparency and accountability are in place – at the level of managing journal editors for example. Some of the moves toward triple (or more?) blind review have good intentions but also risk other harms when everyone is anonymized. For example, why do we think that forms of implicit bias are not creeping into “blind” peer review? Especially bias against some philosophical areas (feminist philosophy, critical race theory, etc.) that might also stand in for bias against groups who are assumed to engage in those areas?

  5. Hear hear, Junior Scholar!

  6. Anon UK Grad

    A related question: a few years ago, I was refereeing a paper. I liked it a lot, R&R’d it, and then recommended publication on the next version; it was published.
    Throughout the process, the identity of the author was unknown to me, and I didn’t out myself during the refereeing. Of course, I know who wrote it now because I’ve see the published version.
    The question: is it appropriate to contact the author /after/ publication and out yourself as the referee? Are there risks that I am not seeing in doing that?

  7. Junior Scholar

    Anon UK Grad: I think Helen addresses this in her original post:
    ‘”I loved your paper! I was the reviewer who recommended accept”. What motivation could one have for writing this and not just “I read your paper on XX that just came out in Journal Y and I really loved it” when it appears in print?’
    I don’t see any good reasons for naming yourself as the reviewer (fill some in if you do) and I see plenty of bad ones (it exerts power over the author/might expect something in turn from them).
    Why not just tell them you work in a similar area and liked their paper? If you want to discuss it in detail/collaborate/discuss next projects, great, but telling them you refereed the paper is likely to make any of that follow up more awkward, and possibly believe to be compulsory to the person receiving such an invitation from you knowing you reviewed their work.

Leave a Reply to Doug PortmoreCancel reply

Discover more from The Philosophers' Cocoon

Subscribe now to keep reading and get access to the full archive.

Continue reading