Jeromy Anglim's Blog: Psychology and Statistics

Thursday, July 7, 2016

Workflow for Completing a Revise and Resubmit of a Journal Article in Psychology

This post discusses my workflow for completing a revise and resubmit.
I have a template document for representing revise and resubmit responses.
See my templates page on github and specifically see the file "response-to-reviewers.dotx".

Setting up the Response Document

The document has the following core styles:
  • Heading 1: Divides up major sections of the review (e.g., Editor, Reviewer 1, Reviewer 2
  • Heading 2: Summary statement for each reviewer actions
  • Reviewer Comment: Exact quote of a particular reviewer comment
  • Body text: For recording my response
  • Quote: For formatting quotes of specifically modified sections of the text
Step 1 is to paste the full text of the editor and reviewers into a new Word response document. Apply reviewer comment style
Step 2 is to set up the response document. Level 1 headings are added that divide up the the reviewer sections.
Reviewer comments are divided into discrete points. The division of revision points may or may not be clear. Some reviewers provide numbered points. Others provide a more narrative review where each paragraph includes multiple points. Some points are interconnected but involve distinct actions.
For each point that is identified, I add a level 2 heading. The level 2 heading includes an identifier and a brief summary statement of the requirement. Identifiers are for example, "R1.2", which would refer to reviewer 1's second point. In some cases, where there are connected points, you get "R1.2.1", "R1.2.2" and so on.
There are several benefits to using identifiers. In some cases, multiple reviewers make the same point. Thus, you can quickly refer the reviewer to another review point. E.g., "This point was addressed in reviewer point R1.2". It can also be an efficient way of keeping track of reviewer points when you are working through a large number of them.
The summary statements are important. I aim to keep them short. Ideally they'll fit on one line so that they are easy to quickly understand (i.e., around 50 characters). I try to make them commands. For example:
  • Clarify unique contribution
  • Improve study motivation in introduction
  • Describe x more clearly
  • Add references to ...
  • Justify statistical method
  • Consider using ... method
  • Include ... Table 1
In some cases, the required action is not explicitly stated by the reviewer. For example, if a reviewer critiques a methodological decision, there are various possible actions including, justifying your choice, adding a limitation, and so on.
The benefits of using formal Headings in MS Word is that you can get a document map on the side that can quickly allow you to navigate between reviewer points.
Another benefit of the above process is that reviewer comments start to appear more manageable. When you first receive a few pages of reviewer comments, it can feel overwhelming. The above process begins to divide up each point into a more manageable task. The act of providing a summary statement also forces you to read and understand what action is required to respond to the reviewer comment.

Sequencing the Revisions

The next task is to determine a sequence for working through the revisions. This involves keeping track of which points still need to be addressed and deciding on an order to work through the points.
At a basic level, I place an asterisk at the start of each heading that has not yet been addressed. This is removed once the point has been adequately addressed.

A more challenging issue is deciding on how to  work through the changes. Some changes are interdependent. In particular, major revisions often have to be worked through first as they can have broader structural implications for the manuscript.
A few useful steps for thinking about sequencing include:
  • Organise the points into categories
  • Read through each point, and make some tentative notes about what to do (e.g., using comments in Word).
  • Decide on an explicit sequence to work on the points. This often requires you to brainstorm the pros and cons of working on one point versus another first.
In some cases, sequencing will raise some more meta-issues about the paper that transcend any given review point.

Addressing Revision Points

If sequencing issues have been resolved, it is a matter of working through each revision point. I have a few guiding principles:
  • Write in a manner which focuses on the scientific issue.
  • Treat the reviewer with respect.
  • If a reviewer has misunderstood something in manuscript, take responsibility for making the manuscript clearer.
Another point is that the response document should be self-contained. Ideally, the reviewer should not need to look at the actual manuscript to judge whether you have effectively responded to their requested changes. This makes the experience of the reviewer much more pleasant. From a strategic perspective, they may also be less inclined to read through the entire manuscript again and come up with all new concerns.
  • If a table or figure is updated, then paste a screenshot of the updated table or figure.
  • If a new paragraph has been added, include a copy of that paragraph.
  • If a sentence of two has been added to a paragraph, include a copy of the whole paragraph and bold the section that has been added.
  • Only if the point is very basic is it sufficient to say, "this change was made". Examples of this might be adding a reference, fixing up typos, and so on.

Collaborations and Revisions

It is often easiest if one person leads revisions. The lead person can also allocate specific revision tasks to co-authors.

No comments:

Post a Comment