Transparency in peer review: how to implement it without chaos
1. The email that exposed a bad practice
Story inspired by a real case reported in the COPE repository; names and details have been changed.
Ernesto, a veteran reviewer, found one of his paragraphs, word for word, in an article published six months later. He discovered that the author had copied the blind review he had received from another journal. That case, documented by COPE (2023), reignited the debate about the opacity of the process.
1.1 Why do so many people distrust blind peer review?
- Lack of accountability: a careless reviewer can block an article without justifying it.
- Hidden bias: studies by PLOS ONE show lower acceptance of female authors in certain disciplines when the process is not double-blind.
- Reverse plagiarism: as in Ernesto’s case, the author reuses comments or ideas.
2. Taxonomy of open peer review models
Model | Reviewer identity | Report publication | Examples of use |
Post‑publication commenting | Disclosed | Public comments | F1000Research |
Reports published, reviewer blind | Hidden | PDF with review | BMJ Open, eLife |
Open identities + reports | Disclosed | PDF with review | Nature Communications |
Collaborative peer review | Collaborative | Change history | Frontiers |
3. Transparency in peer review: measurable benefits
- More downloads of supplementary data: +18% (Figshare 2024).
- Fewer formal complaints: from 12 to 3 per year at Revista Colombiana de Química after publishing reports.
- Longer average comment length: +150 words in an Index pilot, 2024.
4. Risks and counterweights
Risk | Potential impact | Countermeasure |
Loss of reviewers | 10–15% decline | Optional anonymity |
Libel or defamation | Legal | Automated moderation + retraction clause |
Editorial overload | Extra hours | Index makes it easy to add the review report as a supplementary file; assigning a DOI is optional depending on each journal’s policy. |
5. Gradual 6-month plan
- Month 1 – Cultural diagnosis: survey authors, reviewers and readers about openness.
- Month 2 – Policy document: define which reports will be public and under which licence.
- Month 3 – Pilot in a special issue: invite reviewers with a visibility bonus.
- Month 4 – Technical integration: enable the “publish report” option in Index.
- Month 5 – Metrics evaluation: review time, report length, satisfaction.
- Month 6 – Scaling up: extend to the rest of the journal if KPIs improve by ≥ 10%.
6. Tools that make transparency easier
- ORCID peer review credit: records activity and encourages reviewers to sign.
- Scite.ai Statement: visualises key claims and checks citation support.
- Crossmark + review DOI: links the article to its review history.
7. Extended case: nursing journals
Data synthesised from two nursing journals that adopted open peer review.
After a 12-month pilot:
- Average review time rose by only 1 day (from 26 to 27) despite longer reports.
- Final acceptance rate fell by 2%, reflecting greater rigour.
Author satisfaction rose from 3.8 to 4.4/5 in an internal survey.
8. FAQ
Can I start by publishing only the editor’s reports or a summary of the review process?
Yes. Some journals start with an “editor’s note” explaining how the process went. It is a first step towards transparency without compromising reviewers.
What if reviewers do not want their identity to be public?
That is fine. You can offer the option of anonymity. What matters is publishing the content of the review, not necessarily the reviewer’s name.
Does publishing reports affect the impact factor?
No. As long as the reports have a separate DOI and are not indexed as research articles, they do not affect metrics such as the JIF.
Which licence is recommended for review reports?
The most common choice is a CC-BY licence to allow reuse with attribution. If the reviewer prefers more privacy, you can use CC-BY-NC or not assign an open licence.
Will reviewers still agree to take part if their review is published?
In general, yes. Some even value it because it lets them showcase their work. You can encourage this by registering their review in ORCID.
Does this greatly increase the editorial workload?
Not necessarily. Index makes it easy to include reports as supplementary files and, if desired, generate a DOI to link them to the article.
What concrete benefits have other journals seen?
More detailed comments, fewer author complaints and a greater perception of fairness in the process. Several pilots have also seen an improvement in review quality.
Should I apply it to all articles or can I do it only in some cases?
You can introduce transparency gradually: start with a special issue, with invited articles or with selected manuscripts. Then evaluate and decide whether to scale it up.
What if a review contains errors or inappropriate language?
The editor always has the final say. You can edit or moderate comments before publishing them. You can also withdraw a report if it breaches ethical standards.
9. Practical conclusion
Open review is not a fad but a necessary evolution towards more transparent and trustworthy science. Implementing it does not cause chaos if it is done with a gradual plan, a clear policy and the right technical support. The result: greater rigour, recognition for reviewers and more trust from authors. It is a strategic investment in editorial quality and reputation.
Would you like an assessment of the feasibility of open peer review at your journal? Book a 20-minute demo with Index and receive a comparative report with metrics from similar journals.