Transparency in peer review : how to implement it without chaos
1. The email that uncovered a bad practice
Story inspired by a real case reported in the COPE repository; names and details have been changed.
Ernesto, a veteran reviewer, found a paragraph of his own—verbatim—in an article published six months later. He discovered that the author had copied the blind review he received from another journal . This case, documented by COPE (2023), reignited the debate about the opacity of the process.
1.1 Why do so many people distrust blind peer review?
- Lack of accountability: a careless reviewer can block an article without justification.
- Hidden bias: PLOS ONE studies show lower acceptance of female authors in certain disciplines when the process is not double-blind.
- Reverse plagiarism: as in the case of Ernesto: the author reuses comments or ideas.
2. Taxonomy of open peer review models
Model | Reviewer Identity | Publishing of the report | Examples of use |
Post-publication commenting | Revealed | Public comments | F1000Research |
Reports published, reviewer blind | Hidden | PDF with review | BMJ Open , eLife |
Open identities + reports | Revealed | PDF with review | Nature Communications |
Collaborative peer review | Collaborative | Change history | Frontiers |
3. Transparency in peer review , measurable benefits
- More download of supplementary data : +18% (Figshare 2024).
- Reduction of formal complaints : from 12 to 3 per year in the Journal of Chemistry after publishing reports.
- Average comment length increase : +150 words in pilot Index, 2024.
4. Risks and Counterweights
Risk | Potential impact | Countermeasure |
Escape of inspectors | 10-15% decline | Optional anonymity option |
Libels or defamations | Legal | Automated moderation + withdrawal clause |
Editorial overload | Overtime | Index allows you to easily add the review report as a supplementary file; assigning a DOI is optional according to each journal 's policy. |
5. Gradual 6-month plan
- Month 1 – Cultural diagnosis : survey of authors, reviewers and readers on openness.
- Month 2 – Policy document : defines which reports will be public and under what license.
- Month 3 – Pilot in a special issue : invite reviewers with a visibility bonus.
- Month 4 – Technical integration : activate the “publish report” option in Index.
- Month 5 – Evaluation of metrics : review time, report length, satisfaction.
- Month 6 – Scaling : extend to the rest of the journal if KPIs improve ≥ 10%.
6. Tools that facilitate transparency
- ORCID peer review credit : records activity and encourages signing.
- Scite.ai Statement : View key claims and verify citation support.
- Crossmark + review DOI : links the article to its review history.
7. Extended Case: Nursing Journal
Data synthesized from two nursing journal that adopted open peer review.
After a 12-month pilot:
- Average review time increased by only 1 day (from 26 to 27) despite longer reports.
- The final acceptance rate fell by 2%, reflecting greater rigor.
Author satisfaction increased from 3.8 to 4.4/5 in internal survey.
8. FAQ
Can I start by just publishing the editor's reports or the summary of the review process?
Yes. Some journal begin with an “editor’s note” explaining the review process. This is a first step toward transparency without compromising the reviewers.
What if the reviewers don't want their identity to be public?
No problem. You can offer the option of anonymity. The important thing is to publish the content of the review, not necessarily the reviewer's name.
Does the publishing of reports affect the impact factor?
No. As long as the reports have a separate DOI and are not indexed as scientific articles, they do not affect metrics such as the JIF.
Which license is recommended for review reports?
The most common practice is to use a CC-BY to allow reuse with attribution. If the reviewer prefers more privacy, CC-BY-NC , or no open license can be assigned.
Will the reviewers still agree to participate if their review is published?
Generally, yes. Some even value it positively because it allows them to showcase their work. You can encourage this by registering their review on ORCID.
Does this significantly increase the editorial workload?
Not necessarily. Index allows you to easily include reports as supplementary files, and if desired, generate a DOI to link them to the article.
What specific benefits have been seen in other journal ?
More detailed comments, fewer complaints from authors, and a greater perception of fairness in the process. In several pilot programs, an improvement in the quality of the reviews has also been observed.
Should I apply it to all items or can I do it only in some cases?
You can implement transparency gradually: start with a special issue, guest articles, or selected manuscripts. Then evaluate and decide whether to scale it up.
What happens if a review contains errors or inappropriate language?
The editor always has the final say. You can edit or moderate comments before publishing them. You can also remove a report if it violates ethical guidelines.
9. Practical conclusion
Open peer review is not a fad, but a necessary evolution toward more transparent and reliable science. Implementing it doesn't create chaos if done with a phased plan, a clear policy, and adequate technical support. The result: greater rigor, recognition for reviewers, and increased author confidence. It is a strategic investment in quality and editorial reputation.
Do you want a diagnosis of the feasibility of open peer review in your journal ? Book a 20-minute demo with Index and receive a comparative report with metrics from similar journal