際際滷

際際滷Share a Scribd company logo
Maria Kowalczuk, PhD
Deputy Biology Editor, BioMed Central
Innovation in Peer Review
http://www.meta-activism.org/2011/05/fixing-peer-review-freeing-knowledge-creation/
Traditional peer review
 Peer review in the current form has been used
since 1960s.
 Traditionally scientific journals use single blind
peer review or double blind peer review models.
 Online publishing and open access have changed
the publishing landscape while peer review
process has remained the same.
Pitfalls of traditional
peer review
 Slow
 Expensive to manage
 Inconsistent
 Bias
 Favouritism
 Abuse
http://www.eusci.org.uk/articles/exploring-scientific-peer-review
Innovative peer review models
 Open peer review
 Minimal re-review
 Portable peer review
 Technical peer review
 Decoupled peer review
 Post publication peer review
http://www.bishop-
hill.net/blog/2011/3/20/peer-review-not-for-
the-short-sighted-josh-87.html
Open (non-anonymous) peer review
Randomised Controlled Trial (BMJ 1999; 318: 23  27):
- no effect on report quality, recommendation, or time taken to review
- increased likelihood of reviewers declining to review
Innovation in peer review
Innovation in peer review
Innovation in peer review
Innovation in peer review
Biology Direct PubMed record
Publishing peer review documents
- In all 4 EMBO publications, including EMBO J, EMBO Reports
-Peer Review Process File shows all referee reports , author responses and editorial
decision letters
- Referees remain anonymous; opt-out is possible
- 95% of take-up rate; willingness of referees to review unchanged
Authors can opt out of re-review; if the editors judge the revisions sufficient,
the article is published, often accompanied by a critical Commentary.
Discussed in Editorial: http://www.biomedcentral.com/1741-7007/11/18.
Re-review opt-out  BMC Biology
Innovation in peer review
Portable peer review
Flagships
Subject-specific
journals
BMC Research Notes
BMC series
BMC Neuroscience
BMC Public Health
BMC Independent
Journals
Neuroscience Peer Review Consortium
Innovation in peer review
Technical peer review
Innovation in peer review
Innovation in peer review
Innovation in peer review
Innovation in peer review
Innovation in peer review
Post publication peer review via comments
 PubMed Commons
 PubPeer.com
 Research Gate
 Frontiers
 BioMed Central and other publishers
Conclusions
 Peer review is under scrutiny
 Developments in peer review include:
 Open peer review
 Minimizing re-review
 Portable peer review
 Technical peer review
 Peer review decoupled from journal
 Post publication peer review
Thank you!
Maria Kowalczuk, PhD
Deputy Biology Editor, BioMed Central
Maria.Kowalczuk@biomedcentral.com
Any questions?
Ad

Recommended

Future of peer review
Future of peer review
Maria_Kowalczuk
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
UCD Library
Lecture 32: Open Peer Review
Lecture 32: Open Peer Review
Jessica Laccetti
I conf2016
I conf2016
Peiling Wang
Jcdl2017 Poster
Jcdl2017 Poster
Peiling Wang
JBM Flyer
JBM Flyer
JBM Journal of Biological Methods
What Is Peer Review?
What Is Peer Review?
Jerry Stovall
Introduction to Peer review, updated 2015-03-05
Introduction to Peer review, updated 2015-03-05
Wouter Gerritsma
Can We Fix Peer Review
Can We Fix Peer Review
Micah Altman
How Often Are Studies Wrong?
How Often Are Studies Wrong?
Ivan Oransky
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
plumanalytics
Peer reviewing
Peer reviewing
Bryan Chinalpan
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
Ivan Oransky
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
DeVonne Parks, CEM
The Retraction Watch Database
The Retraction Watch Database
Ivan Oransky
OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing Research
William Gunn
BioMed Central's open data initiatives
BioMed Central's open data initiatives
iainh_z
Conference on Vaccines
Conference on Vaccines
OMICS International
Retractions, Peer Review, and Transparency
Retractions, Peer Review, and Transparency
Ivan Oransky
Human Subjects, Research and Navigating the IRB Process
Human Subjects, Research and Navigating the IRB Process
OSUCCC - James
Literature Searching for BSc Health Promotion 2014
Literature Searching for BSc Health Promotion 2014
JoWilson13
JPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapers
manrai1953
Why should my institution support RRIDs?
Why should my institution support RRIDs?
Neuroscience Information Framework
Blockchain based digital currency for researchers (Peer-reviewers)
Blockchain based digital currency for researchers (Peer-reviewers)
KMI - Knowledge Media Institute, The Open University, UK.
ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
William Gunn
Open access workshop wits - 24th october 2013 - copy
Open access workshop wits - 24th october 2013 - copy
Nkaba Senne
Academic citizenship (in higher education)
Academic citizenship (in higher education)
Roger Watson
BIOMEDICAL .ppt
BIOMEDICAL .ppt
AnandKumar459862
Understanding scientific peer review
Understanding scientific peer review
Samir Haffar
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Amado III Tandoc, MD, DPSP

More Related Content

What's hot (15)

Can We Fix Peer Review
Can We Fix Peer Review
Micah Altman
How Often Are Studies Wrong?
How Often Are Studies Wrong?
Ivan Oransky
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
plumanalytics
Peer reviewing
Peer reviewing
Bryan Chinalpan
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
Ivan Oransky
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
DeVonne Parks, CEM
The Retraction Watch Database
The Retraction Watch Database
Ivan Oransky
OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing Research
William Gunn
BioMed Central's open data initiatives
BioMed Central's open data initiatives
iainh_z
Conference on Vaccines
Conference on Vaccines
OMICS International
Retractions, Peer Review, and Transparency
Retractions, Peer Review, and Transparency
Ivan Oransky
Human Subjects, Research and Navigating the IRB Process
Human Subjects, Research and Navigating the IRB Process
OSUCCC - James
Literature Searching for BSc Health Promotion 2014
Literature Searching for BSc Health Promotion 2014
JoWilson13
JPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapers
manrai1953
Why should my institution support RRIDs?
Why should my institution support RRIDs?
Neuroscience Information Framework
Can We Fix Peer Review
Can We Fix Peer Review
Micah Altman
How Often Are Studies Wrong?
How Often Are Studies Wrong?
Ivan Oransky
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
plumanalytics
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
Ivan Oransky
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
DeVonne Parks, CEM
The Retraction Watch Database
The Retraction Watch Database
Ivan Oransky
OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing Research
William Gunn
BioMed Central's open data initiatives
BioMed Central's open data initiatives
iainh_z
Retractions, Peer Review, and Transparency
Retractions, Peer Review, and Transparency
Ivan Oransky
Human Subjects, Research and Navigating the IRB Process
Human Subjects, Research and Navigating the IRB Process
OSUCCC - James
Literature Searching for BSc Health Promotion 2014
Literature Searching for BSc Health Promotion 2014
JoWilson13
JPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapers
manrai1953

Similar to Innovation in peer review (20)

Blockchain based digital currency for researchers (Peer-reviewers)
Blockchain based digital currency for researchers (Peer-reviewers)
KMI - Knowledge Media Institute, The Open University, UK.
ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
William Gunn
Open access workshop wits - 24th october 2013 - copy
Open access workshop wits - 24th october 2013 - copy
Nkaba Senne
Academic citizenship (in higher education)
Academic citizenship (in higher education)
Roger Watson
BIOMEDICAL .ppt
BIOMEDICAL .ppt
AnandKumar459862
Understanding scientific peer review
Understanding scientific peer review
Samir Haffar
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Amado III Tandoc, MD, DPSP
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
healthlibaust2012
Reproducibility and replicability: a practical approach
Reproducibility and replicability: a practical approach
Krzysztof Gorgolewski
eLife peer review alpsp talk
eLife peer review alpsp talk
Mark Patterson
EoE HLN summer conference 2015 IK - open access & research data management
EoE HLN summer conference 2015 IK - open access & research data management
Isla Kuhn
2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania
Max Haring
1.2 study designs, data types, choosing statistical tests, data analysis chec...
1.2 study designs, data types, choosing statistical tests, data analysis chec...
Simple Research
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
Vivien Rolfe
Open Research Practices in the Age of a Papermill Pandemic
Open Research Practices in the Age of a Papermill Pandemic
Dorothy Bishop
Demystifying open access
Demystifying open access
Laura Czerniewicz
Steps-for-Conducting-Systematic-Reviews.pptx
Steps-for-Conducting-Systematic-Reviews.pptx
ARARSOBESHEA1
Getting Published: Tips and Resources
Getting Published: Tips and Resources
UQSCADS
Introduction to F1000Research: an open review journal
Introduction to F1000Research: an open review journal
Dasapta Erwin Irawan
Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...
healthlibaust2012
ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
William Gunn
Open access workshop wits - 24th october 2013 - copy
Open access workshop wits - 24th october 2013 - copy
Nkaba Senne
Academic citizenship (in higher education)
Academic citizenship (in higher education)
Roger Watson
Understanding scientific peer review
Understanding scientific peer review
Samir Haffar
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Amado III Tandoc, MD, DPSP
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
healthlibaust2012
Reproducibility and replicability: a practical approach
Reproducibility and replicability: a practical approach
Krzysztof Gorgolewski
eLife peer review alpsp talk
eLife peer review alpsp talk
Mark Patterson
EoE HLN summer conference 2015 IK - open access & research data management
EoE HLN summer conference 2015 IK - open access & research data management
Isla Kuhn
2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania
Max Haring
1.2 study designs, data types, choosing statistical tests, data analysis chec...
1.2 study designs, data types, choosing statistical tests, data analysis chec...
Simple Research
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
Vivien Rolfe
Open Research Practices in the Age of a Papermill Pandemic
Open Research Practices in the Age of a Papermill Pandemic
Dorothy Bishop
Steps-for-Conducting-Systematic-Reviews.pptx
Steps-for-Conducting-Systematic-Reviews.pptx
ARARSOBESHEA1
Getting Published: Tips and Resources
Getting Published: Tips and Resources
UQSCADS
Introduction to F1000Research: an open review journal
Introduction to F1000Research: an open review journal
Dasapta Erwin Irawan
Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...
healthlibaust2012
Ad

Recently uploaded (20)

FYJC .Chapter-14 L-1 Human Nutrition.pdf
FYJC .Chapter-14 L-1 Human Nutrition.pdf
RachanaT6
THE CIRCULATORY SYSTEM GRADE 9 SCIENCE.pptx
THE CIRCULATORY SYSTEM GRADE 9 SCIENCE.pptx
roselyncatacutan
Citizen Science and Science communication
Citizen Science and Science communication
tarhanhatice0101
8,9-Red Blood Cells.pdf ayurveda for life
8,9-Red Blood Cells.pdf ayurveda for life
AnkitBhardwaj874048
How Psychology Can Power Product Decisions: A Human-Centered Blueprint- Shray...
How Psychology Can Power Product Decisions: A Human-Centered Blueprint- Shray...
ShrayasiRoy2
Climate and Weather_SCIENCE9-QUARTER3.pptx
Climate and Weather_SCIENCE9-QUARTER3.pptx
Dayan Espartero
plant and animal nutrition..........pptx
plant and animal nutrition..........pptx
mayflorgalleno
Cloud Collaboration Market Challenges, Drivers, Trends, and Forecast by 2031
Cloud Collaboration Market Challenges, Drivers, Trends, and Forecast by 2031
moresonali406
Matt Ridley: Economic Evolution and Ideas that have Sex
Matt Ridley: Economic Evolution and Ideas that have Sex
Conservative Institute / Konzervat鱈vny in邸tit炭t M. R. tef叩nika
Science 8 Quarter 4 first quiz digestive system.docx
Science 8 Quarter 4 first quiz digestive system.docx
junefermunez
SCIENCE-G7-Quarter1-Week1-Day1.matatagpptx
SCIENCE-G7-Quarter1-Week1-Day1.matatagpptx
Pyumpyum
GBSN_Unit 3 - Medical and surgical Asepsis
GBSN_Unit 3 - Medical and surgical Asepsis
Areesha Ahmad
Pneumonia Presentation for CPG Review and Mastery
Pneumonia Presentation for CPG Review and Mastery
JayricDepalobos
Synthesis and characterization of Thiazole derivatives of N-substituted lsatin
Synthesis and characterization of Thiazole derivatives of N-substituted lsatin
Professional Content Writing's
Lesson 1 in Earth and Life Science .pptx
Lesson 1 in Earth and Life Science .pptx
KizzelLanada2
Human Body Systems: Organ systemsss.pptx
Human Body Systems: Organ systemsss.pptx
marionrada1985
Antipsychotics-FOR LECTURE.pdf................
Antipsychotics-FOR LECTURE.pdf................
FalguniPatil6
GBSN__Unit 2 - Control of Microorganisms
GBSN__Unit 2 - Control of Microorganisms
Areesha Ahmad
Properties of Gases siwhdhadpaldndn.pptx
Properties of Gases siwhdhadpaldndn.pptx
CatherineJadeBurce
What is Skeleton system.pptx by rizwan bashir
What is Skeleton system.pptx by rizwan bashir
bhatbashir421
FYJC .Chapter-14 L-1 Human Nutrition.pdf
FYJC .Chapter-14 L-1 Human Nutrition.pdf
RachanaT6
THE CIRCULATORY SYSTEM GRADE 9 SCIENCE.pptx
THE CIRCULATORY SYSTEM GRADE 9 SCIENCE.pptx
roselyncatacutan
Citizen Science and Science communication
Citizen Science and Science communication
tarhanhatice0101
8,9-Red Blood Cells.pdf ayurveda for life
8,9-Red Blood Cells.pdf ayurveda for life
AnkitBhardwaj874048
How Psychology Can Power Product Decisions: A Human-Centered Blueprint- Shray...
How Psychology Can Power Product Decisions: A Human-Centered Blueprint- Shray...
ShrayasiRoy2
Climate and Weather_SCIENCE9-QUARTER3.pptx
Climate and Weather_SCIENCE9-QUARTER3.pptx
Dayan Espartero
plant and animal nutrition..........pptx
plant and animal nutrition..........pptx
mayflorgalleno
Cloud Collaboration Market Challenges, Drivers, Trends, and Forecast by 2031
Cloud Collaboration Market Challenges, Drivers, Trends, and Forecast by 2031
moresonali406
Science 8 Quarter 4 first quiz digestive system.docx
Science 8 Quarter 4 first quiz digestive system.docx
junefermunez
SCIENCE-G7-Quarter1-Week1-Day1.matatagpptx
SCIENCE-G7-Quarter1-Week1-Day1.matatagpptx
Pyumpyum
GBSN_Unit 3 - Medical and surgical Asepsis
GBSN_Unit 3 - Medical and surgical Asepsis
Areesha Ahmad
Pneumonia Presentation for CPG Review and Mastery
Pneumonia Presentation for CPG Review and Mastery
JayricDepalobos
Synthesis and characterization of Thiazole derivatives of N-substituted lsatin
Synthesis and characterization of Thiazole derivatives of N-substituted lsatin
Professional Content Writing's
Lesson 1 in Earth and Life Science .pptx
Lesson 1 in Earth and Life Science .pptx
KizzelLanada2
Human Body Systems: Organ systemsss.pptx
Human Body Systems: Organ systemsss.pptx
marionrada1985
Antipsychotics-FOR LECTURE.pdf................
Antipsychotics-FOR LECTURE.pdf................
FalguniPatil6
GBSN__Unit 2 - Control of Microorganisms
GBSN__Unit 2 - Control of Microorganisms
Areesha Ahmad
Properties of Gases siwhdhadpaldndn.pptx
Properties of Gases siwhdhadpaldndn.pptx
CatherineJadeBurce
What is Skeleton system.pptx by rizwan bashir
What is Skeleton system.pptx by rizwan bashir
bhatbashir421
Ad

Innovation in peer review

  • 1. Maria Kowalczuk, PhD Deputy Biology Editor, BioMed Central Innovation in Peer Review http://www.meta-activism.org/2011/05/fixing-peer-review-freeing-knowledge-creation/
  • 2. Traditional peer review Peer review in the current form has been used since 1960s. Traditionally scientific journals use single blind peer review or double blind peer review models. Online publishing and open access have changed the publishing landscape while peer review process has remained the same.
  • 3. Pitfalls of traditional peer review Slow Expensive to manage Inconsistent Bias Favouritism Abuse http://www.eusci.org.uk/articles/exploring-scientific-peer-review
  • 4. Innovative peer review models Open peer review Minimal re-review Portable peer review Technical peer review Decoupled peer review Post publication peer review http://www.bishop- hill.net/blog/2011/3/20/peer-review-not-for- the-short-sighted-josh-87.html
  • 5. Open (non-anonymous) peer review Randomised Controlled Trial (BMJ 1999; 318: 23 27): - no effect on report quality, recommendation, or time taken to review - increased likelihood of reviewers declining to review
  • 11. Publishing peer review documents - In all 4 EMBO publications, including EMBO J, EMBO Reports -Peer Review Process File shows all referee reports , author responses and editorial decision letters - Referees remain anonymous; opt-out is possible - 95% of take-up rate; willingness of referees to review unchanged
  • 12. Authors can opt out of re-review; if the editors judge the revisions sufficient, the article is published, often accompanied by a critical Commentary. Discussed in Editorial: http://www.biomedcentral.com/1741-7007/11/18. Re-review opt-out BMC Biology
  • 14. Portable peer review Flagships Subject-specific journals BMC Research Notes BMC series BMC Neuroscience BMC Public Health BMC Independent Journals
  • 23. Post publication peer review via comments PubMed Commons PubPeer.com Research Gate Frontiers BioMed Central and other publishers
  • 24. Conclusions Peer review is under scrutiny Developments in peer review include: Open peer review Minimizing re-review Portable peer review Technical peer review Peer review decoupled from journal Post publication peer review
  • 25. Thank you! Maria Kowalczuk, PhD Deputy Biology Editor, BioMed Central Maria.Kowalczuk@biomedcentral.com Any questions?