Skip to Main Content

Evidence Synthesis & Systematic Review Research

This guide provides an introduction to evidence synthesis research methods.

Purpose of a Protocol

Evidence synthesis researchers are strongly encouraged to develop a project protocol prior to substantive searching and selection of literature or other aspects of the project. In the same way that a protocol serves as a plan or roadmap for experimental research, an evidence synthesis protocol serves as a plan or roadmap for this type of research and, importantly, helps reduce bias in the selection of included studies.

Chapter 1 of the Cochrane Handbook for Systematic Reviews of Interventions offers guidance on the rationale for doing so:

Preparing a systematic review is complex and involves many judgements. To minimize the potential for bias in the review process, these judgements should be made as far as possible in ways that do not depend on the findings of the studies included in the review. Review authors’ prior knowledge of the evidence may, for example, influence the definition of a systematic review question, the choice of criteria for study eligibility, or the pre-specification of intervention comparisons and outcomes to analyse. It is important that the methods to be used should be established and documented in advance.

Publication of a protocol for a review that is written without knowledge of the available studies reduces the impact of review authors’ biases, promotes transparency of methods and processes, reduces the potential for duplication, allows peer review of the planned methods before they have been completed, and offers an opportunity for the review team to plan resources and logistics for undertaking the review itself.

References:

  • Lasserson, T.J., Thomas, J., & Higgins, J.P.T. (2021). Chapter 1: Starting a review. In J.P.T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M.J.  Page, & V. A. Welch (Eds.),  In Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane handbook for systematic reviews of interventions (Ver 6.5, 2024). www.training.cochrane.org/handbook.

Protocol Components

Reporting guidelines can help you make sure you include all the necessary elements in your written protocol. The widely-accepted PRISMA (Preferred Reporting Items for Systematic Review and Meta-analyses) guidelines offer an extension specifically for protocols, PRISMA-P. Use the protocol guide to make sure you address all the necessary components of an evidence synthesis protocol.

Cochrane's MECIR (Methodological Expectations of Cochrane Intervention Reviews) Manual also includes a section on protocol development.

Protocols will likely contain most or all of the following elements:

  • Research team info
  • Project timeline
  • Research question and evidence synthesis methodology
  • Search strategy and search platforms/resources
  • Inclusion and exclusion criteria
  • Evaluation strategy of included studies (risk of bias assessment or critical appraisal strategy)
  • Data extraction strategy
  • Dissemination plans

Protocol Registration

Some publication venues will require that protocols be registered (e.g., Cochrane Reviews). Even if you are not required to register your protocol, registration can "stake your claim" to work on that question topic. There are other benefits to developing and registering a protocol, including increased review quality (Sideiri et al., 2018) and limiting duplication of evidence synthesis research efforts.

Some protocol registration options include the following websites.

 

Discipline-agnostic

  • OSF (Open Science Framework)
    • open access platform dedicated to openness, integrity and reproducibility of research across disciplines
    • directions for creating a (Pre)registration
  • Figshare
    • open access platform to "store, share, discover research"
    • register to begin uploading and sharing
  • protocols.io
  • ScholarsArchive@OSU (Institutional repository for Oregon State University)
    • login with your OSU credentials to begin uploading
  • Zenodo
    • open access and open source research repository supported by CERN
    • register to begin uploading and sharing

 

Discipline-specific

  • CEE (Collaboration for Environmental Evidence)
    • focused on "sustainable global environment and the conservation of biodiversity"
    • protocols are registered in PROCEED
  • JBI (Joanna Briggs Institute) Systematic Review Register
    • focused on evidence-based decisions that improve health and health service delivery
    • review registration is for use only by JBI-affiliated entities
  • PROSPERO (International Prospective Register of Systematic Reviews)
    • registered systematic reviews in health and social care, welfare, public health, education, crime, justice, and international development, where there is a health-related outcome
    • not appropriate for student course-related work
    • information about registration
  • SYREAF
    • focused on systematic reviews regarding animal health or food-related topics
    • use the Contact Form to send a protocol for posting

 

References:

  • Sideri, S., Papageorgiou, S. N., & Eliades, T. (2018). Registration in the international prospective register of systematic reviews (PROSPERO) of systematic review protocols was associated with increased review quality. Journal of clinical epidemiology, 100, 103–110. https://doi.org/10.1016/j.jclinepi.2018.01.003