March 2021 Institute
Prework:
Agenda for Day 1
All times in EDT
12:00pm – Welcome and introductions
12:30pm –Reproducibility, transparent methods, and pre-registration
Supplementary Material
- Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science (PDF)
- Rein in the four horsemen of irreproducibility
- Reproducibility and Replicability in Science
1:00pm –
Exploring different review methodologies (Google Slides)
Supplementary Materials
Scoping studies: Advancing the methodology
Updating the PRISMA reporting guideline for systematic reviews and meta-analyses
Living systematic review: 1. Introduction—the why, what, when, and how
Systematic review example (pre-reading)
Scoping review example (pre-reading)
1:30pm – Break
2:00pm – Evidence synthesis steps and librarians as co-investigators (Google Slides)
2:30pm Systematic review guidelines/checklists/reporting standards (Google Slides)
Supplementary materials
PRISMA Statement, Checklist, and Flow Diagram
APA Meta-Analysis Reporting Standards (MARS)
RepOrting standards for Systematic Evidence Syntheses in environmental research (ROSES)
Methodological Expectations of Campbell Collaboration Intervention Reviews (MECCIR)
Evidence synthesis protocol template
Inclusive Systematic Review Registration Form
3:00pm – Break
3:30pm – The reference interview: how to have a conversation with a review team
3:45pm – Break
4:00pm –Introduction to protocols and protocol registration (Google Slides)
Supplementary Materials
Protocol registry links:
https://campbellcollaboration.org/
https://www.environmentalevidence.org/
https://www.crd.york.ac.uk/prospero/
Evidence synthesis protocol template
4:45pm – Wrap up
Agenda for Day 2
All times in EDT
12:00pm – Formulating a research question (Google Slides)
12:30pm –
Frameworks and eligibility criteria (Google Slides)
Supplementary Material
JBI Manual for Evidence Synthesis, Chapter 11.2.2
The well-built clinical question: A key to evidence-based decisions
Cooke A, Smith D, Booth A. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012 Oct;22(10):1435-43. PMID: 22829486.
Booth, A. (2006). Clear and present questions: Formulating questions for evidence based practice. Library Hi Tech, 24(3): 355-368.
Wildridge, V., & Bell, L. (2002). How CLIP became ECLIPSE: A mnemonic to assist in searching for health policy/management information. Health Information & Libraries Journal, 19(2):113-115
1:00pm – Break
1:15pm –
Selecting databases for evidence synthesis (Google Slides)
Supplementary Material
Haddaway NR, Collins AM, Coughlin D, Kirk S. The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PloS one. 2015 Sep 17;10(9):e0138237. https://doi.org/10.1371/journal.pone.0138237
GSscraper
This package contains a suite of functions to scrape search results from Google Scholar
1:30pm –Writing a search strategy (Google Slides)
2:30pm – Break
3:00pm –
Searching the Grey Literature (Google Slides)
Supplementary Materials
Grey Literature sources for agricultural topics
Searching for studies: A guide to information retrieval for Campbell systematic reviews
Example of grey literature documentation
3:45pm – Citation management, article screening tools and documentation
Supplementary Materials
4:30pm – Writing the methods section (Google Slides)
Supplementary Materials
PRISMA-S: https://osf.io/ygn9w/
Example methods section: https://doi.org/10.1007/s10567-020-00315-3
Exercise article: Food waste matters – A systematic review of household food waste practices and their policy implications https://doi.org/10.1016/j.jclepro.2018.02.030
Agenda for Day 3
All times in EDT
12:00 pm – Breakout sessions (Round 1)
- Room 1: Database access in resource-limited settings
- Room 2: Starting a service
- Room 3: Living Systematic Reviews
- Room 4: Automating the evidence synthesis process
- Room 5: Advising teams on data extraction forms and risk of bias assessment
- Room 6: Evidence synthesis in Agriculture and Nutrition
12:45 pm – Break
1:00pm Breakout sessions (Round 2)
- Room 1: Database access in resource-limited settings
- Room 2: Starting an Evidence Synthesis Service in Your Library
- Room 3: Living Systematic Reviews
- Room 4:Automating the evidence synthesis process
- Room 5: Advising teams on data extraction forms and risk of bias assessment
- Room 6: Resources to support nutrition and agriculture
-
Supplementary Material
Resources specific to nutrition
Academy of Nutrition and Dietetics
Methodology for Conducting Systematic Reviews for the Library
Agency for Healthcare Research and Quality (AHRQ)
USDA’s Center for Nutrition Policy and Promotion
Resources specific to agriculture
ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments)
Checklist of information to include in publications describing animal research
3ie – International Initiative for Impact Evaluation
Training materials, repository on international development
SYREAF – Systematic Reviews for Animals & Food
Site for publication of review protocols on food safety, animal health and animal welfare
8 reviews on agricultural development project topics
Documentation on OSF
Gray Lit Resources for Agriculture Evidence Syntheses
Resources specific to environmental topics
Collaboration for Environmental Evidence
Review guidelines, journal, tools for author
ROSES – RepOrting standards for Systematic Evidence Syntheses
For environmental research
1:45pm – Break
2:00pm – Breakout sessions (Round 3)
- Room 1: Psychology and Educational Psychology Reviews
- Room 2:Database access in resource-limited settings
- Room 3: OSF protocol registration
- Room 4: Peer review (PRESS etc)
- Room 5: Evidence Synthesis in Social Work and Social Welfare
2:45pm – Break
3:00pm Breakout sessions (round 4)
- Room 1: Psychology and Educational Psychology Reviews
- Room 2: Reviews in Business and Management
- Room 3: OSF protocol registration
- Room 4: Peer review (PRESS etc)
- Room 5: Evidence synthesis in Social Work and Social Welfare
- Advising teams on data extraction and risk of bias assessment
- Living Systematic Reviews
References
Counotte, Michel Jacques (2020). Zika virus: causality, open science and risk of emerging infectious diseases. (Thesis). Universität Bern, Bern
Living Systematic Review of Mental Health in COVID-19. The DEPRESSD Project: A Unique and Rigorous Data Platform for Depression Screening Research. depressd.ca/covid-19-mental-health
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. B. (2021). PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews. Syst Rev, 10(1), 39. doi:10.1186/s13643-020-01542-z
What is a Living Systematic Review? Cochrane Gynaecological, Neuro-oncology and Orphan Cancers. Retrieved from https://gnoc.cochrane.org/news/what-living-systematic-review
- Psychology and Educational Psychology Systematic Reviews
References
Campbell Collaboration. Retrieved from www.campbellcollaboration.org
Ghezzi-Kopel, Kate, & Porciello, Jaron. (2020). Evidence synthesis protocol template. doi: 10.17605/OSF.IO/ZWD6N
PROSPERO. Retrieved from https://www.crd.york.ac.uk/prospero/
Topor, M., Pickering, J. S., Barbosa Mendes, A., Bishop, D. V. M., Büttner, F. C., Henderson, E. L., … Westwood, S. J. (2020, December 14). An integrative framework for planning and conducting Non-Interventional, Reproducible, and Open Systematic Reviews (NIRO-SR). doi: 10.31222/osf.io/8gu5z
Van den Akker, O., Peters, G.Y., Bakker, C., Carlsson, R., Coles, N. A., Corker, K.S.,…Yeung, S. (2020). Inclusive Systematic Review Registration Form. doi: 10.31222/osf.io/3nbea
3:45pm – Break
4:00pm – Answer questions from survey and wrap up
