DOI

https://doi.org/10.18849/ve.v8i3.653

Abstract

Objective: The Symposium on Animal Systematic Reviews held 24 May 2022, sought to bring organisations working on animal literature searching and systematic reviews together into the same virtual space for introductions and discussion.

Background: Groups working on animal research synthesis are often siloed into preclinical, veterinary, and One Health settings. This symposium sought to define commonalities and differences in methodologies, resources, and philosophies and to discuss future needs.

Methods: The 3-hour virtual symposium for veterinarians, researchers, and information specialists began with introductions by panelists from organisations involved in searching the literature for animal studies and conducting systematic reviews. This was followed by a panel discussion and question and answer period.

Results: Panelists identified a need to ensure planning and accurate description of primary animal studies as a precursor to quality systematic reviews. They acknowledged and discussed differences in evidence synthesis expectations and tools based on the type of review, the types of studies available on the topic, and the focus on preclinical, veterinary, or One Health topics.

Conclusion: The need to increase the speed and quality of evidence reviews, and to automate updates, requires investing in the development of both skilled teams and platforms. The symposium provided a chance to identify existing resources, define challenges, and note gaps unique to systematic reviews of animal studies.

Application: This symposium acts as a baseline for ongoing discussions centred on improving the culture and pipeline for evidence syntheses of animal studies that inform decision-making.

References

Bahor, Z., Liao, J., Currie, G., Ayder, C., Macleod, M., McCann, S.K., Bannach-Brown, A., Wever, K., Soliman, N., Wang, Q., Doran-Constant, L., Young, L., Sena, E.S. & Sena, C. (2021). Development and uptake of an online systematic review platform: the early years of the CAMARADES Systematic Review Facility (SyRF). BMJ Open Science. 5(1), e100103. DOI: https://doi.org/10.1136/bmjos-2020-100103

Baker, M. (2019). Animal registries aim to reduce bias. 573(7773), 297–298. DOI: https://doi.org/10.1038/d41586-019-02676-4

Bannach-Brown, A., Przybyła, P., Thomas, J., Rice, A.S.C., Ananiadou, S., Liao, J. & Macleod, M.R. (2019). Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 8(1), 23. DOI: https://doi.org/10.1186/s13643-019-0942-7

Banwell, V., Sena, E.S. & Macleod, M.R. (2009). Systematic Review and Stratified Meta-analysis of the Efficacy of Interleukin-1 Receptor Antagonist in Animal Models of Stroke. Journal of Stroke and Cerebrovascular Diseases. 18(4), 269–276. DOI: https://doi.org/10.1016/j.jstrokecerebrovasdis.2008.11.009

Beller, E., Clark, J., Tsafnat, G., Adams, C., Diehl, H., Lund, H., Ouzzani, M., Thayer, K., Thomas, J., Turner, T., Xia, J., Robinson, K., Glasziou, P. & founding members of the ICASR group. (2018). Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 7(1), 77. DOI: https://doi.org/10.1186/s13643-018-0740-7

Bersani, C., Codagnone, J., David, L., Foiniotis, A., Galasso, G., Mancini, S., Michieletti, R., Orphanidou, C. & Pellegrino, M. (2022). Roadmap for actions on artificial intelligence for evidence management in risk assessment. EFSA Journal. 19(5), DOI: https://doi.org/10.2903/sp.efsa.2022.EN-7339

Bert, B., Heinl, C., Chmielewska, J., Schwarz, F., Grune, B., Hensel, A., Greiner, M. & Schönfelder, G. (2019). Refining animal research: The Animal Study Registry. PLoS Biology. 17(10), e3000463. DOI: https://doi.org/10.1371/journal.pbio.3000463

Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M. & Stewart, L. (2012). The nuts and bolts of PROSPERO: an international prospective register of systematic reviews. Systematic Reviews. 1, 2. DOI: https://doi.org/10.1186/2046-4053-1-2

Brennan, M.L., Arlt, S.P., Belshaw, Z., Buckley, L., Corah, L., Doit, H., Fajt, V.R., Grindlay, D.J.C., Moberly, H.K., Morrow, L.D., Stavisky, J. & White, C. (2020). Critically Appraised Topics (CATs) in Veterinary Medicine: Applying Evidence in Clinical Practice. Frontiers in Veterinary Science. 7, 314. DOI: https://doi.org/10.3389/fvets.2020.00314

Center for Open Science. (n.d.). OSF Registries. [online]. Available at: https://www.cos.io/products/osf-registries [Accessed 20 July 2023]

Centre for Evidence-based Veterinary Medicine. (2021). Veterinary Systematic Review (VetSRev) database (Version 2.0). [online]. Available at: https://vetsrev.nottingham.ac.uk [Accessed 20 July 2023]

Clark, J., Glasziou, P., Del Mar, C., Bannach-Brown, A., Stehlik, P. & Scott, A.M. (2020a). A full systematic review was completed in 2 weeks using automation tools: a case study. Journal of Clinical Epidemiology. 121, 81–90. DOI: https://doi.org/10.1016/j.jclinepi.2020.01.008

Clark, J.M., Sanders, S., Carter, M., Honeyman, D., Cleo, G., Auld, Y., Booth, D., Condron, P., Dalais, C., Bateup, S., Linthwaite, B., May, N., Munn, J., Ramsay, L., Rickett, K., Rutter, C., Smith, A., Sondergeld, P., Wallin, M., Jones, M. & Beller, E. (2020b). Improving the translation of search strategies using the polyglot search translator: a randomized controlled trial. Journal of the Medical Library Association. 108(2), 195. DOI: https://doi.org/10.5195%2Fjmla.2020.834

Collaborative Approach to Meta Analysis and Review of Animal Experimental Studies (CAMARADES). (n.d.). Automated Systematic Search Deduplicator (ASySD). [online]. Available at: https://camaradesuk.github.io/ASySD/ [Accessed 20 July 2023]

Collaborative Approach to Meta Analysis and Review of Animal Experimental Studies (CAMARADES) Berlin. Preclinical Systematic Review Wiki. [online]. Available at: http://camarades.de/ [Accessed 20 July 2023]

Cornell University Library. (n.d.). Evidence Synthesis Service. Systematic Review Decision Tree and Methodologies. [online]. Available at: https://cornell.box.com/s/9usdreu25kjkajkiwfeyykhpfne14alj [Accessed 20 July 2023]

Covidence. (n.d.). [online]. Available at: https://www.covidence.org [Accessed 20 July 2023]

de Vries, R.B.M., Wever, K.E., Avey, M.T., Stephens, M.L., Sena, E.S. & Leenaars, M. (2014). The Usefulness of Systematic Reviews of Animal Experiments for the Design of Preclinical and Clinical Studies. ILAR Journal. 55(3), 427–437. DOI: https://doi.org/10.1093/ilar/ilu043

DistillerSR. (n.d.). Systematic Review and Literature Review Software by DistillerSR. [online]. Available at: https://www.distillersr.com [Accessed 20 July 2023]

Fonseca, B. & O’Connor, A. (2021). Protocol for an updated Living Systematic Review of the observational studies reporting the association between health events and states and proximity to animal feeding operations. PRISMA-P: Item 1a, 1b, 3a; ROSES:Item 1, 2, 3. [online]. Available at: https://syreaf.org/wp-content/uploads/2022/05/Draft_Protocol_CAFO-3.pdf [Accessed 20 July 2023]

Grames, E.M., Stillman, A.N., Tingley, M.W. & Elphick, C.S. (2019). An automated approach to identifying search terms for systematic reviews using keyword co‐occurrence networks. Methods in Ecology and Evolution. 10(10), 1645–1654. DOI: https://doi.org/10.1111/2041-210X.13268

Grant, M.J. & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information and Libraries Journal. 26(2), 91–108. DOI: https://doi.org/10.1111/j.1471-1842.2009.00848.x

Grindlay, D.J.C., Brennan, M.L. & Dean, R.S. (2012). Searching the Veterinary Literature: A Comparison of the Coverage of Veterinary Journals by Nine Bibliographic Databases. Journal of Veterinary Medical Education. 39(4), 404–412. DOI: https://doi.org/10.3138/jvme.1111.109R

Haddaway, N.R., Bannach-Brown, A., Grainger, M.J., Hamilton, W.K., Hennessy, E. A., Keenan, C., Pritchard, C.C. & Stojanova, J. (2022). The evidence synthesis and meta-analysis in R conference (ESMARConf): levelling the playing field of conference accessibility and equitability. Systematic Reviews. 11(1), 113. DOI: https://doi.org/10.1186/s13643-022-01985-6

Haddaway, N.R., Grainger, M.J. & Gray, C.T. (2021). citationchaser: An R package and Shiny app for forward and backward citations chasing in academic searching. Zenodo. DOI: https://doi.org/5281/zenodo.4533747

Hair, K., Bahor, Z., Macleod, M., Liao, J., & Sena, E. S. (2021a). The Automated Systematic Search Deduplicator (ASySD): a rapid, open-source, interoperable tool to remove duplicate citations in biomedical systematic reviews. BioRxiv. DOI: https://doi.org/10.1101/2021.05.04.442412

Hair, K., Sena, E.S., Wilson, E., Currie, G., Macleod, Malcolm, Bahor, Z., Sena, C., Ayder, C., Liao, J., Ayder, E.T., Ghanawi, J., Tsang, A., Collins, A., Carstairs, A., Antar, S., Drax, K., Neves, K., Ottavi, T., Chow, Y.Y., Henry, D., Selli, C., Fofana, M., Rudnicki, M., Gabriel, B., Pearl, E.J., Kapoor, S.S., Baginskaite, J., Shevade, S., Chung, A., Przybylska, M.A., Henshall, D.E., Hajdu, K.L., McCann, S., Sutherland, C., Alves, T.L., Blacow, R., Hood, R.J., Soliman, N., Harris, A., Swift, S.L., Rackoll, T., Percie du Sert, N., Waldron, F., Macleod, Magnus, Moulson, R., Low, J.W., Rannikmae, K., Miller, K., Bannach-Brown, A., Kerr, F., Hébert, H.L., Gregory, S., Shaw, I.W., Christides, A., Alawady, M., Hillary, R., Clark, A., Jayasuriya, Natasha, Sives, S., Nazzal, A., Jayasuriya, N., Sewell, M., Bertani, R., Fielding, H. & Drury, B. (2021b). Building a Systematic Online Living Evidence Summary of COVID-19 Research. Journal of EAHIL. 17(2), 21–26. DOI: https://doi.org/10.32384/jeahil17465

Hooijmans, C.R., Rovers, M.M., de Vries, R.B.M., Leenaars, M., Ritskes-Hoitinga, M. & Langendam, M.W. (2014). SYRCLE’s risk of bias tool for animal studies. BMC Medical Research Methodology. 14, 43. DOI: https://doi.org/10.1186/1471-2288-14-43

Institute for Evidence-Based Healthcare. Bond University. (n.d.). Systematic Review Accelerator SpiderCite. [online]. Available at: https://www.sr-accelerator.com/#/spidercite [Accessed 20 July 2023]

LaFollette, M.R., O’Haire, M.E., Cloutier, S., Blankenberger, W.B. & Gaskill, B.N. (2017). Rat tickling: A systematic review of applications, outcomes, and moderators. PLoS One. 12(4), e0175320. DOI: https://doi.org/10.1371/journal.pone.0175320

Manlove, K.R., Walker, J.G., Craft, M.E., Huyvaert, K.P., Joseph, M.B., Miller, R.S., Nol, P., Patyk, K.A., O’Brien, D., Walsh, D.P. & Cross, P.C. (2016). “One Health” or Three? Publication Silos Among the One Health Disciplines. PLoS Biology. 14(4), e1002448. DOI: https://doi.org/10.1371/journal.pbio.1002448

McCann, S.K., Cramond, F., Macleod, M.R. & Sena, E.S. (2016). Systematic Review and Meta-Analysis of the Efficacy of Interleukin-1 Receptor Antagonist in Animal Models of Stroke: an Update. Translational Stroke Research. 7(5), 395–406. DOI: https://doi.org/10.1007/s12975-016-0489-z

Menagerie of Reporting Guidelines Involving Animals (MERIDIAN) Network. (2023). [online]. Available at: https://meridian-network.org [Accessed 3 August 2023]

Menon, J.M.L., Ritskes-Hoitinga, M., Pound, P. & van Oort, E. (2021). The impact of conducting preclinical systematic reviews on researchers and their research: A mixed method case study. PLoS One. 16(2), e0260619. DOI: https://doi.org/10.1371/journal.pone.0260619

Moore, S.A., McCleary-Wheeler, A., Coates, J.R., Olby, N. & London, C. (2021). A CTSA One Health Alliance (COHA) survey of clinical trial infrastructure in North American veterinary institutions. BMC Veterinary Research. 17(1), 90. DOI: https://doi.org/10.1186/s12917-021-02795-z

Murphey, E.D. (2019). The AVMA Animal Health Studies Database. Topics in Companion Animal Medicine. 37, 100361. DOI: https://doi.org/10.1016/j.tcam.2019.100361

Norecopa. (n.d.). [online]. Available at: https://norecopa.no/ [Accessed 20 July 2023]

O’Connor, A. & Sargeant, J. (2015). Research synthesis in veterinary science: Narrative reviews, systematic reviews and meta-analysis. Veterinary Journal. 206(3), 261–267. DOI: https://doi.org/10.1016/j.tvjl.2015.08.025

O’Connor, A.M., Totton, S.C., Cullen, J.N., Ramezani, M., Kalivarapu, V., Yuan, C. & Gilbert, S.B. (2018). The study design elements employed by researchers in preclinical animal experiments from two research domains and implications for automation of systematic reviews. PLoS One. 13(6), e0199441. DOI: https://doi.org/10.1371/journal.pone.0199441

Page, J.R., Moberly, H.K., Youngen, G.K. & Hamel, B.J. (2014). Exploring the Veterinary Literature: A Bibliometric Methodology for Identifying Interdisciplinary and Collaborative Publications. College & Research Libraries. 75(5), 664–683. DOI: https://doi.org/10.5860/crl.75.5.664

Page, M.J., McKenzie, J.E., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J.M., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E.W., Mayo-Wilson, E., McDonald, S., McGuinness, L.A. & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery. 88, 105906. DOI: https://doi.org/10.1016/j.ijsu.2021.105906

Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M.T., Baker, M., Browne, W.J., Clark, A., Cuthill, I.C., Dirnagl, U., Emerson, M., Garner, P., Holgate, S.T., Howells, D.W., Karp, N.A., Lazic, S.E., Lidster, K., MacCallum, C.J., Macleod, M., Pearl, E.J., Petersen, O., Rawle, F., Peynolds, P., Rooney, K., Sena, E.S., Silberberg, S.D., Steckler, T. & Wurbel, H. (2020). The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research. PLoS Biology. 18(7), e3000410. DOI: https://doi.org/10.1371/journal.pbio.3000410

Rayyan. [online]. Available at: https://www.rayyan.ai [Accessed 20 July 2023]

Rethlefsen, M.L., Kirtley, S., Waffenschmidt, S., Ayala, A.P., Moher, D., Page, M.J., Koffel, J.B., & PRISMA-S Group. (2021). PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews. Systematic Reviews. 10(1), 1–19. DOI: https://doi.org/10.1186/s13643-020-01542-z

RCVS Knowledge. (n.d.[a]). Evidence-based Veterinary Medicine Learning. [online]. Available at: https://learn.rcvsknowledge.org [Accessed 20 July 2023]

RCVS Knowledge. (n.d.[b]). Knowledge Summaries. [online]. Available at: https://knowledge.rcvs.org.uk/evidence-based-veterinary-medicine/veterinary-evidence/#knowledgesummaries [Accessed 20 July 2023]

Sargeant, J.M. & O’Connor, A.M. (2014). Introduction to Systematic Reviews in Animal Agriculture and Veterinary Medicine. Zoonoses and Public Health. 61(51), 3–9. DOI: https://doi.org/10.1111/zph.12128

Sena, E.S., Currie, G.L., McCann, S.K., Macleod, M.R. & Howells, D.W. (2014). Systematic Reviews and Meta-Analysis of Preclinical Studies: Why Perform Them and How to Appraise Them Critically. Journal of Cerebral Blood Flow & Metabolis 34(5), 737–742. DOI: https://doi.org/10.1038/jcbfm.2014.28

Smith, A.J., Clutton, R.E., Lilley, E., Hansen, K.E.A. & Brattelid, T. (2018). PREPARE: guidelines for planning animal research and testing. Laboratory Animals. 52(2), 135–141. DOI: https://doi.org/10.1177/0023677217724823

Sutton, A., Clowes, M., Preston, L. & Booth, A. (2019). Meeting the review family: exploring review types and associated information retrieval requirements. Health Information & Libraries Journal. 36(3), 202–222. DOI: https://doi.org/10.1111/hir.12276

Systematic Review Center for Laboratory animal Experimentation (SYRCLE). (2023). Course on preclinical systematic reviews of animal studies. [online]. Available at: https://learn.etplas.eu/courses/syrcle-course-on-systematic-reviews-of-animal-studies/ [Accessed 20 July 2023]

Systematic Reviews for Animals and Food (SYREAF). (2023). [online]. Available at: https://syreaf.org [Accessed 20 July 2023]

The University of Edinburgh. Collaborative Approach to Meta Analysis and Review of Animal Experimental Studies (CAMARADES). [online]. Available at: https://www.ed.ac.uk/clinical-brain-sciences/research/camarades [Accessed 20 July 2023]

Torrence, M.E. (ed). (2014). Special Issue: Systematic Reviews and Meta-Analysis in Animal Agriculture and Veterinary Medicine. Zoonoses and Public Health 61(S1). [online]. Available at: https://onlinelibrary.wiley.com/toc/18632378/2014/61/S1 [Accessed 20 July 2023]

UK Centre for Reviews and Dissemination (CRD) at the University of York, PROSPERO for animal studies. [online]. Available at: https://www.crd.york.ac.uk/prospero/documents/Guidance for registering animal studies.pdf [Accessed 20 July 2023]

UK EQUATOR Centre. (2019). Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network. Available at: https://www.equator-network.org [Accessed 20 July 2023]

University of Nottingham. (2023). Best Bets for Vets. [online]. Available at: https://bestbetsforvets.org/ [Accessed 20 July 2023]

US National Library of Medicine. (2000). ClinicalTrials.gov. [online]. Available at: https://www.clinicaltrials.gov/ [Accessed 20 July 2023]

van der Naald, M., Chamuleau, S. A. J., Menon, J. M. L., de Leeuw, W., de Haan, J., Duncker, D. J. & Wever, K. E. (2022). Preregistration of animal research protocols: development and 3-year overview of preclinicaltrials.eu. BMJ Open Science. 6(1), e100259. DOI: https://doi.org/10.1136/bmjos-2021-100259

Veterinary Evidence. (n.d.[a]). How to Write a Knowledge Summary. [online]. Available at: https://veterinaryevidence.org/index.php/ve/How-to-write-a-knowledge-summary-guide [Accessed 20 July 2023]

Veterinary Evidence. (n.d.[b]). Writing the Clinical Bottom Line. [online]. Available at: https://veterinaryevidence.org/index.php/ve/writing-the-clinical-bottom-line [Accessed 20 July 2023]

Wareham, K. J., Hyde, R. M., Grindlay, D., Brennan, M. L. & Dean, R. S. (2017). Sponsorship bias and quality of randomised controlled trials in veterinary medicine. BMC Veterinary Research. 13, 1–10. DOI: https://doi.org/10.1186/s12917-017-1146-9

Westgate, M. & Haddaway, N. (2017). Evidence Synthesis Hackathon. [online]. Available at: https://www.eshackathon.org/ [Accessed 20 July 2023]

Wever, K.E., Menting, T.P., Rovers, M., van der Vliet, J.A., Rongen, G.A., Masereeuw, R., Ritskes-Hoitinga, M., Hooijmans, C.R. & Warlé, M. (2012). Ischemic Preconditioning in the Animal Kidney, a Systematic Review and Meta-Analysis. PLoS One. 7(2), e32296. DOI: https://doi.org/10.1371/journal.pone.0032296

Whitty, C.J.M. & Collet-Fenson, L.B. (2021). Formal and informal science advice in emergencies: COVID-19 in the UK. Interface Focus. 11(6), 20210059. DOI: https://doi.org/10.1098/rsfs.2021.0059

Most read articles by the same author(s)