An Exploratory Study Investigating the Non-Clinical Benefits of Evidence-Based Veterinary Medicine
Elizabeth L. Jackson BAg (Hons), MBA, PhD, SFHEA1*
1The Royal Veterinary College, Hawkshead Lane, North Mymms, Hatfield, Hertfordshire, AL9 7TA, United Kingdom
*Corresponding Author (eljackson@rvc.ac.uk)
Vol 2, Issue 2 (2017)
Published: 30 May 2017
Reviewed by: Dr Sebastian Arlt and Virginia Fajt (DVM, PhD, DACVCP)
DOI: 10.18849/VE.V2I2.93
Objective: As little prior research exists about the non-clinical benefits of evidence-based veterinary medicine (EBVM), this exploratory study was conducted to identify non-clinical benefits of EBVM to veterinary practices, as well as highlighting the barriers to further implementation, and ways to overcome them.
Background: A PICO-based literature review (Hauser and Jackson, 2016) was conducted to establish current knowledge about the non-clinical benefits of EBVM. It found that while there are some papers suggesting a link between the practice of EBVM and better non-clinical benefits such as client satisfaction and client retention, a single study, focusing on the non-clinical benefits of EBVM, had yet to be conducted.
Evidentiary value: This exploratory study provides a solid basis for the further development of a confirmatory study of the themes identified in the interviews. The impact on practice from our findings is significant as it details the key areas where the use of EBVM can yield commercial benefits from the perspective of a group of EBVM experts via interview. It is entirely possible that international veterinary environments which mirror that of the UK will find this research beneficial.
Methods: Due to the paucity of data about the non-clinical benefits of EBVM, an exploratory, qualitative approach was taken to this research in order to build a platform for further confirmatory, quantitative investigation (Zikmund, 2003). In February and March 2016 interviews with 16 RCVS Knowledge Group chairs[1] were conducted. The interview guide contained broad, open-ended questions to explore existing tacit knowledge about the non-commercial benefits of EBVM. The interviews were audio recorded and transcribed verbatim and subsequently analysed using NVivo 11 software.
Results: This qualitative enquiry showed that the key areas where the use of EBVM can yield non-clinical benefits are through increased client satisfaction and retention, improved reputation and confidence of the veterinarian, as well as employee engagement. In order to yield these benefits the two main barriers, time and resources, need to be overcome.
Conclusion: The themes highlighted in this paper provide a solid, real world base for further, quantitative study of the non-clinical benefits of practising EBVM.
Application: The results of this research are applicable to practicing veterinarians, nurses and other practice staff. It is clear that practising EBVM not only leads to better clinical outcomes, but can also result in commercial benefits, such as better client retention and employee engagement
[1] Chairs of RVCS Knowledge Groups are recognised leaders in the field of EBVM and hold these invited positions within the UK’s Royal College of Veterinary Surgeons.
Little research exists on the non-clinical benefits of EBVM. While the clinical benefits have been fairly well documented, the business aspect of evidence-based veterinary medicine has not. In a situation such as this, Zikmund (2003) suggests an exploratory approach to help inform a more rigorous, conclusive study when there is a need for generating new ideas. Exploratory research is often qualitative in nature and thus does not attempt to provide conclusive answers to research questions. Rather, it allows researchers to gain access to cultural norms and attitudes that are often too complex for confirmatory, quantitative enquiry. As such, sample size is often very small in comparison to quantitative studies because qualitative research focuses on the depth of understanding cultural knowledge, rather than how many or what kinds of people hold the knowledge. McCracken (1988, p. 17) summarises this methodological paradigm perfectly: “…qualitative research does not survey the terrain, it mines it. It is, in other words, much more intensive than extensive in its objectives”.
A PICO-based literature review (Hauser and Jackson, 2016) was conducted to establish current knowledge about the non-clinical benefits of EBVM and it concluded that while there are some papers suggesting a link between the practice of EBVM and better non-clinical benefits such as client satisfaction and client retention, a single study, focusing on the non-clinical benefits of EBVM, had yet to be produced.
With the limited knowledge generated from this activity, this study was designed to gain further understanding of the non-clinical benefits of EBVM. As recommended by Yin (2014), an interview guide containing broad, open-ended questions was developed to explore four key themes that emerged from the sparse existing knowledge: the definition of EBVM, the benefits of EBVM, the barriers to the adoption of EBVM and ideas for exploring the broader adoption of EBVM.
This study forms the first phase of a two-part, mixed-method research project that will establish the non-clinical benefits of EBVM. This first phase is a qualitative enquiry essential for determining the under-studied area of the non-clinical benefits of evidence-based medicine. Zikmund (2003) emphasises that this first, exploratory phase of a mixed-method project is particularly important when addressing under-studied areas of research as the discovery of new ideas is paramount in developing a well-informed confirmatory study.
The secondary aim of this research was to use the results of the interviews to create a survey that will empirically test the tacit knowledge documented in this paper. As such it was important that the interview participants were experienced supporters of EBVM and were able to share their intimate knowledge about this way of practicing veterinary medicine. With this in mind, the interview participants were recruited from the list of chairs of the RCVS Knowledge Groups. Chairs of RVCS Knowledge Groups are recognised leaders in the field of EBVM and hold these invited positions within the UK’s Royal College of Veterinary Surgeons. Bogner, Littig and Menz (2009) discuss the virtues of conducting expert interviews in exploratory research. These authors suggest that efficiencies in time and knowledge are gained when qualitative data are collected from experts as they share a common background and relevance of the topic with the researcher so no time is lost with superfluous background explanations.
As one of the aims of this research was to use the results of the interviews to create a survey for the second part of this study, it was important that the interview participants were champions of EBVM and were able to share their success stories about this way of practicing veterinary medicine. With this in mind, the interview participants were recruited from the list of chairs of the RCVS Knowledge Groups.
The interview participants were approached via e-mail which explained the purpose of the project and the ethics of the data collection process (i.e. participation in the research is entirely voluntary, despite the interviews being audio recorded all data would be anonymised and anyone was free to withdraw from the research at any time without fear of retribution). Two pilot interviews were conducted prior to the formal data collection and yielded no requirements for the data collection instrument or the research setting to substantively change. Interviews were conducted in person and via Skype in February and March, 2016. The interviews were audio recorded and transcribed verbatim and subsequently analysed using NVivo 11 software.
Interviewees were asked about their views on financial, commercial and business impacts of EBVM on the individual business. While financial benefits only include monetary aspects such as profit and loss of a practice, business and commercial benefits include a wider spectrum of benefits such as client satisfaction, employee engagement and reputation. These benefits can have a major impact on the success of a business despite being difficult to measure. Wider economic benefits, that include potential impacts on other industries, such as increased revenue in the meat processing industry due to better veterinary practice, were outside the scope of this study.
The interview guide (available as a supplementary file), the information sheet about the project and the consent form to be signed by research participants was scrutinised and approved by the Royal Veterinary College’s Clinical Research Ethical Review Board (Approval #2015 1457).
With ethical approval from the Royal Veterinary College’s Clinical Research Ethical Review Board (URN 2015 1457), a total of 16 interviews were conducted with people who are dedicated to the practice of veterinary medicine through the principles of EBVM. Participants were self-selecting as their primary reason for contributing to this research was their dedication, enthusiasm and experience of practicing EBVM. Table 1 provides a summary profile of the research participants in terms of their main area of veterinary focus, age, gender, year graduated and whether or not they are a registered veterinarian. A seventieth EBVM Knowledge Chair was approached by declined to participate in the data collection because he considered that the research questions were being asked too prematurely for the current state of EBVM in UK veterinary practice.
Almost all participants were veterinarians, however, the interviews also included a veterinary technician and an animal nutritionist. Interviewees have a great range of focus and experience in veterinary medicine. Seven participants had some link to academia, while other participants worked in private practice, corporate practice, a government agency, or an NGO. While participants were purposefully not selected to be representative of the industry, it was ensured that the interviews were conducted with representatives from different fields of work, including: small animal, farm animal, equine, lab animal and mixed practices (which included exotics).
The following is a thematic analysis of the interview data. Many qualitative researchers follow the classic advice of Glaser and Strauss (1967) and take a grounded theory approach by allowing themes to naturally emerge from the data. Due to the specific nature of this research, we have been guided by the advice of Miles and Huberman (1994) who advocate using a ‘start list’ for generating themes. The ‘start list’ for this research was based on the research questions which were, of course, developed from existing literature (discussed in the Introduction to this paper). As such, the ‘start list’ was a loose list of themes that were grounded in the research questions.
The ethos and presentation of qualitative research is often criticised as being unsystematic, impressionistic, sloppy and unsophisticated (Glaser and Strauss, 1967). Similarly, Creswell (2009) discusses the erroneous sentiment of ‘generalisability’ of qualitative research. He goes to some lengths to explain that the virtue of qualitative research lies in the multidimensional description and development of themes in the specific context of the research setting and how particularity, rather than generalisability is the hallmark of qualitative research.
For presenting the results of the thematic analysis, we look to the advice of McCracken (1988) who discusses the method of inquiry associated with long interviews. He talks about the rich and useful knowledge that can be gained from the researcher providing sample quotes to capture the ideas and concerns of participants. The overall aim of this reporting method is for the abundant data to speak to the reader and provide a guided tour of the participants’ thoughts and opinions on each theme.
In order to properly set the scene of EBVM for the research participants, it was necessary to first determine their understanding of the concept so participants were asked to define EBVM. Participants generally concurred that EBVM is “practicing medicine in a way that is supported by published evidence” (Participant 11) and is an effort for practitioners to separate themselves from practicing veterinary medicine on the way they were taught as opposed to making clinical decisions based on high-quality published data and published evidence. Support for these conclusions comes from the following participants:
While most participants were clear about the definition of EBVM, some participants extended the definition to include ensuring that the quality of evidence was sufficient to make good clinical decisions:
Discussing the non-clinical benefits of EBVM initially proved difficult for participants as their immediate response was that the adoption of EBVM results in clinical success: it leads to an improved standard of care. Deeper questioning lead to further discussion about client satisfaction, client retention, improved reputation, confidence and a feel-good factor amongst practitioners.
The best evidence about the commercial benefits for EBVM that emerged from the data was from Participant 15 who said: “it's demonstrated that you know we're seeing increased sales of those things through the use of evidence based medicine”. Participants largely agreed that practising EBVM will give a veterinary practice competitive advantage:
I. Client satisfaction
An improvement in client satisfaction was clear from a number of perspectives:
II. Client retention
While the ideas of client satisfaction and client retention are closely linked in the data, there was sufficient discussion to separate these as disparate concepts: client satisfaction being a short-term yet positive outcome from the provision of good clinical practice while client retention is focused on the longer-term positive externality of a trusting relationship being developed between client and veterinarian whereby the veterinarian is more than a valued service provider. The veterinarian takes on a more sophisticated relationship than an expert for hire and assumes the role of the client’s trusted partner in providing long-term veterinary care:
III. Reputation
Another closely-related issue to client satisfaction and retention is reputation. This emerged as a key theme from the data, which presented itself in a number of different ways:
IV. Confidence
Discussions on the increased standard of care attributed to EBVM developed into insights into client satisfaction, client retention and reputation but most unexpectedly a lot of evidence emerged about how vets’ confidence was developed from the application of EBVM and how it was a valuable opportunity to stimulate engaging, challenging discussions with colleagues. In terms of the non-clinical benefits of EBVM discussed for this research, the confidence that EBVM builds amongst vets and the satisfaction they gain from practicing good medicine was by far the most discussed theme within the data.
Satisfaction was a key word often used: “I think, in terms of job satisfaction, you get a lot more out of it because you don’t feel like you’ve gone to work and winged it…You feel like you’re …doing clinical research, you feel like you’re contributing to the wider port of knowledge. You feel like you’re actually - you’re doing something to help improve the profession you work in so it’s got a personal satisfaction element to it as well…/… And the process I think makes everyone a lot happier because, if you like, there’s stuff to support what they’re doing.” (Participant 11); “I think it gives me individual satisfaction that you're hopefully doing a good job and you are providing the 'best', in inverted commas, service you can do under the circumstances.” (Participant 16).
Employee engagement emerged as another key theme-based on the ideas that EBVM creates debate and develops an intellectual challenge for veterinary professionals who are motivated by constantly being challenged: “by getting people together and sharing the ideas and being collaborative about it, then you know then we've been able to drive enthusiasm amongst ourselves and the barriers can fall away really, once you do that.” (Participant 15).; “When you do evidence based medicine you become more invested in what you're doing and when you become more invested in what you're doing, you become more passionate about what you're doing. So in an intangible way, I see evidence based medicine, just being a huge asset in terms of confidence and, ownership or passion in the field…/…I mean from my own personal perspective, it has certainly invigorated my passion for the field.” (Participant 13); “And another perk is to share the experience. If you do evidence-based [sic] you can share the experience and you can get the best experience in this regard.” (Participant 8).
Clinical decision making and the confidence that comes with good decision making were key issues raised; as was the issue of minimising waste generated by bad decision making: “I think it gives more confidence in clinical decision making, which everybody wants, right?” (Participant 13); “[you] have more confidence in what you’re doing…you’ve not got that internal doubt or panic of is what I’m doing the right thing to do because you always have that no matter how many times you do something.” (Participant 11); “It's personal, more than anything else. I can actually go to bed with a hand on my heart and say, I applied the best evidence as far as I am aware, because … the evidence that I have today, right now, means I can hand on heart, go to sleep and tell them I did the best possible job.” (Participant 7).
The ability to deal with clients, particularly, difficult questions from clients emerged as an issue that built confidence: “…EBVM may form part of your defence” (Participant 2); “the client, they think they’re so much better informed so they can access doctor Google, so I think you’ve got to be able to justify what you’re doing in a constructive way, in a proven” (Participant 4); “I think when challenged about the reasons why we do things, then we are able to support the reason why we do things with evidence” (Participant 15).
3. Barriers to the wider adoption of EBVM
The two major barriers that were cited to the wider adoption of EBVM were time and resources. “I think the two big barriers are time, and access to evidence.” (Participant 16) While participants recognised the long-term benefits of EBVM (e.g. developing staff knowledge and their confidence, knowing that clients are being provided with the best care for their animal(s)), there was much discussion around the idea that EBVM is a long-game that is resource-intensive and time-consuming in the short term.
Time was discussed in terms of the time required to investigate the evidence based for individual cases:
Discussing the evidence with colleagues was discussed in a positive light for sharing information and engaging with like-minded people but it did also involve taking time away from clinical practice: “I think the time is probably the next biggest barrier. People are overstretched and overworked and feel that it's just yet another thing that they have to do.” (Participant 15).
There was an overwhelming response from participants that there is a paucity of publicly-available resources for truly adopting EBVM in practice. Upon digging deeper into this theme, there is evidence to suggest that access to literature may not actually be the true problem. The problem may actually lie in vets’ readiness and willingness to access the literature in that actually sourcing literature to make clinical decisions is not at the top of their minds:
“The industry culture is the enemy of innovation and it’s the enemy of evidence-based research and studies” This evidence from Participant 1 summarises another theme that emerged from the data about the barriers to adopting EBVM. To start with, some participants discussed their perceptions of the profession’s current reliance on ‘eminence rather than evidence’:
There also appears to be a problem with the quality of evidence available to practitioners in terms of depth of coverage, validity of information and quality of information:
An issue associated with industry culture is the lack of awareness by clients, their lack of demand for EBVM and some owners’ demand for ‘quick-fix, low-cost solutions’:
The final issue that emerged from the data about barriers to the adoption of EBVM is the attitudes of educational institutions. The foremost issue here related to veterinary schools’ lack of attention to EBVM but the issue of teaching and assessing these skills was also raised:
4. Increasing the adoption of EBVM
The two most prominent issues to emerge from the data about increasing the adoption of EBVM are that 1) EBVM needs management support: journal clubs, forums, training opportunities, CPD, time for reading, all members of the vet team need to be included, senior vets as role models, vet techs/nurses need to be involved in EBVM (not just vets) and 2) EBVM needs investment: funded research projects, support services, journal access.
In terms of management support for EBVM, the interview data showed support for the heightened level of employee engagement that came about from vets and vet nurses who are given the time and intellectual freedom to practice EBVM rather than being trapped under a heavy case load. Further evidence is provided by these quotes:
As for increased investment in EBVM, the following data showed demand for opportunities to teach practitioners about considering and understanding high-quality evidence, how to discuss high-quality evidence with important stakeholders and that using EBVM is easier over time as it becomes habit:
Participants 3 and 12, respectively, commented on the need for open-access publications: “So this is where we get into open publication, the whole concept of open access science, and I think that's another barrier, or another way to break down the barriers would be to have more open access.” and “I think scientific publishing is going to have to change. It's going to, I mean it's changing already right with open access, and you know more and more is open access, more and more is free” which is linked to comments made by Participant 2: “It's there, but you know you want to bring people together, and I think that's probably the key thing, is that if we find to make bridging university, like academia and practice gap, people will start seeing more relevant meaning to it…/…The way barriers can be overcome fundamentally is communication and not protectionism.”; “I think that there needs to be some acknowledgment, there might need to be some financial support or expertise support that go into groups and practices and help them do that. I think it’s unrealistic to expect practitioners to do that.” (Participant 4)
Participant 5 provided some constructive comments to improve the adoption of EBVM: “spread it out a bit, I mean having two major conferences a year at the moment. You should perhaps take it smaller, you've probably done a bit of this I think, perhaps going out to local veterinary societies, but maybe even contact larger practices in an area where they've perhaps got, you know we've got a room downstairs, our waiting room we use as a meeting room sometimes for the vets from other practices…./…Somebody from Nottingham or from the university, committee of EBVM should come and perhaps, talk about it a bit more, so that everybody knows about it, the nurses and everybody as well.”. Participant 4 provided another interesting idea: “Well I tell you what the college needs to do, they need to buy into the fact that you can do a residency in practice, because this would fit a residency so well. That’s what they need to do. It doesn’t need to be hospital-based or university-based. It can be in practice.”
This research yielded themes that are of considerable importance to the veterinary professions at present and that practicing EBVM may derive greater benefits than superior clinical outcomes. McCracken (2013) suggested that financial and operational efficiencies are outcomes of evidence based medicine (EBM) in the human world but these did not emerge as themes from the data. More in-keeping with the logic of Caldwell (2001) who advocates the convergence of EBM healthcare systems objectives, we found that practicing EBVM is not restricted to strong clinical practice but is also related to greater client satisfaction in the short term, and to long-term client retention. However, it was also highlighted that often clients are not aware of EBVM or prefer a ‘quick fix’ solution. Another closely-related issue to client satisfaction and retention is reputation. This emerged as a key theme from the data, which presented itself in a number of different ways including the way a better reputation is gained by a different approach to veterinary medicine and performing reliable procedures. These themes essentially link to professionalism and professional identity. One of the key constructs of professionalism is the professional’s ability to communicate. Previous studies have discussed the importance of communicating with clients to develop sustainable business practice (Backynsky et al., 2013) and managing client expectations (Mossop et al., 2015). The present research adds to this body of knowledge by providing EBVM as another tool for enhancing client satisfaction and enabling client retention.
By far the most discussed theme that emerged from the data, was how EBVM influences vets’ confidence and the satisfaction they gain from practicing good medicine. The practice of EBVM was seen as a valuable opportunity to stimulate engaging, challenging discussions with colleagues. Similarly, employee engagement emerged as another important theme based on the ideas that EBVM creates debate and develops an intellectual challenge for veterinary professionals. This is a particularly important finding of the research due to the current climate of the UK veterinary professions. The Royal College of Veterinary Surgeons and the British Veterinary Association have collaborated in the Vet Futures initiative (http://www.vetfutures.org.uk/). Research findings of this initiative have outlined several key ambitions and recommendations for the profession, two of which are: 1) “confident, resilient, healthy and well-supported [professionals]” and 2) “a broad range of diverse and rewarding career paths” (Vet Futures, 2015, p. 4). The present research demonstrates that practicing of EBVM could be one of the avenues the profession could pursue in its efforts to ensure its people are well-supported and work in interesting, developing careers. Similarly, VN Futures (2016) discusses some of the causal factors of stress in the veterinary professions and cites “professional isolation” as one of the reasons why people in the veterinary professions are so stressed. Once again, the social and developmental aspects of practicing EBVM that emerged from the present research could offer an important opportunity for relieving this pressure point.
A theme to recently emerge from the veterinary professionalism literature is professional identity. The development of professional identity starts with the understanding of professionalism and under-lying foundations of professionalism are the ability to balance multiple responsibilities and manage professional challenges (Armitage-Chan, Maddison & May, 2015). Balancing multiple responsibilities involves engaging with different parties both internal and external to the veterinary environment who, managing professional challenges, relates to controlling work/life balance and responses to difficult or emotional clients. Evidence from the present research suggests that vets’ ability to deal with the increasing expectations of clients, achieving goals through team performance, and gaining confidence from practicing good veterinary medicine could be yet another benefit of EBVM to the audience interested in professional identity formation.
One of the main limitations of this study was that there were a number of important general issues that also emerged about the non-clinical benefits of EBVM that did not suitably fit into the results of the thematic analysis of interview data. One of the RCVS Knowledge Chairs who was invited to participate in this research declined because he considered that it was far too early to attempt to quantify the non-clinical benefits of EBVM; similarly, one participant could not see a direct link between practising EBVM and a direct business advantage.
A further limitation was that the increased standard of care was the most intuitive response participants gave when discussing EBVM, and it was at times challenging to move the discussion to the non-clinical benefits. However, through further questioning far more detailed themes emerged about clients, practice reputation and staff confidence.
We take a pragmatic philosophical stand point to this research and acknowledge that this exploration of expert opinions of EBVM is not where this enquiry terminates. This qualitative phase of the research has allowed for the rich and in-depth exploration of key stakeholder perceptions on which we can now use as a platform for confirmation and explanation of the non-clinical benefits of EBVM in a survey of the professions; that is, empirically testing the theories that were grounded in our research questions. This pragmatic, pluralist approach is best described as mixed-method research (Johnson & Onwuegbuzie, 2004) which rejects Howe’s (1988) incompatibility thesis that the quantitative and qualitative methodologies can never be combined. In summary, this study forms the first phase of a two-part, mixed-method research to establish the non-clinical benefits of EBVM. From the findings of this explorative study a survey will be created that will empirically test the knowledge documented in this paper.
Acknowledgments: We would like to thank RCVS Knowledge for its generous support of this project, our Co-investigator: Graham Milligan MRCVS and all the interview and survey participants
Funding: RCVS Knowledge grants.
Competing interests: There are no areas of conflicting interest associated with this work.
All the supplementary files are available here.
Intellectual Property Rights
Authors of articles submitted to RCVS Knowledge for publication will retain copyright in their work, but will be required to grant to RCVS Knowledge an exclusive licence of the rights of copyright in the materials including but not limited to the right to publish, re-publish, transmit, sell, distribute and otherwise use the materials in all languages and all media throughout the world, and to licence or permit others to do so.
Authors will be required to complete a licence for publication form, and will in return retain certain rights as detailed on the form.