Showing posts with label evidenced based medicine. Show all posts
Showing posts with label evidenced based medicine. Show all posts

Friday, July 15, 2016

What is evidence based practice?

Evidence based medicine, evidence based practice, EVM, EBP
What is evidence based medicine and what does evidence based practice look like? Bosca is searching here for evidence of snacks.

What does evidence based medicine look like in practice? This was one of the questions explored by Dr Marnie Brennan, Deputy Director of the Centre for Evidence-based Veterinary Medicine (EVBM or EVM) and Assistant Professor in Epidemiology at Nottingham University, in Sydney this week.

Dr Brennan defines EVM as “the use of scientific (peer-reviewed) evidence, clinical expertise, owner and patient circumstances together”. Her analogy is that evidence is like a pair of glasses – if you put them on they may clarify things, but not always – so we sometimes need to put them on and take them off again.

We need to ask ourselves five questions:
  1. What is the question I am trying to answer? What do we not know?
  2. How do I find this evidence – where do I go? Databases? Journals?
  3. How do I work out if its any good? Can I trust this material enough to use it?
  4. Is it relevant to my practice? Relevant to this case?
  5. How did I do? What were the outcomes? Was this approach better or worse than the standard approach?

The big barriers to evidence-based practice (EBP) are time, a concern by some that it robs them of clinical autonomy (it doesn’t – we still need to exercise judgement), a concern that EVM yields a one-size-fits-all protocol (it can’t), bias in the types of evidence available (some research is more readily funded than other research) and concerns that evidence in veterinary medicine is generally non-existent or poor. But in the words of evidence-based veterinary dermatologist Hal Williams, “It’s better tolight a candle than curse the darkness.” (Actually those words are an old proverb but we like their application in veterinary dermatology, and to life in general).

So what does an EVP look like? This was the topic of much of our discussion, but our group agreed it would use
  • Some sort of clinical audit/benchmarking including analysis of case outcomes
  • Lots of continuing professional development
  • Case discussions
  • Journal clubs (effective journal clubs using structured worksheets)
  • Development of evidence-based guidelines/protocols
  • Review of same

Dr Brennan pointed out some great EVP resources available online, including Best Bets for Vets or this one on evidence based guidelines on cardiopulmonary resuscitation for vets which describes the process of developing these. 

Many veterinarians are using EVM without badging it as such, but it would be great to see these resources developed further and used widely, and more measurement of outcomes.


You can be part of the process by contributing to international research. Dr Brennan is working with postdoctoral researcher Dr Natalie Robinson to interview owners and veterinarians about booster vaccine consults. To participate, visit www.surveymonkey.co.uk/r/boostervaccinations - and remember this is for vets or clients. It doesn't take long (maybe 1/3 of a cup of tea worth of time?).

Thursday, April 7, 2016

What is the therapeutic illusion?

Sphinx
Some hairless cats I have been hanging out with...

Last week a colleague sent me a thought-provoking article about the therapeutic illusion in the field of human medicine.

The therapeutic illusion is related to a more generalised illusion – the illusion of control. It’s a human tendency to infer causality where none exists. For example, gamblers routinely overestimate the control they have over outcomes. Volunteers in experiments who were asked to press a button to get a panel to light up felt that they had cracked the code once it did, even though the outcome was random. Human beings, in other words, have a tendency to overestimate the impact of their actions.

The therapeutic illusion is the illusion of control applied to treatment modalities. And physicians suffer from it too. So they overestimate the impact of treatment of conditions like back pain and cancer.

The illusion is reinforced by confirmation bias – where we selectively look for evidence that supports our existing beliefs.

It’s not always a BAD thing. The illusion may increase confidence of physicians which can rub off on patients and other health care providers. And humans in general are more motivated to act if they believe their actions matter.

But the therapeutic illusion can lead to inaccuracies in assessing the efficacy of a particular treatment. And the author of the paper is concerned that the therapeutic illusion may lead to over-treatment.

So in a veterinary setting, for example, it is possible, in some cases, for some animals to get better in spite of – not because of treatment. Or because of one component of treatment and not another. But it can be hard for us to see this. 

For example, this week I spoke to some clients whose dog had cancer. A number of treatments were performed including surgery, antibiotics, anti-nausea medication and a novel drug therapy – all administered or at least initiated on the same day. The owners swore that the novel drug cured their dog. Their vet wasn’t so sure. The cure may have been a result of the surgery, or a combination of some or all of the treatments. This is why controlled studies are needed. 

Evidence-based medicine means we need to constantly question our evaluation of treatment success.

David Casarett provides two tips to counter the therapeutic illusion:
  • Before you conclude that a treatment was effective, look for other explanations.
  • If you see evidence of success, look for evidence of failure, i.e. test assumptions of therapeutic efficacy by looking for negative outcomes.

But he warns that over-thinking can have negative impacts too. If physicians doubt their own effectiveness, they might under-treat – the harms of which could be the same or worse than over-treating. It can be a fine line and sometimes hard to judge.

The paper does not suggest that we have no control over therapeutic outcomes – far from it. But it does argue that we can improve outcomes and contribute to rational, evidence-based medicine by questioning our assumptions.

Check out our previous post on evidence based medicine at this link. 

Reference

Saturday, March 12, 2016

Keeping pets safe from rat lungworm, and evidence based medicine

Snails aren't just a problem for flowers. They carry the parasite rat lungworm which can affect companion animals and wildlife.

Rat lungworm is a parasite you really want to avoid. Angiostrongylus cantonensis is found in approximately 5 per cent of ordinary garden snails in Sydney and surrounds, and according to colleagues Professor Richard Malik and Derek Spielman, it may be more common in Brisbane. It can cause severe, nasty signs in affected dogs (and human children or adults who eat snails).
They’ve written this article in The Conversation about rat lungworm with some important pointers on keeping humans and animals safe.

Importantly its not just a matter of eliminating snails and rats - products designed to kill rats, snails and slugs can also kill other animals if ingested.

This week fellow blogger SkeptVet has shared some great posts on evidence based veterinary medicine with some lecture slides that are worth a read.

Can we really trust the scientific literature?


Evidence based veterinary medicine in the trenches


What you know that ain’t necessarily so



Happy weekend, folks!

Friday, December 11, 2015

Why bother with a problem based approach to cases?


What tools do you use to problem solve tricky cases? One of my favourite resources is a book called Differential Diagnosis in SmallAnimal Medicine. The second edition has just come out and I gave it to myself as an early Christmas present. In my teaching role I find that many students struggle with the concept of problem-based medicine (PBL) or problem-oriented medical management (POMM). Why compile a huge list of differential diagnoses when surely there’s one right answer? I discussed this with the authors of the second edition, Drs Alex Gough and Kate Murphy.

Putting together this book was a huge task. For the first edition, Dr Gough compiled a huge list of clinical signs (e.g. heart murmur), historical signs (e.g. seizures), radiograph signs (e.g. pleural effusion), laboratory findings (e.g. non-regenerative anaemia) and then for each of these signs scoured textbooks, conference proceedings and papers to complete the list. For the second edition, Kate revised, fact-checked and edited out some extraneous material. The end product is a brilliant resource.

Dr Kate Murphy at work.
What is your day job?

AG: Head of Medicine Referrals in a Multidisciplinary Referral hospital. [Ed - Alex sees referrals in medicine, cardiology and neurology; holds the Royal College of Veterinary Surgeons Certificate of Small Animal Medicine and Veterinary Cardiology and a postgraduate certificate in neuroimaging for research. He also wrote Breed Predispositions to Disease in Dogs and Cats].

Dr Alex Gough.
KM: My day job is balancing work and home life! At work I am the Clinical Lead for our Referral Hospital. I work in a busy Referral Hospital, which is also the main hospital for our First Opinion Practice. We have 13 branches sending in patients for elective investigation and surgery and then any acute cases, which need more care than the branches, can provide. As a result, there is never a “quiet” day. I am a Small Animal Internal Medicine Specialist and so as well as leading the referral team I am also actively seeing referred medical cases every day. Some of these are straightforward (e.g. gastrointestinal investigation) and then there are the others which is where POMM comes in!

What is POMM?

KM: POMM or “problem-oriented medical management” is a system which makes us concentrate on all the problems a patient has and forces us to avoid the problems of pattern recognition which not only can lead us to misdiagnosis but can also stop us from discovering new diseases or new presentations of old diseases.

There are so many differential diagnoses for some signs like polydipsia and polyuria, or forelimb lameness, yet we are taught common things occur commonly. Why bother thinking about all the potential differentials?

AG: If you fail to consider all the possibilities that may cause a particular sign, then you will not consider performing the range of testing that may be required to rule in or out all the differentials. Most of the time, if you only focus on the common diseases, you will get away with it, but there are a lot of uncommon and rare diseases out there, and uncommon presentations of common diseases are often seen. Taking into account all the possible differential diagnoses makes errors in diagnosis, sometimes catastrophic ones, less likely. For example, failing to consider that a dog with ascites may have a pericardial effusion has led to many dogs having unnecessary and dangerous exploratory laparotomies. That isn't to say you should blindly test for every condition on a differential diagnosis list - this is often suboptimal because of the invasiveness of some of the tests, as well as financial constraints. Rather, tests should be prioritised to give the highest diagnostic yield for the least cost (whether that is to the animal or owner), and be prepared to revise a diagnosis if test results don't support your diagnosis, or if an expected response to treatment is not achieved. 

KM: POMM does not stop us thinking about “common things occurring commonly” but it helps us when we are not seeing a common case to think logically and keep our options open.  It can help us to problem solve and then bring the most likely differentials together to aid the construction of a sound diagnostic plan based on information we have gathered and the finances of the client. Sometimes making assumptions leads us to select the diagnostics most likely to give us the answer we think we will find and we might be heading down the wrong (sometimes expensive track) because we were not prepared to “think outside the box”.

Why are students so attracted to a "pattern recognition" approach?

AG: The pattern recognition approach is quicker, and once it is learned, it requires less intellectual effort. It may also have some advantages, especially in simple cases, in reducing the number of tests a patient requires. For example, a limping cat with a swollen leg, pyrexia and a bite wound could be reasonably treated for a cat bite celullitis, and only if a good response to treatment is not achieved, starting testing for other problems. 

KM: Pattern recognition is easier than POMM and it is more innate. For example, a young dog with haematemesis, haemorrhagic diarrhoea and low white blood cells is assumed to have parvovirus infection. Such diagnosis reveals decent pattern recognition skills but in our clinic last year we saw patients who were not infected with parvovirus but with leptospira. Leptospirosis, would not be on many differential lists for haematemesis and haemorrhagic diarrhoea.

Is POMM still relevant for experienced practitioners, and why?

AG: Experienced practitioners will often use pattern recognition, and in short consultations, this may be the most efficient way of achieving a diagnosis. However, those cases that don't go according to plan, or have unusual signs, can be greatly helped by going through a logical thought process to get to the bottom of them. 

KM: POMM is used by specialist clinicians as well as experienced practitioners. You will probably find that they do not use it for every case in its written format, but in their heads they are running through the differentials for the presenting problems and then rationalizing into the most likely causes, which will then be investigated. When I see cases where I have no strong evidence for the cause, I return to the basic POMM approach to help me logically consider all the options.

Compiling differentials for every historical, physical, radiographic, sonographic, laboratory and electrodiagnostic sign or finding seems like a mammoth task - how do you do it?

The reality is that you do have to be a little discriminatory and this is where experience helps. So I do not write vast differential lists for non-specific signs such as inappetance and lethargy for example. I do keep those problems on my list so that if they do not appear to be secondary problems I push them back up my problem solving list. When interpreting clinicopathological data one has to get experience to decide which are significant results, which require problem solving and which do not. Sometimes it is the fact that whilst a result is not outside of the reference interval, it is an inappropriate finding in a “sick/collapsed patient”. For example: a collapsed dog with low normal glucose is an unusual finding; normally the glucose is at the top or slightly above normal and thus this could be an indication to consider an insulinoma a likely diagnosis. In a collapsed dog that does not have a stress leukogram, we should consider Addison’s disease as a differential.

Do we worry about a total white blood cell count that is 0.5x109/l above normal – not really?

This skill is one of the most difficult to teach and when I was teaching undergraduate students we spent time discussing this aspect – however it is only by forcing oneself to look at the clinicopathological data and interpret it yourself before reading the clinical pathologist comments from the lab that will make the clinician a better problem solver in the future. The same for histopathology reports – read the description not just the final diagnosis. Why?….because we are the ones who have seen the client, examined the animal and now need to put it all together.

What is the best way to use a list of differentials?


KM: I use differential lists to guide me rather than to dictate me. Veterinary medicine is a science with some art thrown in. You can be an amazing POMM clinician but the art comes in to your conversation with the client, making sure they understand the jargon you are throwing at them, that they feel informed and involved in the decision making for their pet and that they feel their concerns have been listened to, respected and addressed. It is no good making the most amazing diagnosis if the client has lost trust because you have done loads of tests but explained nothing that they can understand or if by the time you make the diagnosis you have spent all their money and they can not afford the treatment. Honest, open discussion with a logical problem-orientated approach are the keys to my clinical practice.

Thank you, Drs Gough and Murphy, for your time. Their book, Differential Diagnosis in Small Animal Medicine, is available via Wiley Blackwell here.

Monday, November 2, 2015

RCVS launches Veterinary Evidence journal

How easy is it to access the latest evidence about a particular condition? 

Evidence-based medicine is the new buzz-word, but much of what we do in practice is not based on the high quality of evidence we might assume or would like it to be.That can be for a range of reasons, including that there is very little evidence available. One of the challenges in practising evidence-based medicine is access to all of the available evidence – which can be extensive and time-consuming.

Increasingly, doctors have access to evidence-based guidelines for the treatment of common conditions. This occurs in veterinary medicine, to a lesser extent (conference programs have been dominated by EBM and EBVM for the past five years). Accessing guidelines can be challenging, although publications such as the Journal ofFeline Medicine and Surgery have set a fantastic example with their ABCD Guidelines series.

The Royal College of Veterinary Surgeons (RCVS) has launched a new platform, VeterinaryEvidence, to distribute up-to-date evidence-based veterinary knowledge designed for practitioners.

You can register for free online access to Veterinary Evidence here, contribute to the knowledge base by becoming an author (there are extensive author guidelines available), or – if you are an expert in the field – sign up as a reviewer. The journal has opened for submissions. The website can be found here. For a review of Evidence Based Medicine, check out our interview here.


Monday, July 13, 2015

What is evidence-based veterinary medicine and what does it look like in practice?

Do you know which literature  to consult and how to critically appraise it?
Have you ever wondered what evidence-based medicine is, or what it looks like in veterinary practice? We all use evidence on a daily basis, and often make a judgement about the quality of that evidence. But how sound are those judgements?

Dr Nick Royle works for the Royal College of Veterinary Surgeons in the UK. He took some time out to explain his role and the nature if evidence-based veterinary medicine (EBVM).

What is your role within the RCVS?

I’m the Executive Director of RCVS Knowledge. Formally the “RCVS Trust”, we’re the independent charity partner of the UK’s Royal College. We have a threefold mission: to manage the College’s Historical Collection; to maintain and grow a (principally online) technical library on behalf of the practising veterinary community; and to forward the relatively new concept of Evidence-based Veterinary medicine (EBVM).

I came to RCVS Knowledge having led TheCochrane Collaboration for nine years as its first CEO, and previously to the “evidence led” movement from having tried to adopt this approach for drug and alcohol services in Scotland prisons whilst serving as their first Head of Addictions.


Dr Nick Royle.
The role of RCVS Knowledge within EBVM is to bring together those pockets of activity – and there are some really great teams out there working on this – and through international networking ensure that the whole really is greater than the sum of the parts. Together, we can do something really special.

What, in a nutshell, is EBVM?

EBVM is the conscious use of best available evidence to support clinical decision-making. Derived principally from the synthesised conclusions of the best available scientific evidence, such evidence should be used in conjunction with the practitioner’s experience, patient circumstances, and owners’ values.

EBVM is "new" in veterinary medicine but is it possible that many of us are already using it without really knowing it?

More than likely, to different degrees. There are many great vets, and any good vet will be making sure that their decision making is science-based. But an evidence-based approach takes this to another level, and is, if you like, a different mindset. Yes, you might have read the latest paper on the condition – but where did that paper sit within the greater context of what we know about the condition? Was the trial or study on which it was based well conducted, free from bias, and of sufficient “power”? So an evidence-based approach is about being questioning, and open to changing your practice in the light of your new knowledge.

One of the problems with evidence in any field of medicine today is that it is often presented by companies that manufacture or distribute a product, with a vested interest in its sales. Is some evidence more trustworthy than other evidence?

Some years back, when I was running a drug testing programme, a company tried to sell me a urine testing kit. The salesman provided me with a research paper that he reassured me showed how good his kit was. I read the paper, and it said that his kit wasn’t as good as other kits available.

I guess the salesman had never read his own stuff, and the moral of the story would be that we should always be wary of a single research paper, and that we need to place such information within the wider context of what is known about the question being asked.

This is where the type of evidence-based approach we advocate really pays off. By “evidence” we don’t just mean the results of a single paper, and we certainly don’t mean compiling a range of clinical test results. We mean synthesised evidence drawn from the collated results of all the trials or studies relevant to the question we are asking.

The evidence-based approach has a number of steps:
  1. Work out what your question is – the more defined the better.
  2. Track down the best available evidence – perhaps using the RCVS Knowledge online library (and maybe our information specialists to help).
  3. Critically appraise the evidence you find. How up-to-date is it; are the trials on which it is founded well conducted; is there any bias in the trials or how they are reported, and is this relevant?
  4. Apply what you have found to your decision-making process.
  5. Evaluate how things turned out.

What does EBVM look like in the context of veterinary general practice, i.e. how does a practice where vets using EBVM differ from one where they don't?

An evidence-based approach has revolutionised clinical care in human health. Doctors have stopped doing many things that are ineffective or dangerous, become more conscious of price differentials between equally effective products, and through clinical guidelines applied this knowledge widely throughout their profession. Very often with no idea that they are being “evidence based”.
We share the view of many within the veterinary profession that it’s time for a similar “quiet revolution” here.

One of the most difficult questions I am asked by young vets-in-training is what do they do if they get to their first practice with all their hard-won knowledge, and find that people aren’t welcoming of new-fangled ideas and that “they don’t do that here”.

The sign of a good practice is surely one where the veterinary team are questioning and open to new ideas; where cases are discussed amongst colleagues, and new concepts considered carefully and where appropriate embraced. That would be an evidence-based veterinary team.

Thank you Dr Royle for taking the time to answer our questions. If you’d like to learn more about EBVM and you’re based in the UK (or plan to pop over there in the near future), the RCVS Knowledge is running the first EVBM Skills Day: Essential Tools for Evidence Based Practice.

The program, which you can view in full here, looks absolutely fantastic.

Topics covered include how doctors make decisions, how to design a study in practice, how to critically appraise a paper and run a journal club, significant event and clinical auditing and evidence-based veterinary management.

Friday, December 12, 2014

Evidence based medicine and cultural competence in medicine: is there a conflict

Skittles the ferret. She has little to do with today's post but she is absolutely stunning.

Evidence based medicine and cultural competence in medicine are two key concepts most veterinary and medical curricula are trying to accommodate simultaneously. However, there seems to be a fundamental conflict between the two. I finally understood it when I read an editorial in Health Services Research by Romana Hasnain-Wynia, shared by Dr Martin Whiting.

First though, what does each mean on its own?

Evidence-based medicine (EBM to those who know it well) is the “conscientious, explicit and judicious use of current best evidence, primarily from clinical trials, in making decisions about the care of individual patients” (Hasnain-Wynia, 2006).

Skittles looks like she has a Batman mask.
EBM is associated with diagnostic and treatment guidelines, algorithms and protocols. The aim is to standardise patient care. Overall that seems to be a good thing. It means treatment decisions aren’t based on the whims or limitations of one practitioner.

There are a few limitations of this approach. The gold standard of evidence is the randomised controlled trial, but they can be an ethical minefield. For example, subjecting a patient with a particular condition to sham surgery to compare to those receiving a surgical treatment may have an unacceptable welfare cost. So some trials just don’t happen.

ferret walks on lead
Skittles walks on a lead.
EBM is only as strong as its evidence-base, the size of which can be variable. Veterinary trials are relatively thin on the ground, and when they do exist they usually consist of small numbers of animals (with the exception of some large scale, multi-centre studies). Sometimes all we have to go by is a case series or, gulp, a case report. Or extrapolation from first principles. Or asking an expert.

And there are some treatments for which observational studies are convincing enough. Smith (2003) makes this point rather colourfully in a paper suggesting that “the most radical protagonists of evidence based medicine organised and participated in a double blind, randomised, placebo controlled, crossover trial of the parachute” (see the article here).

And again. So its hard to focus on a moving ferret.
Cultural competence in medicine (CCM) is “the delivery of health services that acknowledges and understands cultural diversity in the clinical setting and respects individuals’ health beliefs, values and behaviours” (Hasnain-Wynia, 2006).

It emphasises finding out what is important to the patient. The emphasis is on individualisation, rather than standardisation, of care.

Of course it can be misused, leading to cultural stereotyping, which can be harmful to individual patients and populations. The emphasis of CCM has shifted from providing specific knowledge about certain cultural groups and minorities to promoting humility, communication, understanding patient narrative and so on.

The problem is that EBM and CCM both base recommendations on modal information from studies populations or subgroups – so critics might argue that their recommendations either don’t apply broadly enough or marginalise some individuals. The classic criticism if EBM is that it promotes “cookbook” medicine, a one-size-fits-all approach. The classic criticism of CCM is that, at its worst, is promotes cultural stereotyping.

The real questions are these: can EBM provide patient-centered care? Can CCM demonstrate improved clinical outcomes? And if they do, how can we tell? It can be challenging measuring outcomes for either model (that doesn't mean we shouldn't try).


ferret close up
Skittles held.
Hasnain-Wynia argues that despite the evolution of EBM and CCM, we need to admit that EBM does promote standardisation of care which leads to reduced discretion for clinicians and patients. On the other hand, CCM promotes discretion for clinicians and patients and may leader to greater variability in clinical care. And that is okay. There is a need for both.

Whilst these are exactly the issues that critics target, neither is inherently bad, and neither justifies canning the whole theory (or as philosophers love to say, throwing out the baby with the bathwater).

References
Hasnain-Wynia (2006) Is evidence-based medicine patient-centered and is patient-centered care evidence-based? Health Services Research 41(1): DOI 10.1111/j.1475-6773.2006.00504.x

Smith G (2003) Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials. BMJ 2003;327:1459