(Note: because this is his first post, we allowed Chris to crush the word limit and give his opinions over two weeks. Stay tuned for the second installment next week. You can find out more about Chris in the “People” page)
As a new parent, I am familiar with the amount of ‘how to do parenting’ advice that becomes ‘available’ from different angles. Good advice or not, it’s obvious that when it comes to babies, people want to help out sometimes without considering the impact their advice may have. I see health and medical research in a similar vein – there are many opinions with no consideration of any repercussions. Evidently, there are many competing agendas in medical research. Since I’m somewhat of a romantic I do believe the foundation of academic research is the intention to do ‘good’. We cannot be blindsided though by such intentions as there are real consequences to our work that we all should consider before we conduct it.
Leo posted recently on the state of research quality (here). While there is a bit of overlap between the issues, in this post (and the next) I want to explore the problems I see with producing high volumes of research. Since I wanted to avoid posting something with a higher word count than my thesis I should mention that these are probably only a few of the problems worth considering.
The first relates to access to good information. Recently I conducted a systematic review that required screening more than 10,000 titles, (stupid I know), 60 of which were remotely relevant. While it might be unfair to use this as an example, compared to synthesizing evidence in real practice (a search for a systematic review is usually more sensitive), it seems keeping up to date with high volumes of literature would be beyond the capacity for any normal clinician (or researcher). The issue becomes more apparent if we consider that departure from evidence-based care remains enormous in most areas of health care.1 In my view, the dissemination of large quantities of (arbitrary) literature is a major contributor to this. Certainly, well-conducted and implemented research does occur and it forms the basis of quality health care. The reality though is that this is a small proportion of the ‘evidence bank’. The sheer weight of ‘dubious evidence’ surely has some impact on shaping practice even though we really only ever care to guess how our (good) research informs practice.
An added consideration to the issue of sourcing reliable information is the pressure patients bring to the health care table. Pressure (from patients) to perform a test or treatment is a reality. While I believe management decisions should be a two-way interaction between the clinician and patient, unskilled opinions based on inaccurate heath information means that this pressure is often misguided. Antibiotic prescription is an example that springs to mind. Many time-poor clinicians may not be well equipped to deal with demanding patient requests or misinformed beliefs. Moreover, it is common to encounter the advocacy (and use) of screening procedures and treatments despite higher risk of side effects, because the ‘research’ supporting them may form the majority of evidence but not the best available evidence. The issue is that while 20 poor studies do not provide better quality evidence than 1 or 2 good ones, they may be perceived to do so. Simon Chapman has commented on a similar issue in prostate cancer.2 Agreed, part of the problem is how this information is represented. However, as producers of the information it seems irresponsible to dismiss our own liability and blame the misrepresentation of our research.
Without question, a leading cause to high volumes of publication is the pressure to publish…or perish. It seems odd though that irresponsible publication of research does not face similar ramifications treating clinicians would for providing flawed treatments, the right treatment poorly or over treating a patient.
1 – Williams C, Maher C, Hancock M et al. Low Back Pain and Best Practice Care: A Survey of General Practice Physicians. Arch Int Medi. 2010; 170:1088
2 – Champman S, Barratt A, Stockler M – Let Sleeping Dogs Lie; 2010 Sydney University Press http://sydney.edu.au/news/84.html?newscategoryid=1&newsstoryid=6003
If you would like to contribute, check out the “About” page and send us an email. We’d love to hear from you!
Enter your email address to subscribe to this blog and receive notifications of new posts by email.
Join 106 other followers
academic misconduct advertising Bec career Cartoon Chris W cochrane collaboration conferences cost doping evidence-based practice experiences experts fun grants hours interpreting research LBP Forum learning Leo C lifestyle Luciola C nerds networking new skills Nick H PhD placebo presentations profiles publications question of science reporting research methods research translation retraction Sport stats Steve K study quality supervisors Tasha tips for research videos WCPT work-life workload writing Zoe M