Are Research Results Fact or Fiction?

What if the so called trustworthy fruits of research are not true after all?

By Chantelle (Tilly) War, Staff Writer

globalresearch.ca

We live in a society where we often refrain from making a choice until we’ve done our research on the subject, be it a vaccination, new vehicle, or vacation. Over the years, we have come to trust the fruits of our research labour. But what if those helpful tidbits we’ve come to rely on weren’t so true after all? Suddenly, you realize that a person or corporation will say anything to make the sale, but more important, gain your trust.

In his essay, “Why Most Published Research Findings are False”, Dr. John P.A Loannidis discusses why the information we have come to trust isn’t as trustworthy as we first thought. The main reason for this is bias. Dr. Ioannidis defines bias as, “the combination of various design, data, analysis, and presentation factors that tend to produce research findings when they should not be produced.” The author also notes that people should be cautious that they don’t mix up bias with chance variability. [pullquote]One of the main problems with biased research is that the results can be easily manipulated to suit the researcher’s needs.[/pullquote]

One of the main problems with biased research is that the results can be easily manipulated to suit the researcher’s needs. For instance, studies may be conducted by several independent teams. They may have similar questions to ask, however, instead of keeping broad horizons and open minds, they focus on isolated discoveries, and interpret the results in an equally isolated environment. Any bits or pieces of information that could help support the argument are then carefully picked and chosen. No matter how miniscule, if it could potentially convince you, it will be used.

A common occurrence that also tends to lead to bias is selective or distortive reporting. A person’s research labours might yield consistent results, but if there are outcomes that don’t match the rest of the findings, they may be nixed for their inconsistencies. Those who are trying to do the convincing tend to bury any conflicts of interest. No one wants to present findings that are against their arguments.

Image Courtesy of: edu.uwo.ca

The article, “Most Science Studies Appear to be Tainted by Sloppy Analysis” simplifies what Ioannidis’ essay states: “A new claim about a research finding is more likely to be false than true.” As an experiment, Dr. Ioannidis and his colleges decided to analyze over 400 research publications regarding gender and genes. Of those, only one had results that were replicated. Of those 400+ publications, that result’s replication is probably the only one that could be considered true.

Research funding also caters to the bias and likely falsehoods of research findings. In the United States, research is an enterprise with figures upwards of $55 billion. To say that the bulk of the findings that were part of this funding are false is a sore spot, but it’s a nerve that Dr. Ioannidis felt obligated to pinch.

Though most published research results are deemed false, the “Most Science Studies…” author reminds researchers that mistakes shouldn’t be feared as much as people are led to believe. Errors are just as important in science as discovery; “Conflicting data and differences of interpretation are common.” As well, since scientists rely on the vigilance of their colleges, why would they dispute the findings of those in their respective fields? [pullquote]Research funding also caters to the bias and likely falsehoods of research findings. In the United States, research is an enterprise with figures upwards of $55 billion.[/pullquote]

When errors are found, researchers have the tendency to retract their papers. Though these retractions are common, so those reading the studies don’t learn about false findings, there are still many that have been left in place. However, Yale Professor Daniel Kelves reminds researchers, and those studying the reports, that even though research with false findings may be retracted, “the correction isn’t the ultimate truth either.”

True or false, published research findings will always have some use. If they help to cater to a personal bias, or give you peace of mind when making a decision, then the results have done their job, regardless of their reliability.

Better known by my alias “Tilly,” I’m a proud Canadian who’s sixth-generation on the family homestead.  I’m currently working on my B.A in English with Athabasca University by correspondence, and I firmly believe in using our freedom of speech to its fullest potential (it’s just as important as voting). For more of my idiosyncrasies, please check out the following:

Twitter: @ChantelleTillyW

A Paper Voice (http://apapervoice.blogspot.com)

Linked In: Chantelle (Tilly) Wark