Go
New
Find
Notify
Tools
Reply
  
"publication bias" Login/Join
 
Member
Picture of shufitz
posted
From today's Wall Street Journal:

In ancient Greece, sailors who survived shipwrecks had their portraits displayed in a temple on Samothrace as a testament to the power of Neptune. When Diagoras of Melos was told that this proved that the gods insert themselves into the lives of men, he answered, "but where are they painted that are drowned?"

Today, showing only the rescued sailors would be called publication bias, the tendency of scientists to report findings that support some point (Neptune rescues sailors) but to bury examples (drowned sailors) that undercut it. It has existed for years, most seriously in the failure to publish studies that cast doubt on the safety or efficacy of new drugs.

… journals are biased in favor of positive studies … "Positive" means those showing that some intervention had an effect, that some gene is linked to a disease – or, more broadly, that one thing is connected to another in a way that can't be explained by random chance. A 1999 analysis found that the percentage of positive studies in some fields routinely tops 90%. That is statistically implausible, suggesting that negative results are being deep-sixed. As a result, "what we read in the journals may bear only the slightest resemblance" to reality.
 
Posts: 2666 | Location: Chicago, IL USAReply With QuoteReport This Post
Member
posted Hide Post
On a slightly different but closely related topic, acupuncture was considered a heathen "science" and Consumers Reports ridiculed it

But when Nixon suddenly decided for no apparent reason that China should be our friend, at once acupuncture was ok and CR virtually praised it to the skies, while acupuncture clinics popped up everywhere

Thus is science politicized
 
Posts: 657Reply With QuoteReport This Post
Member
Picture of Kalleh
posted Hide Post
That surely is the case in getting research published. It is much harder to get something published when the independent variable shows no effect, rather than when there is a significant effect. But of course researchers know that, so they perform every kind of analysis available to find something to report.

Still, it has always seemed like more of a game to me than science.
 
Posts: 24735 | Location: Chicago, USAReply With QuoteReport This Post
Member
posted Hide Post
I don't see how publication bias is anything other than a specific instance of selection bias.
 
Posts: 886 | Location: IllinoisReply With QuoteReport This Post
  Powered by Social Strata  
 


Copyright © 2002-12