今天看到Twitter上的一个帖子，有关科学的，测试也是在一次次地做实验，怎样让测试结果更可靠，也许可以从这个实验环中每一步可以改进的地方思考：

文章的原文，比较长，可以快速略读即可

：

http://www.nature.com/articles/s41562-016-0021

摘几段与测试相关的话：

The combination of apophenia (the tendency to see patterns in random data), confirmation bias (the tendency to focus on evidence that is in line with our expectations or favoured explanation) and hindsight bias (the tendency to see an event as having been predictable only after it has occurred) can easily lead us to false conclusions.

Publication bias47, also known as the file drawer problem48, refers to the fact that many more studies are conducted than published. Studies that obtain positive and novel results are more likely to be published than studies that obtain negative results or report replications of prior results47,49,50. The consequence is that the published literature indicates stronger evidence for findings than exists in reality. 

Outcome switching refers to the possibility of changing the outcomes of interest in the study depending on the observed results. A researcher may include ten variables that could be considered outcomes of the research, and — once the results are known — intentionally or unintentionally select the subset of outcomes that show statistically significant results as the outcomes of interest. The consequence is an increase in the likelihood that reported results are spurious by leveraging chance, while negative evidence gets ignored. 

我在几年前写的一篇blog，将测试与科学对比的文章，可以点击原文链接阅读：http://www.taixiaomei.com/others04.php

另外，之前关于这个方面也做过一次演讲，可以在优酷上查看，Keynote-A tester, a scientist?

视频地址：http://v.youku.com/v_show/id_XNjA1Mjk0NjI0.html?spm=a2hzp.8253869.0.0&from=y1.7-2