Here is what came to mind after reading this post:
http://en.wikipedia.org/wiki/Discourse_on_MethodThe Discourse on the Method is a philosophical and mathematical treatise published by René Descartes in 1637. Its full name is Discourse on the Method of Rightly Conducting the Reason, and Searching for Truth in the Sciences.
<snip>
The Discourse on the Method is one of the most influential works in the history of modern science. It is a method which gives a solid platform from which all modern natural sciences could evolve. In this work, Descartes tackles the problem of skepticism which had been revived from the ancients such as Sextus Empiricus by authors such as Al-Ghazali<1> and Michel de Montaigne.
Descartes modified it to account for a truth that he found to be incontrovertible.
Descartes started his line of reasoning by doubting everything, so as to assess the world from a fresh perspective, clear of any preconceived notions.
The following quote from Discourse on Method presents the four precepts that characterize the Method itself:
"The first was never to accept anything for true which I did not clearly know to be such; that is to say, carefully to avoid precipitancy and prejudice, and to comprise nothing more in my judgment than what was presented to my mind so clearly and distinctly as to exclude all ground of doubt.
The second, to divide each of the difficulties under examination into as many parts as possible, and as might be necessary for its adequate solution.
The third, to conduct my thoughts in such order that, by commencing with objects the simplest and easiest to know, I might ascend by little and little, and, as it were, step by step, to the knowledge of the more complex; assigning in thought a certain order even to those objects which in their own nature do not stand in a relation of antecedence and sequence.
And the last, in every case to make enumerations so complete, and reviews so general, that I might be assured that nothing was omitted."
By clear and distinct he suggests the evidence of the senses.
The enumerations have in time developed into many forms. He suggested drawing boxes on a paper, and connecting them. This idea has led to a multitude of graphic thinking aids that we use today.
There is so much to be said on this topic. So much money and hope are wasted on sham cures annually, and even if they do no physical harm, they may do financial harm to those least able to absorb the error.
The pillars of scientific research are peer review and reproducibility by others, As you mentioned, the claim of "statistical significance" can be misleading.