The previous post (https://luysii.wordpress.com/2016/08/22/the-plural-of-anecdote-is-data/) showed that collecting a bunch of small studies (anecdotes) was extremely helpful in seeing the larger picture.
In medicine exactly the opposite occurs. The only way to find out if something works is to do a controlled study. [ Science vol. 297 p 325 ’02 ] There were over 50 observational studies showing benefits for hormone replacement in menopausal women.. Observational studies are basically anecdotes. During the planning study for the Women’s Health Initiative (WHI), some argued that it was unethical to deny some women hormones and give them a placebo. The reason HERS (Heart and Estrogen/Progesterone Replacement Study) was even done was that Wyeth couldn’t get the FDA to approve hormone replacement therapy as a treatment to prevent cardiovascular disease, so they funded HERS to prove their case. Most readers of this have probably read all sorts of bitching about the slowness of the FDA in approving drugs but in this case they did the female populace a huge favor.
As you probably know, the results of hormone replacement in both studies were a disaster (the HERS trial was stopped at 5.2 years after because of increased breast cancer in the treated group). There was also an increased risk of coronary heart disease by 30%, stroke by 41%. At least hip fracture was reduced. Fortunately, even though these were bad outcomes, they were infrequent,(but more frequent in the treated group).
These weren’t lab animals, but someone’s wife and/or mother.
How could they have been so far off? Before all this started, estrogen users were different from nonUsers in several respects — first they were doing something about their health, and clearly had more medical supervision. In addition they were better educated, smoked less and of a higher social class, all of which tend to diminish morbidity and mortality.
Something very similar happened in my field of neurology (not that vascular disease doesn’t severely impact the nervous system). There was a very logical operation to improve cerebral circulation — the pulse just in front of your ear is the superficial temporal artery, a branch of the common carotid after it splits in the internal carotid which goes into the skull and supplies blood to the brain, and the external carotid. If the internal carotid is blocked and the common carotid artery is open, then open the skull and hook (anastomose) the superficial temporal artery to a vessel on the surface of the brain, bypassing the blockage. If you want to know how it is done see — http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1150876/.
There was all sorts of anecdotal evidence of miraculous recovery from stroke. The neurosurgeons and vascular surgeons mounted a wonderful controlled study of the surgery even though many thought it was unnecessary — so 1377 patients were prospectively randomized to have the surgery or medical management. The surgery wasn’t better than medical management N Engl J Med 1985; 313:1191-1200November 7, 1985DOI: 10.1056/NEJM198511073131904, so the procedure was abandoned.