DomKen
Posts: 19457
Joined: 7/4/2004 From: Chicago, IL Status: offline
|
quote:
ORIGINAL: Kirata quote:
ORIGINAL: DomKen Yes I did. The sequential labeling of the samples. The failure to produce equivalent numbers of ice crystal photographs from both the experimental and control samples. The fact that a tech involved in the experiment chose which crystals to photograph and at what magnification. Okay look, let's not repeat outselves. I've already responded to your claim about the labeling, and explained why it is not a design flaw. I've pointed out that the fact that the treatment condition produced more crystals is a result, not a flaw. I've responded to your claim that the tech "chose" which crystals to photograph by pointing out that all crystals were photographed -- and I'll add that the magnification options were preset, to be determined by the size of the particular crystal. Since repeating your claims does not make them true, how about explaining the basis for the assertions you've made that the tech knew which samples were which and selected which crystals to photograph. Specifically, how any random order of labels, sequential or otherwise, would enable someone who did not know which samples were which to obtain that information, and why the treatment condition must necessarily produce a nearly equal number of crystals absent tampering or deception. With regard to the design you propose in your post, the beauty of a crystal is independent of size. So I see no benefit to the stationary camera with fixed field of view and magnification. And in my opinion, the rating of the images was more than sufficiently independent in the original study. I do think, however, that the possibility of accidental contamination (dust) introduces an interesting angle. I'm not sure how that would play in the ratings, but it might offer an alternative explanation for why more crystals formed in the treatment group. Thanks. K. You can handwave away the flaws but they remain serious flaws. A study might survive a single serious flaw but 3 serious flaws? No way. The purpose of a double blind study is to remove all possible bias from the experiment. Any choice by anyone at any point in the process is a serious problem. Care must be taken to prevent bias from affecting the choices. I've already explained that more crystals were formed than they claimed. The sequential labeling is a problem. Choosing at what magnification to photograph each crystal is another possible injection of bias. Now I've produced a better protocol with no significant effort which is fairly obvious in all details which casts extreme doubt on the study's design. All in all the study is useless and could never make it through peer review in a legit journal.
|