Washout with a one-week half-life: the arithmetic — does this still hold? posts 31–46
This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1 · go to the accepted answer.
Post #31 and I disagree about the size of the effect, not about the direction.
Where I have landed on Washout, having got it wrong once in public: the direction is clear, the magnitude is not, and anyone quoting a precise magnitude has borrowed it from somewhere that did not measure it.
Taking post #31 at face value and following it one step further.
Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.
Adding the boring version of Washout, because the interesting version keeps getting posted and the boring one is usually right.
Check the ordinary explanations, in order, and stop when one of them accounts for what you are seeing. Most of the time the second one does.
Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.
The variance between people here is larger than the effect being discussed.
That is a cleaner way of putting what I was circling around.
Helpful, and easy to find again, which is half of what a good reply is.
Post #40 is right about the mechanism and I think understates the practical bit.
Washout is well covered in the tag pages, and the older discussions are better than the recent ones because they were argued out properly. Worth twenty minutes before adding to this one.
It does not tell you about anybody else, which is why aggregating these accounts does not produce evidence of the kind people want it to.
This is the sort of thing that ought to be settled and apparently is not.
Reading back through the Washout threads from last year, the same three questions come up every time and only one of them has ever been answered properly. That seems like a documentation gap rather than a knowledge gap.
On post #42 — agreed on the reasoning, with one qualification.
The reason Washout keeps being re-asked is that the answer is conditional and people quote it without the condition. It is not that the answer is unknown.
Confirming post #44 from a second method, which matters more than confirming it from a second person.
Sample size in n-of-1: you are the sample. Repeated measurements (weekly weighings, daily mood scores) increase the power to detect a real effect even though n=1.
I had written a reply contradicting post #42 and deleted it. Here is what survived.
My experience of Washout contradicts the reply above. I am posting it as a data point rather than as a refutation, because one person's experience is exactly that.
This topic was referenced in
- Why most self-reports here are not experiments, and that is fineResearch Methods › N-of-1 designs · 2 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Why most self-reports here are not experiments, and that is fine
Why most self-reports here are not experiments, and that is fine — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what a single-person experiment can…
|
2 | 46k | 11mo | |
|
Coming back to: Why most self-reports here are not experiments, and that is fine
The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. A question about what a single-person experiment…
|
+56 | 62 | 11k | 4mo |
|
Designing a personal experiment that could change your mind — one year on
Designing a personal experiment that could change your mind — one year on — setting out what I have, and where I think it stops being reliable. Two things I would like separated before anyone answers on…
|
+74 | 80 | 17k | 2d |
|
Pre-registering a personal experiment, seriously
Pre-registering a personal experiment, seriously — setting out what I have, and where I think it stops being reliable. A narrow question about pre-registering a personal experiment, deliberately narrow,…
|
+96 | 119 | 58k | 14mo |
|
Pre-registering a personal experiment, seriously — a second dataset
Posting this under the heading it deserves: Pre-registering a personal experiment, seriously — a second dataset Everything below is what sits behind that. Posting a small dataset on Pre-registering a personal…
|
+60 | 66 | 35k | 3mo |
Related topics — sharing the tags confounding, data table, worked example
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Whether an aggregate is worth publishing at all: a disputed topic — does this still hold?
Whether an aggregate is worth publishing at all: a disputed topic — does this still hold? I have a specific reason for asking rather than idle curiosity, and the context is below. An honest uncertainty about…
|
+14 | 18 | 3.4k | 2mo |
|
Feature request: should a dose-equivalence tool exist at all?
Feature request: should a dose-equivalence tool exist at all? — that is the question, and I have not found it answered plainly anywhere I have looked. Reading back through what has been written here about…
|
+21 | 25 | 4.8k | 18mo |
|
Revisiting: Bioimpedance and hydration: why the number moves
Posting this under the heading it deserves: Revisiting: Bioimpedance and hydration: why the number moves Everything below is what sits behind that. I have spent a fortnight trying to pin Bioimpedance and…
|
2 | 2.8k | 1mo | |
|
Contributing data without breaching anyone's privacy
Contributing data without breaching anyone's privacy Writing it up because I had to work it out twice and would rather nobody else did. Asking about contributing data without breaching directly, because I…
|
+65 | 71 | 839 | 5mo |
|
Titles that describe the question, not the situation — what changed since
Posting this under the heading it deserves: Titles that describe the question, not the situation — what changed since Everything below is what sits behind that. What changes if the standard account of Titles…
|
+29 | 33 | 29k | 10mo |