Designing a personal experiment that could change your mind — one year on posts 61–81
This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.
Everything in post #61 holds. The case it does not cover is the one I have.
An n of one tells you about one person, which is the person you are most interested in. That is the whole value and it is not nothing.
Nothing above should be read as advice about what anyone else should do.
That is a cleaner way of putting what I was circling around.
Nothing in a personal experiment is medical advice to anyone including yourself, and several people here have found that a prescriber will happily discuss a well-documented one.
A note on scope: what I am saying about Designing a personal experiment applies to the case in the first post and I would not extend it further without checking.
On post #68 — agreed on the reasoning, with one qualification.
Multiple outcomes measured without a primary one means something will move. Nominate the primary in advance and report the rest as secondary.
Write down what you would accept as evidence that it did not work, before starting. That one sentence turns an anecdote into an experiment.
Anyone with a larger sample, please post it.
Quietly grateful for the plain phrasing. Not every thread gets that.
Adding the measurement that post #73 says would settle it.
A photograph or a device reading is a harder record than a recollection, and where one is available it should be the record.
Where I would look next, rather than where I would stop.
Post #72 describes the usual case. This is about the unusual one.
Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.
That much is documented. The rest is how I have interpreted it.
Taking Designing a personal experiment seriously for a moment rather than deflecting: the honest position is that the community has observations and no controlled comparison, and those two things support very different sentences.
Designing a personal experiment that could actually change your mind: that is the standard for an n-of-1 design. An experiment designed so that any result confirms what you already believed has not changed anything.
I would put the burden of proof on the interesting explanation, not the dull one.
This topic was referenced in
- An ABAB design with a data table and honest limitations — a second datasetResearch Methods › N-of-1 designs · 118 replies
- Second pass at: Designing a personal experiment that could change your mindResearch Methods › N-of-1 designs · 44 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Washout with a one-week half-life: the arithmetic — does this still hold?
Washout with a one-week half-life: the arithmetic — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Washout: setting out the arithmetic in full,…
|
+41 | 45 | 12k | 1d |
|
Pre-registering a personal experiment, seriously
Pre-registering a personal experiment, seriously — setting out what I have, and where I think it stops being reliable. A narrow question about pre-registering a personal experiment, deliberately narrow,…
|
+96 | 119 | 58k | 14mo |
|
Blinding yourself: practical methods and their limits — the long version
Blinding yourself: practical methods and their limits — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Blinding yourself,…
|
+7 | 11 | 1.8k | 22h |
|
An ABAB design with a data table and honest limitations — a second dataset
On the subject in the title: An ABAB design with a data table and honest limitations — a second dataset Working notes rather than a conclusion. Posting a small dataset on ABAB design. It is mine, it is…
|
+106 | 118 | 25k | 4mo |
|
Why most self-reports here are not experiments, and that is fine
Why most self-reports here are not experiments, and that is fine — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what a single-person experiment can…
|
2 | 46k | 11mo |
Related topics — sharing the tags effect size, data table, worked example
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Second pass at: Multiplicity when you track fifteen variables
Posting this under the heading it deserves: Second pass at: Multiplicity when you track fifteen variables Everything below is what sits behind that. Two things I would like separated before anyone answers on…
|
2 | 12k | 18mo | |
|
Why cagrilintide alone is discussed so much less than in combination — does this still hold?
Why cagrilintide alone is discussed so much less than in combination — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Cagrilintide alone:…
|
+27 | 31 | 1.2k | 22h |
|
Bioimpedance and hydration: why the number moves
Bioimpedance and hydration: why the number moves — setting out what I have, and where I think it stops being reliable. I have spent a fortnight trying to pin bioimpedance and hydration down and I want to set…
|
+62 | 70 | 13k | 23d |
|
Titrating on tolerability rather than on the calendar
On the subject in the title: Titrating on tolerability rather than on the calendar Working notes rather than a conclusion. An honest uncertainty about titrating on tolerability rather than a disguised…
|
2 | 31k | 13mo | |
|
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. The question about pooling buys that I actually want answered is the…
|
+74 | 83 | 6.6k | 8mo |