A single-person experiment can be genuinely informative if it has a pre-specified outcome, a defined period, and a plan written before the data arrives. Most accounts here have none of those.
I have seen it go both ways, which is why I hedge.
A single-person experiment can be genuinely informative if it has a pre-specified outcome, a defined period, and a plan written before the data arrives. Most accounts here have none of those.
I have seen it go both ways, which is why I hedge.
Reading back through the Pre-registering a personal experiment threads from last year, the same three questions come up every time and only one of them has ever been answered properly. That seems like a documentation gap rather than a knowledge gap.
On Pre-registering a personal experiment, the part that usually goes wrong is that the question is asked as though it has one answer. It has a range, and the width of the range is the interesting bit.
If you can post the two or three numbers you are working from, several people here will check the arithmetic rather than argue about the conclusion.
On post #50 — agreed on the reasoning, with one qualification.
Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result.
A partial answer, offered because a partial answer beats none.
Read the full topic (67 posts)
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Pre-registering a personal experiment, seriously
Pre-registering a personal experiment, seriously — setting out what I have, and where I think it stops being reliable. A narrow question about pre-registering a personal experiment, deliberately narrow,…
|
+96 | 119 | 58k | 14mo |
|
Why most self-reports here are not experiments, and that is fine
Why most self-reports here are not experiments, and that is fine — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what a single-person experiment can…
|
2 | 46k | 11mo | |
|
Designing a personal experiment that could change your mind
Posting this under the heading it deserves: Designing a personal experiment that could change your mind Everything below is what sits behind that. I was wrong about designing a personal experiment in a thread…
|
+2 | 6 | 695 | 6mo |
|
Coming back to: Why most self-reports here are not experiments, and that is fine
The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. A question about what a single-person experiment…
|
+56 | 62 | 11k | 4mo |
|
Blinding yourself: practical methods and their limits
On the subject in the title: Blinding yourself: practical methods and their limits Working notes rather than a conclusion. A methods question rather than a substantive one, about blinding yourself. Everyone…
|
+40 | 44 | 33k | 5d |
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
A calculator that gives a right answer to the wrong question
Posting this under the heading it deserves: A calculator that gives a right answer to the wrong question Everything below is what sits behind that. Posting the calculation with the inputs, so that somebody…
|
+32 | 36 | 1.9k | 17h |
|
A 5 mg vial and a 0.25 mg dose: the arithmetic in full — what changed since
Posting this under the heading it deserves: A 5 mg vial and a 0.25 mg dose: the arithmetic in full — what changed since Everything below is what sits behind that. 5 mg vial: setting out the arithmetic in…
|
+86 | 93 | 25k | 13mo |
|
Coming back to: Column chemistry choices for a 40-residue peptide
On the subject in the title: Column chemistry choices for a 40-residue peptide Working notes rather than a conclusion. Column chemistry choices — I have the observation and I do not trust my interpretation of…
|
2 | 43k | 16mo | |
|
Peak-to-trough ratio at steady state for a weekly agent
On the subject in the title: Peak-to-trough ratio at steady state for a weekly agent Working notes rather than a conclusion. Working through the kinetics rather than the pharmacology, because I think the…
|
+58 | 64 | 9.7k | 2mo |
|
Measurement error in home scales, with a worked standard deviation — the long version
On the subject in the title: Measurement error in home scales, with a worked standard deviation — the long version Working notes rather than a conclusion. A narrow question about Measurement error in home…
|
+96 | 105 | 2k | 2mo |