20 categories

Research Methods

How to reason from data: self-experiments, statistics, bias and confounding.

30 topics1,295 posts9 solved Moderators: owen.brady, t.vasquez About this category

30 topics

Topic	Participants	Replies	Views	Activity
Correlation in a self-tracked dataset: what it can support Research Methods › Statistics effect size heterogeneity worked example number needed to treat Closed Correlation in a self-tracked dataset: what it can support — setting out what I have, and where I think it stops being reliable. Posting a small dataset on correlation. It is mine, it is uncontrolled, and the…	+152	166	48k	23mo
Pre-registering a personal experiment, seriously Research Methods › N-of-1 designs worked example data table effect size confounding Pre-registering a personal experiment, seriously — setting out what I have, and where I think it stops being reliable. A narrow question about pre-registering a personal experiment, deliberately narrow,…	+96	119	58k	14mo
An ABAB design with a data table and honest limitations — a second dataset Research Methods › N-of-1 designs confounding effect size data table worked example Solved On the subject in the title: An ABAB design with a data table and honest limitations — a second dataset Working notes rather than a conclusion. Posting a small dataset on ABAB design. It is mine, it is…	+106	118	25k	4mo
Washout with a one-week half-life: the arithmetic Research Methods › N-of-1 designs effect size data table worked example Wiki Washout with a one-week half-life: the arithmetic — setting out what I have, and where I think it stops being reliable. Washout: setting out the arithmetic in full, because I have had to do it twice and I…	+90	96	44k	20mo
Measurement error in home scales, with a worked standard deviation — the long version Research Methods › Statistics number needed to treat worked example heterogeneity effect size Solved On the subject in the title: Measurement error in home scales, with a worked standard deviation — the long version Working notes rather than a conclusion. A narrow question about Measurement error in home…	+96	105	2k	2mo
Pre-registering a personal experiment, seriously — a second dataset Research Methods › N-of-1 designs data table worked example confounding Posting this under the heading it deserves: Pre-registering a personal experiment, seriously — a second dataset Everything below is what sits behind that. Posting a small dataset on Pre-registering a personal…	+60	66	35k	3mo
Designing a personal experiment that could change your mind — one year on Research Methods › N-of-1 designs effect size data table worked example Designing a personal experiment that could change your mind — one year on — setting out what I have, and where I think it stops being reliable. Two things I would like separated before anyone answers on…	+74	80	17k	2d
Second pass at: Regression to the mean in progress reports Research Methods › Statistics effect size worked example heterogeneity Second pass at: Regression to the mean in progress reports Writing it up because I had to work it out twice and would rather nobody else did. Posting a small dataset on Regression. It is mine, it is…	+71	75	4k	17mo
Regression to the mean in progress reports Research Methods › Statistics number needed to treat heterogeneity confounding effect size On the subject in the title: Regression to the mean in progress reports Working notes rather than a conclusion. Something about regression does not reconcile and I would like a second pair of eyes before I…	+30	34	49k	12mo
Blinding yourself: practical methods and their limits Research Methods › N-of-1 designs confounding data table effect size On the subject in the title: Blinding yourself: practical methods and their limits Working notes rather than a conclusion. A methods question rather than a substantive one, about blinding yourself. Everyone…	+40	44	33k	5d
Coming back to: Why most self-reports here are not experiments, and that is fine Research Methods › N-of-1 designs worked example data table effect size Solved Closed The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. A question about what a single-person experiment…	+56	62	11k	4mo
Second pass at: Absence of evidence and evidence of absence Research Methods › Statistics worked example confounding number needed to treat On the subject in the title: Second pass at: Absence of evidence and evidence of absence Working notes rather than a conclusion. Two things I would like separated before anyone answers on Absence of evidence,…	+50	55	18k	16h
Sample size intuition for a personal experiment — does this still hold? Research Methods › Statistics effect size heterogeneity number needed to treat Solved Sample size intuition for a personal experiment — does this still hold? I have a specific reason for asking rather than idle curiosity, and the context is below. Reading back through what has been written…	+33	38	26k	23d
Washout with a one-week half-life: the arithmetic — does this still hold? Research Methods › N-of-1 designs confounding data table worked example Solved Washout with a one-week half-life: the arithmetic — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Washout: setting out the arithmetic in full,…	+41	45	12k	1d
Sample size intuition for a personal experiment Research Methods › Statistics number needed to treat heterogeneity confounding effect size On the subject in the title: Sample size intuition for a personal experiment Working notes rather than a conclusion. A follow-up question about sample size intuition that I did not know to ask the first time.…		4	62k	18mo
Second pass at: Designing a personal experiment that could change your mind Research Methods › N-of-1 designs worked example effect size confounding data table Solved Second pass at: Designing a personal experiment that could change your mind Writing it up because I had to work it out twice and would rather nobody else did. The question about Designing a personal…	+39	44	632	14mo
Multiplicity when you track fifteen variables Research Methods › Statistics effect size heterogeneity confounding worked example Solved Multiplicity when you track fifteen variables — setting out what I have, and where I think it stops being reliable. Asking about multiplicity directly, because I have read four threads on it and each answered…		2	60k	11mo
Measurement error in home scales, with a worked standard deviation Research Methods › Statistics effect size heterogeneity number needed to treat confounding Solved Wiki Measurement error in home scales, with a worked standard deviation Writing it up because I had to work it out twice and would rather nobody else did. What changes if the standard account of measurement error…	+26	31	4.3k	4mo
An ABAB design with a data table and honest limitations Research Methods › N-of-1 designs effect size confounding worked example An ABAB design with a data table and honest limitations Writing it up because I had to work it out twice and would rather nobody else did. An honest uncertainty about ABAB design rather than a disguised…		2	45k	5mo
Why most self-reports here are not experiments, and that is fine Research Methods › N-of-1 designs confounding worked example data table effect size Closed Why most self-reports here are not experiments, and that is fine — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what a single-person experiment can…		2	46k	11mo
[2026 update] Correlation in a self-tracked dataset: what it can support Research Methods › Statistics number needed to treat effect size worked example heterogeneity Posting this under the heading it deserves: Correlation in a self-tracked dataset: what it can support Everything below is what sits behind that. Posting a small dataset on Correlation. It is mine, it is…		2	31k	6h
Absence of evidence and evidence of absence Research Methods › Statistics effect size worked example number needed to treat Absence of evidence and evidence of absence Writing it up because I had to work it out twice and would rather nobody else did. Asking about absence of evidence on behalf of the question I keep seeing asked…	+16	20	3.9k	5mo
About the N-of-1 designs category Research Methods › N-of-1 designs worked example confounding effect size Pinned Wiki Designing a personal experiment that could actually change your mind, including washouts and blinding. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is…		4	22k	14h
What a confidence interval means, from scratch — the long version Research Methods › Statistics effect size worked example confounding number needed to treat The question in the title: What a confidence interval means, from scratch — the long version I will give what I have already checked below so nobody repeats it. Asking about confidence interval directly,…	+16	20	2.3k	8mo
Measurement error in home scales, with a worked standard deviation — a second dataset Research Methods › Statistics effect size confounding heterogeneity number needed to treat Solved Measurement error in home scales, with a worked standard deviation — a second dataset — setting out what I have, and where I think it stops being reliable. Posting a small dataset on Measurement error in home…		2	13k	7mo
Second pass at: Multiplicity when you track fifteen variables Research Methods › Statistics number needed to treat confounding effect size worked example Posting this under the heading it deserves: Second pass at: Multiplicity when you track fifteen variables Everything below is what sits behind that. Two things I would like separated before anyone answers on…		2	12k	18mo
About the Statistics category Research Methods › Statistics effect size number needed to treat heterogeneity Pinned Wiki Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…	+4	8	2.3k	7mo
Blinding yourself: practical methods and their limits — the long version Research Methods › N-of-1 designs worked example effect size confounding data table Blinding yourself: practical methods and their limits — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Blinding yourself,…	+7	11	1.8k	22h
Designing a personal experiment that could change your mind Research Methods › N-of-1 designs confounding worked example data table effect size Posting this under the heading it deserves: Designing a personal experiment that could change your mind Everything below is what sits behind that. I was wrong about designing a personal experiment in a thread…	+2	6	695	6mo
What a confidence interval means, from scratch Research Methods › Statistics number needed to treat confounding worked example heterogeneity What a confidence interval means, from scratch — that is the question, and I have not found it answered plainly anywhere I have looked. Asking about confidence interval directly, because I have read four…		2	2.6k	2mo

Sponsored Janoshik Analytical — independent third-party testingHPLC purity and mass-spectrometric identity on submitted samples, reported with the method stated. The laboratory most often cited in this community’s verification records.Independent testing → Sponsored GL Biochem (Shanghai) Ltd. — synthesis, directFounded 1998. ISO 9001 and cGMP certified, over 1,500 staff and 200-plus patents. Custom peptide synthesis and amino acid derivatives, with a batch certificate on every order.Custom synthesis →