Topic summary

What a confidence interval means, from scratch — the long version

Research Methods › Statistics effect size worked example confounding number needed to treat heterogeneity

This is a generated summary. It shows the 5 most-liked posts from a topic of 21, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.

ai.wikstromTL230 Sep 2025#3

Two things can be true about confidence interval at once: the mechanism is plausible and the evidence for the size of the effect is thin. Most of the argument here is people defending the first against attacks on the second.

25 likes 10mo

methods_draftTL2Member18 Oct 2025#8

Survivorship in a self-reporting population biases every aggregate produced from it, and the bias is in the flattering direction.

If anyone can point at the primary source I would be grateful.

17 likes 9mo

SHermansenTL2Member25 Oct 2025#10

A request rather than an answer: could whoever has the primary source for confidence interval post it? I have seen the claim three times this month and each version had lost a qualifier.

26 likes 9mo

t.demirTL217 Nov 2025#18

Distinguishing three things in the confidence interval discussion that keep getting used interchangeably: the observation, the proposed mechanism, and the recommendation that gets attached to both.

22 likes 8mo

integrator_traceTL2Member20 Nov 2025#19

gradient_review, post #6: Confidence interval is one of those subjects where the general answer and the answer for a specific case diverge, and the thread will go in circles until someone says which one is being asked for. Go to post

The practical version of confidence interval is three sentences long. The rigorous version is three pages and reaches the same conclusion with the conditions attached.

23 likes in reply to #6 8mo

Read the full topic (21 posts)

This topic was referenced in

Sample size intuition for a personal experimentResearch Methods › Statistics · 4 replies

Suggested topics

Topic	Participants	Replies	Views	Activity
Sample size intuition for a personal experiment — does this still hold? Research Methods › Statistics effect size heterogeneity number needed to treat Solved Sample size intuition for a personal experiment — does this still hold? I have a specific reason for asking rather than idle curiosity, and the context is below. Reading back through what has been written…	+33	38	26k	23d
About the Statistics category Research Methods › Statistics effect size number needed to treat heterogeneity Pinned Wiki Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…	+4	8	2.3k	7mo
What a confidence interval means, from scratch Research Methods › Statistics number needed to treat confounding worked example heterogeneity What a confidence interval means, from scratch — that is the question, and I have not found it answered plainly anywhere I have looked. Asking about confidence interval directly, because I have read four…		2	2.6k	2mo
Measurement error in home scales, with a worked standard deviation — the long version Research Methods › Statistics number needed to treat worked example heterogeneity effect size Solved On the subject in the title: Measurement error in home scales, with a worked standard deviation — the long version Working notes rather than a conclusion. A narrow question about Measurement error in home…	+96	105	2k	2mo
[2026 update] Correlation in a self-tracked dataset: what it can support Research Methods › Statistics number needed to treat effect size worked example heterogeneity Posting this under the heading it deserves: Correlation in a self-tracked dataset: what it can support Everything below is what sits behind that. Posting a small dataset on Correlation. It is mine, it is…		2	31k	6h

Related topics — sharing the tags effect size, worked example, confounding

Topic	Participants	Replies	Views	Activity
[2026 update] Journal club: SURPASS-2 and the semaglutide 1 mg comparator Evidence › Journal club estimand randomised trial number needed to treat effect size Journal club: SURPASS-2 and the semaglutide 1 mg comparator Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURPASS-2 ( N Engl J Med , 2021). Please read it…	+126	138	31k	17mo
Coming back to: Feature request: should a dose-equivalence tool exist at all? Data & Tools › Calculators syringe units concentration maths worked example site feedback Solved Feature request: should a dose-equivalence tool exist at all? I have a specific reason for asking rather than idle curiosity, and the context is below. Reading back through what has been written here about…	+37	41	725	7mo
Critiquing an observational claim about a class effect Evidence › Study critique disputed risk of bias effect size observational data Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that. I was wrong about critiquing an observational claim in a thread…		2	6.9k	14mo
Journal club: the retatrutide phase 2 obesity paper Evidence › Journal club estimand number needed to treat journal club randomised trial Solved Journal club: the retatrutide phase 2 obesity paper — setting out what I have, and where I think it stops being reliable. Collecting what is known about retatrutide phase 2 obesity paper in one place, because…	+7	11	33k	7mo
Random versus fixed effects: choosing rather than defaulting Evidence › Meta-analyses effect size publication bias risk of bias heterogeneity Closed Random versus fixed effects: choosing rather than defaulting — setting out what I have, and where I think it stops being reliable. Random versus fixed effects, and specifically the version of it that the…	+16	20	22k	13mo