The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique · continued

Reverse causation in a cohort study of weight and outcome — a second dataset posts 121–132

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

CN
c.niemelTL3Regular16 Sep 2025#121
taper_shift, post #17: Post #14 is the version of this I will quote in future. One addition. Generalisability and validity are separate axes. A trial can be internally impeccable and still tell you nothing about the person asking. Small point, but it is the one that usually catches people. Go to post

Picking up post #118: that is the part I would want checked first.

Practical answer on Reverse causation, since the theoretical one is upthread: do the simplest check first, write down the result, and only then decide whether the complicated explanation is needed. It usually is not.

23 likes in reply to #17 10mo
SF
s.ferreiraTL216 Sep 2025#122

Hold a trial to the standard something could actually have met. A criticism that no achievable design could have answered is a criticism of the field rather than of the paper.

Filing this under things that are true until someone shows me otherwise.

0 likes 10mo
B
BramleyTL2Member16 Sep 2025#123

Bookmarking this. I will come back when I have something worth adding.

3 likes 10mo
ND
n.dziedzicTL216 Sep 2025#124

Coming back to post #120, because the follow-up matters more than the original answer.

Building consensus on which criticisms matter: if everyone agrees that the sample size is small but only you think that affects the conclusion, maybe your criticism is more idiosyncratic. That does not make it wrong but it is worth noticing.

10 likes 10mo
CD
cohort_driftTL316 Sep 2025#125
RC
r.chukwuTL216 Sep 2025#126

Two people in this thread mean different things by Reverse causation and are disagreeing about the definition while believing they are disagreeing about the facts. Worth pausing to define it.

32 likes 10mo
LC
l.chevalierTL3Regular16 Sep 2025 · edited#127

Post #126 answers the question as asked. The question underneath it is different.

A run-in period that excludes non-responders before randomisation changes what the trial is estimating. It is legitimate design and it must be stated in any summary.

The number is defensible. The precision I gave it is not.

1 like 10mo
PB
p.boatengTL216 Sep 2025#128
to.varga, post #117: The pre-specified endpoint being a weaker proxy than you would like is a real criticism. It is a smaller one than saying the result was chosen after the fact. If the premise is wrong, everything after it is decoration. Go to post

I read post #124 twice before replying, because I had assumed the opposite.

Agreed on Reverse causation, with one qualification that I think matters. The reasoning holds for the case as described. Change the starting assumption and it does not, and the starting assumption is the part nobody states.

6 likes in reply to #117 10mo
BP
bench_peakTL3Regular16 Sep 2025#129

The version of Reverse causation that circulates here is a simplification of a simplification. It is not wrong, but it has lost the conditions under which it holds, and those conditions are where the interesting cases live.

11 likes 10mo
MN
m.ndiayeTL216 Sep 2025 · edited#130
ma.nascimento, post #20: Noted, and thank you for writing it out rather than summarising it. Go to post

Answering the question post #128 raises rather than the one it answers.

Generalisability and validity are separate axes. A trial can be internally impeccable and still tell you nothing about the person asking.

24 likes in reply to #20 10mo
CD
c.draganovTL116 Sep 2025#131
VK
v.kjaerTL216 Sep 2025#132

Taking post #130 at face value and following it one step further.

A request rather than an answer: could whoever has the primary source for Reverse causation post it? I have seen the claim three times this month and each version had lost a qualifier.

0 likes 10mo

Suggested topics

TopicParticipantsRepliesViewsActivity
A claim built entirely on a subgroup analysis — what changed since
On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion. What changes if the standard account of claim built is wrong? I ask…
AWZCQZ 2 2k 18mo
About the Study critique category
Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
BNJNDEHF 4 114 16mo
Critiquing an observational claim about a class effect — one year on
Critiquing an observational claim about a class effect — one year on — setting out what I have, and where I think it stops being reliable. I was wrong about Critiquing an observational claim in a thread last…
FELDKRAWDO+5 9 3.2k 8mo
Selection into a registry and what it does to the estimate — a second dataset
Posting this under the heading it deserves: Selection into a registry and what it does to the estimate — a second dataset Everything below is what sits behind that. Posting a small dataset on Selection. It is…
PBINVFPES+28 32 1.3k 1d
Reverse causation in a cohort study of weight and outcome
On the subject in the title: Reverse causation in a cohort study of weight and outcome Working notes rather than a conclusion. Posting a small dataset on reverse causation. It is mine, it is uncontrolled, and…
LVDRIEDDN+10 14 11k 7mo

Related topics — sharing the tags risk of bias, observational data, confounding

TopicParticipantsRepliesViewsActivity
About the Preprints category
Unrefereed work, clearly labelled as such, with the usual caveats stated once and taken seriously. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded…
JMDONIBSP+3 7 14k 3mo
About the N-of-1 designs category
Designing a personal experiment that could actually change your mind, including washouts and blinding. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is…
OBDOKAGRIA 4 22k 14h
Blinding yourself: practical methods and their limits — the long version
Blinding yourself: practical methods and their limits — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Blinding yourself,…
CTSDNGJEMD+7 11 1.8k 22h
Journal club: STEP 1 and the treatment-policy estimand — does this still hold?
Asking directly, because I could not find a straight answer: Journal club: STEP 1 and the treatment-policy estimand — does this still hold? Working notes on STEP 1 rather than a conclusion. I would rather…
GKRCDALB+70 76 4.8k 15h
Journal club: SUSTAIN 6 and its retinopathy signal
On the subject in the title: Journal club: SUSTAIN 6 and its retinopathy signal Working notes rather than a conclusion. Reading SUSTAIN 6 ( N Engl J Med , 2016) for the population rather than the effect,…
LAMRZHOJI+110 122 46k 1d