The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Journal club · continued

Second pass at: Journal club: LEADER as the historical anchor posts 61–82

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

HO
h.oyelowoTL2Regular24 Jul 2024 · edited#61
LJankowiak, post #48: On post #46 — agreed on the reasoning, with one qualification. I would keep LEADER and the decision it usually gets used for separate in this thread. They are related and they are not the same question, and merging them is why the last one went badly. Go to post

LEADER would be much easier to settle if anyone reported the denominator. Almost nobody reports the denominator.

33 likes in reply to #48 2y
MR
m.radichTL224 Jul 2024#62

Adding a null result on LEADER. I looked, carefully, and found nothing, and null results deserve posting precisely because they never are.

0 likes 2y
SC
sourced_claimsTL3Regular25 Jul 2024#63

An hour is enough for one paper read properly and not enough for two read partly. The temptation is always to add the second.

7 likes 2y
RZ
ro.zielinskiTL225 Jul 2024#64

Helpful, and short, which on this subject is harder than long.

17 likes 2y
DV
dr.villanuevaTL3Physician25 Jul 2024#65

Adding the measurement that post #62 says would settle it.

The baseline characteristics table is the single most useful page for the questions that get asked here, because it tells you who the result applies to.

Take it as a starting point and not as a specification.

24 likes 2y
SG
s.grimaldiTL226 Jul 2024#66
MH
ms_hollowayTL4Mass spectrometrist26 Jul 2024#67

Where the LEADER discussion usually stalls is that nobody wants to say "I do not know" and everyone is willing to say "it varies". Those are the same sentence with different clothes on.

3 likes 2y
EI
e.iyerTL226 Jul 2024#68
hana.sato, post #32: A request rather than an answer: could whoever has the primary source for LEADER post it? I have seen the claim three times this month and each version had lost a qualifier. Go to post

Sessions on negative or null results are consistently the most instructive and the hardest to get anyone to attend.

11 likes in reply to #32 2y
ST
sterile_tableTL3Regular26 Jul 2024#69

Offering a way to settle LEADER rather than another opinion about it. Two measurements, taken the same way, a fortnight apart. If the difference is within the noise, the question was not answerable at this precision.

18 likes 2y
YE
y.eriksenTL227 Jul 2024 · edited#70

On post #68 — agreed on the reasoning, with one qualification.

Where the group cannot agree, record the disagreement rather than resolving it by seniority. The recorded disagreement is more honest and more useful later.

That is all the detail I have. Someone else will have more.

0 likes 2y
N
NardoneTL2Member27 Jul 2024#71
y.eriksen, post #70: On post #68 — agreed on the reasoning, with one qualification. Where the group cannot agree, record the disagreement rather than resolving it by seniority. The recorded disagreement is more honest and more useful later. That is all the detail I have. Someone else will have more. Go to post

Small correction to my own earlier position on LEADER. I had the units the wrong way round, which changes the conclusion by an order of magnitude and therefore changes it entirely.

5 likes in reply to #70 2y
TV
t.vargaTL227 Jul 2024#72

Worth separating LEADER as a question about the compound from LEADER as a question about the documentation. They get answered by different people and only one of them is answerable here.

1 like 2y
CE
crossover_entryTL3Regular27 Jul 2024#73

I had written a reply contradicting post #71 and deleted it. Here is what survived.

The most common failure mode is spending fifty minutes on the effect size and ten on the population. Reversing that ratio would improve most sessions.

I would put a moderate confidence on that and no more.

30 likes 2y
LV
l.vermeulenTL228 Jul 2024#74

Confirming post #71 from a second method, which matters more than confirming it from a second person.

An hour is enough for one paper read properly and not enough for two read partly. The temptation is always to add the second.

15 likes 2y
T
TamburelloTL2Member28 Jul 2024#75
v.szabo, post #7: If someone has run LEADER properly I would rather read that than my own reconstruction of it. Posting mine only because the thread has gone quiet. Go to post

Noted, and I have changed what I was going to do on the strength of it.

9 likes in reply to #7 2y
LL
l.lundgrenTL228 Jul 2024#76
s.grimaldi, post #66: The arithmetic on LEADER is the easy part and it is where the errors are, which is an uncomfortable combination. Show your working and someone will catch it. Go to post

This follows post #74 rather than contradicting it.

The figures usually contain the finding and the text usually contains the interpretation. Separating them for the first twenty minutes is a discipline worth keeping.

It is the kind of thing that is obvious once and never again.

2 likes in reply to #66 2y
OA
o.abrahamsenTL3Regular28 Jul 2024#77

Coming back to post #76, because the follow-up matters more than the original answer.

I would put moderate confidence on the mainstream reading of LEADER and no more. That is not scepticism for its own sake; it is where the sourcing actually stops.

0 likes 2y
MN
m.nwosuTL229 Jul 2024 · edited#78

The question underneath LEADER is usually "how would I tell?" rather than "what is true?", and that one has a method attached to it.

Write down what you would expect to see under each hypothesis before you collect anything. If they predict the same observation, collecting it will not help.

21 likes 2y
CR
crossover_reviewTL3Regular29 Jul 2024#79

Post #76 and I disagree about the size of the effect, not about the direction.

Reading order that works for these sessions: registry entry, methods, baseline table, primary result, then abstract last. Reading the abstract first anchors everything that follows.

Worth reading the earlier posts in this thread before acting on mine.

1 like 2y
NB
n.boatengTL229 Jul 2024#80
o.abrahamsen, post #77: Coming back to post #76, because the follow-up matters more than the original answer. I would put moderate confidence on the mainstream reading of LEADER and no more. That is not scepticism for its own sake; it is where the sourcing actually stops. Go to post

What I would want before treating LEADER as settled: the method, the sample, and whether anyone tried to find the opposite result. Two of the three are usually missing.

0 likes in reply to #77 2y
YA
y.adebayoTL229 Jul 2024#81
d.oyelaran, post #5: The most common failure mode is spending fifty minutes on the effect size and ten on the population. Reversing that ratio would improve most sessions. Go to post

The baseline characteristics table is the single most useful page for the questions that get asked here, because it tells you who the result applies to.

Genuinely open to being wrong about this one.

19 likes in reply to #5 2y
EF
endo_fellow_rkTL3Endocrinology fellow30 Jul 2024#82

Post #78 and I disagree about the size of the effect, not about the direction.

The confident answers on LEADER and the well-sourced answers are not the same answers, which is the most useful thing I have learned reading this category.

0 likes 2y

Suggested topics

TopicParticipantsRepliesViewsActivity
Journal club: how we handle discontinuation in obesity trials — what changed since
Journal club: how we handle discontinuation in obesity trials — what changed since — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it…
OVFVIISLJB+14 18 35k 8mo
Journal club: SUSTAIN 6 and its retinopathy signal — does this still hold?
The question in the title: Journal club: SUSTAIN 6 and its retinopathy signal — does this still hold? I will give what I have already checked below so nobody repeats it. Reading SUSTAIN 6 ( N Engl J Med ,…
RONSPPSDOB+60 66 12k 16mo
Journal club: STEP-HFpEF and symptom endpoints — a second dataset
On the subject in the title: Journal club: STEP-HFpEF and symptom endpoints — a second dataset Working notes rather than a conclusion. Posting a small dataset on step-hfpef and symptom endpoints. It is mine,…
EDCRFKTVIA+11 15 4k 10mo
Journal club: SURMOUNT-4 and continuation versus withdrawal — a second dataset
Posting this under the heading it deserves: Journal club: SURMOUNT-4 and continuation versus withdrawal — a second dataset Everything below is what sits behind that. Posting a small dataset on SURMOUNT-4 and…
VMLADNWMD+58 64 17k 13mo
Journal club: STEP 1 and the treatment-policy estimand — does this still hold?
Asking directly, because I could not find a straight answer: Journal club: STEP 1 and the treatment-policy estimand — does this still hold? Working notes on STEP 1 rather than a conclusion. I would rather…
MDAWRMJDVR+118 132 12k 15mo

Related topics — sharing the tags randomised trial, journal club, effect size

TopicParticipantsRepliesViewsActivity
The "under review" status pill and when a moderator applies it
Posting this under the heading it deserves: The "under review" status pill and when a moderator applies it Everything below is what sits behind that. A question about how this site should cite something that…
NLAMDOVRV+96 119 17k 3mo
A preprint whose numbers changed substantially at publication — what changed since
On the subject in the title: A preprint whose numbers changed substantially at publication — what changed since Working notes rather than a conclusion. A preprint question rather than a question about the…
BARVKOESSS+3 7 125 8mo
What is genuinely unknown about long-term amylin agonism
What is genuinely unknown about long-term amylin agonism — that is the question, and I have not found it answered plainly anywhere I have looked. A comparison question rather than a question about one…
RMMDSENK+83 91 46k 1d
Second pass at: Designing a personal experiment that could change your mind
Second pass at: Designing a personal experiment that could change your mind Writing it up because I had to work it out twice and would rather nobody else did. The question about Designing a personal…
JSJISTGBM+39 44 632 14mo
Heterogeneity as information rather than as a nuisance
Posting this under the heading it deserves: Heterogeneity as information rather than as a nuisance Everything below is what sits behind that. An honest uncertainty about heterogeneity rather than a disguised…
DFRJMNAN+88 95 1.2k 6mo