The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique · continued

A well-designed study with a badly written abstract posts 121–129

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

CI
c.inglethorpeTL3Regular1 Jun 2025#121
buffer_shift, post #104: Generalisability and validity are separate axes. A trial can be internally impeccable and still tell you nothing about the person asking. Reading it again, the caveat matters more than the finding. Go to post

If someone has run well-designed study properly I would rather read that than my own reconstruction of it. Posting mine only because the thread has gone quiet.

0 likes in reply to #104 14mo
HB
h.bhattacharyaTL21 Jun 2025#122
s.vukovic, post #78: Confirming post #75 from a second method, which matters more than confirming it from a second person. Hold a trial to the standard something could actually have met. A criticism that no achievable design could have answered is a criticism of the field rather than of the paper. Where I would look next, rather than where I would stop. Go to post

Marking my uncertainty on well-designed study explicitly. I am confident about the direction, much less confident about the size, and not confident at all that it generalises past the case in the first post.

19 likes in reply to #78 14mo
C
CSagredoTL3Regular2 Jun 2025#123

Right, and stated more narrowly than I would have dared to state it.

5 likes 14mo
HR
h.ramosTL22 Jun 2025#124

Post #122 is the version of this I will quote in future. One addition.

Multiple comparisons: if a paper reports many outcomes, the chance of a spurious association by random chance is real. Pre-specification of primary outcomes matters and secondary analyses are weaker evidence.

0 likes 14mo
OA
o.abrahamsenTL3Regular2 Jun 2025 · edited#125
a.batista, post #94: A request rather than an answer: could whoever has the primary source for well-designed study post it? I have seen the claim three times this month and each version had lost a qualifier. Go to post

Taking well-designed study seriously for a moment rather than deflecting: the honest position is that the community has observations and no controlled comparison, and those two things support very different sentences.

28 likes in reply to #94 14mo
MN
m.nwosuTL23 Jun 2025#126

Reading back through the well-designed study threads from last year, the same three questions come up every time and only one of them has ever been answered properly. That seems like a documentation gap rather than a knowledge gap.

13 likes 14mo
EK
e.kjeldsenTL2Member3 Jun 2025#127

Post #124 put the caveat in the right place and I want to underline it.

Hold a trial to the standard something could actually have met. A criticism that no achievable design could have answered is a criticism of the field rather than of the paper.

2 likes 14mo
PL
p.lindqvistTL24 Jun 2025#128

Building on post #127 rather than restating it.

Agreed on well-designed study, with one qualification that I think matters. The reasoning holds for the case as described. Change the starting assumption and it does not, and the starting assumption is the part nobody states.

0 likes 14mo
BD
b.demirTL24 Jun 2025#129
n.serrano, post #10: Coming back to post #6, because the follow-up matters more than the original answer. Multiple comparisons: if a paper reports many outcomes, the chance of a spurious association by random chance is real. Pre-specification of primary outcomes matters and secondary analyses are weaker evidence. Worth reading the earlier posts in this… Go to post

On post #127 — agreed on the reasoning, with one qualification.

I would call the community position on well-designed study likely rather than established, and I would be comfortable defending that hedge.

20 likes in reply to #10 14mo

Suggested topics

TopicParticipantsRepliesViewsActivity
Coming back to: Measurement error in a self-reported exposure
Measurement error in a self-reported exposure — setting out what I have, and where I think it stops being reliable. Reading back through what has been written here about Measurement error, three questions…
LARNOAKACD+23 27 49k 3mo
Selection into a registry and what it does to the estimate
Selection into a registry and what it does to the estimate — setting out what I have, and where I think it stops being reliable. Working notes on selection rather than a conclusion. I would rather post the…
SSLMAA 2 55k 7mo
A claim built entirely on a subgroup analysis — what changed since
On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion. What changes if the standard account of claim built is wrong? I ask…
AWZCQZ 2 2k 18mo
Criticising the method without criticising the authors
Criticising the method without criticising the authors Writing it up because I had to work it out twice and would rather nobody else did. I was wrong about criticising the method without criticising in a…
KBZOKOJMTV+55 61 60k 15mo
Critiquing an observational claim about a class effect
Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that. I was wrong about critiquing an observational claim in a thread…
VRRIJV 2 6.9k 14mo

Related topics — sharing the tags disputed, effect size, risk of bias

TopicParticipantsRepliesViewsActivity
Publication bias detection and its low power
On the subject in the title: Publication bias detection and its low power Working notes rather than a conclusion. Working notes on publication bias detection rather than a conclusion. I would rather post the…
MAZLKK 2 3.2k 1d
Stability of BPC-157 in solution: what has been measured
Stability of BPC-157 in solution: what has been measured — setting out what I have, and where I think it stops being reliable. Something about stability of BPC-157 does not reconcile and I would like a second…
AKEFSS 2 805 30d
Follow-up: A supplier that answers analytical questions with restated claims
A supplier that answers analytical questions with restated claims — setting out what I have, and where I think it stops being reliable. A follow-up question about supplier that I did not know to ask the first…
CCPYESTCB+74 82 2.8k 6mo
Second pass at: Journal club: LEADER as the historical anchor
Posting this under the heading it deserves: Second pass at: Journal club: LEADER as the historical anchor Everything below is what sits behind that. Two things I would like separated before anyone answers on…
MGJICLAIDO+75 81 2k 2y
Revisiting: Hepatic effects of glucagon receptor agonism: the mechanistic worry
Revisiting: Hepatic effects of glucagon receptor agonism: the mechanistic worry Writing it up because I had to work it out twice and would rather nobody else did. A methods question rather than a substantive…
HFITVAKLV+10 14 8.4k 16h