The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique

Selection into a registry and what it does to the estimate

SS
s.solbergTL28 Dec 2025#1

Selection into a registry and what it does to the estimate — setting out what I have, and where I think it stops being reliable.

Working notes on selection rather than a conclusion. I would rather post the reasoning while it can still be corrected than post the answer once I am committed to it.

Everything below is checkable. Where I have taken a figure from somewhere else I have said where; where I have estimated, I have said that too.

0 likes 8mo
LM
lyophil_marginTL3Regular22 Dec 2025 · edited#2

Confirming the opening post from a second method, which matters more than confirming it from a second person.

Choosing the worst interpretation: "The confidence interval includes a harmful effect" is true if the CI goes from -1 to +5. But assuming the worst-case scenario is not how you use the evidence. The point estimate and the precision both matter.

That is one dataset and I would not build a rule on it.

18 likes 7mo
AA
a.amankwahTL21 Jan 2026#3

On the opening post — agreed on the reasoning, with one qualification.

Sample size calculated on an optimistic effect estimate produces a trial that is underpowered for the effect that actually exists. That is visible in the protocol.

The answer changed when I changed how I was measuring, which was informative.

7 likes 7mo

Suggested topics

TopicParticipantsRepliesViewsActivity
A structured critique template this community uses — a second dataset
On the subject in the title: A structured critique template this community uses — a second dataset Working notes rather than a conclusion. Posting a small dataset on structured critique template. It is mine,…
PRFLKBACAW+47 51 16k 15h
A critique that turned out to be unfair, retracted by its author
Posting this under the heading it deserves: A critique that turned out to be unfair, retracted by its author Everything below is what sits behind that. Critique, and specifically the version of it that the…
MSASFIONS+34 38 20k 17h
Coming back to: A structured critique template this community uses
Posting this under the heading it deserves: A structured critique template this community uses Everything below is what sits behind that. Reading back through what has been written here about structured…
SOFAKHASMY+63 69 17k 18h
A well-designed study with a badly written abstract
Posting this under the heading it deserves: A well-designed study with a badly written abstract Everything below is what sits behind that. Reading back through what has been written here about well-designed…
RCMICBMRPN+117 128 7.2k 14mo
A claim built entirely on a subgroup analysis
A claim built entirely on a subgroup analysis Writing it up because I had to work it out twice and would rather nobody else did. I would like to disagree carefully with the settled view on claim built, and I…
ASKHMIASNP+71 80 1.1k 14mo

Related topics — sharing the tags risk of bias, disputed, observational data

TopicParticipantsRepliesViewsActivity
[2026 update] Comparing documentation quality across the directory, tabulated
On the subject in the title: Comparing documentation quality across the directory, tabulated Working notes rather than a conclusion. Structured question about turnaround and what it signals. I have started…
JVCMNOA 3 18k 11mo
Follow-up: Why we hide unevidenced fraud accusations and log the hiding
The question in the title: Why we hide unevidenced fraud accusations and log the hiding I will give what I have already checked below so nobody repeats it. Filing a documentation observation rather than a…
EMMAVDAEEC+12 16 17k 12mo
Contributing data without breaching anyone's privacy
Contributing data without breaching anyone's privacy Writing it up because I had to work it out twice and would rather nobody else did. Asking about contributing data without breaching directly, because I…
CAMFSRDNEM+65 71 839 5mo
[2026 update] Journal club: is percentage weight change the right endpoint?
Journal club: is percentage weight change the right endpoint? — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what the numbers mean rather than what…
MLSCNHHRS+105 118 18k 11mo
Heterogeneity as information rather than as a nuisance
Posting this under the heading it deserves: Heterogeneity as information rather than as a nuisance Everything below is what sits behind that. An honest uncertainty about heterogeneity rather than a disguised…
DFRJMNAN+88 95 1.2k 6mo