The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique

Coming back to: A structured critique template this community uses

SO
s.okonkwoTL222 Apr 2026#1

Posting this under the heading it deserves: A structured critique template this community uses Everything below is what sits behind that.

Reading back through what has been written here about structured critique template, three questions come up every time and only one has ever been answered properly.

Listing all three, with what I think the state of the answer is for each, so the thread can start further along than the last one did.

45 likes 3mo
FA
f.abrahamsenTL2Member26 Apr 2026#2

Where I part company with the opening post, and it is a narrow parting.

On structured critique template I would separate what is worth knowing from what is worth acting on. The first list is long and the second is short, and conflating them is how threads get heated.

0 likes 3mo
KH
ka.haddadTL228 Apr 2026#3

The arithmetic in the opening post is right; the assumption feeding it is the part to check.

The strongest critiques cite the section they rely on. A critique without a page reference is an impression, however well informed.

3 likes 3mo
AS
a.salcedoTL3Regular30 Apr 2026#4
f.abrahamsen, post #2: Where I part company with the opening post, and it is a narrow parting. On structured critique template I would separate what is worth knowing from what is worth acting on. The first list is long and the second is short, and conflating them is how threads get heated. Go to post

The most useful reply I ever got about structured critique template was a request to state my units. It sounds like pedantry and it has saved me twice.

11 likes in reply to #2 3mo
MY
m.yilmazTL22 May 2026 · edited#5

The honest answer on structured critique template is that it depends, and the useful part is the list of what it depends on. Four items, in rough order of how much they matter.

Most people get the first two right and then argue about the fourth.

17 likes 3mo
SD
s.duarteTL24 May 2026#6

Attrition is the failure mode most likely to invalidate a result and the least likely to be discussed. Differential attrition between arms is the specific thing to look for.

Filing this under things that are true until someone shows me otherwise.

0 likes 3mo
VB
v.bhattacharyaTL26 May 2026#7
f.abrahamsen, post #2: Where I part company with the opening post, and it is a narrow parting. On structured critique template I would separate what is worth knowing from what is worth acting on. The first list is long and the second is short, and conflating them is how threads get heated. Go to post

Adding the measurement that post #4 says would settle it.

Reporting rather than recommending, on structured critique template. What happened is above. Whether it should have is a different question and not one I am qualified to answer.

1 like in reply to #2 3mo
JD
j.dahlbergTL28 May 2026#8
ka.haddad, post #3: The arithmetic in the opening post is right; the assumption feeding it is the part to check. The strongest critiques cite the section they rely on. A critique without a page reference is an impression, however well informed. Go to post

Post #6 describes the usual case. This is about the unusual one.

Checked the structured critique template claim against the primary source this morning. It survives, with a narrower scope than the version quoted here. Posting the narrower scope.

7 likes in reply to #3 3mo
TW
t.wojcikTL210 May 2026#9

Post #8 is right about the mechanism and I think understates the practical bit.

A critique should end with what would change your mind. Without that it is a position rather than an argument.

0 likes 3mo
AK
a.kowalskiTL212 May 2026#10

Noted, and thank you for writing it out rather than summarising it.

1 like 3mo
I
IMainwaringTL3Regular13 May 2026#11

Where I part company with post #9, and it is a narrow parting.

Structured critique template would be much easier to settle if anyone reported the denominator. Almost nobody reports the denominator.

19 likes 3mo
IB
i.beaulieuTL215 May 2026#12
N
NLoughranTL3Regular17 May 2026#13

Helpful, and short, which on this subject is harder than long.

2 likes 2mo
VM
v.malinowskiTL218 May 2026#14

Adding a null result on structured critique template. I looked, carefully, and found nothing, and null results deserve posting precisely because they never are.

0 likes 2mo
F
FFaulknerTL3Regular20 May 2026#15

A note on scope: what I am saying about structured critique template applies to the case in the first post and I would not extend it further without checking.

13 likes 2mo
SM
so.mbekiTL221 May 2026#16

Confirming post #14 from a second method, which matters more than confirming it from a second person.

Generalisability and validity are separate axes. A trial can be internally impeccable and still tell you nothing about the person asking.

That is the practical version. The rigorous version is longer and says the same thing.

4 likes 2mo
OT
osmolal_tableTL1Member23 May 2026#17
m.yilmaz, post #5: The honest answer on structured critique template is that it depends, and the useful part is the list of what it depends on. Four items, in rough order of how much they matter. Most people get the first two right and then argue about the fourth. Go to post

The most useful thing anyone has posted about structured critique template in this category was a table of what had been measured and by whom. That is what I would want again.

0 likes in reply to #5 2mo
BA
b.adeyemiTL224 May 2026#18

Where a critique rests on a subgroup, check whether the interaction was tested. A difference between subgroups that is not statistically supported is not a difference.

A guess, clearly labelled as one.

0 likes 2mo
O
OstrowskiTL2Member26 May 2026#19

On structured critique template, the part that usually goes wrong is that the question is asked as though it has one answer. It has a range, and the width of the range is the interesting bit.

If you can post the two or three numbers you are working from, several people here will check the arithmetic rather than argue about the conclusion.

8 likes 2mo
HN
h.nwosuTL227 May 2026#20

I would rather this thread reach "we do not know" about structured critique template than reach a confident answer that nobody can support when asked.

2 likes 2mo
SR
s.rasmussenTL229 May 2026#21

Per-protocol and intention-to-treat analyses answer different questions and neither is the honest one by default. Reporting both is the practice worth insisting on.

The strength of my opinion here exceeds the strength of my evidence.

0 likes 2mo
FW
f.wojcikTL230 May 2026#22
h.nwosu, post #20: I would rather this thread reach "we do not know" about structured critique template than reach a confident answer that nobody can support when asked. Go to post

Post #20 put the caveat in the right place and I want to underline it.

Blinding, duration and comparator choice trade against each other. Improving one usually costs another, and a critique that ignores the trade is incomplete.

The number is defensible. The precision I gave it is not.

0 likes in reply to #20 2mo
EO
e.okaforTL231 May 2026#23

The arithmetic in post #22 is right; the assumption feeding it is the part to check.

What would change my mind on structured critique template is a second dataset collected by someone with no stake in the first. Until then I hold it loosely and I would rather say so than pretend to more.

8 likes 2mo
LT
l.trevinoTL22 Jun 2026#24

The useful distinction on structured critique template is between what was measured and what was inferred from it. Both end up in the same sentence and only one of them has error bars.

19 likes 2mo
OC
o.cousineauTL3Regular3 Jun 2026#25
FFaulkner, post #15: A note on scope: what I am saying about structured critique template applies to the case in the first post and I would not extend it further without checking. Go to post

Where a critique changes your position, saying so in the thread is worth more than being right, and it is the thing this subcategory does better than most places.

27 likes in reply to #15 2mo
NV
n.vogelTL25 Jun 2026 · edited#26
s.rasmussen, post #21: Per-protocol and intention-to-treat analyses answer different questions and neither is the honest one by default. Reporting both is the practice worth insisting on. The strength of my opinion here exceeds the strength of my evidence. Go to post

A request rather than an answer: could whoever has the primary source for structured critique template post it? I have seen the claim three times this month and each version had lost a qualifier.

0 likes in reply to #21 2mo
CN
c.niemelTL3Regular6 Jun 2026#27

Adding the measurement that post #26 says would settle it.

Source for the structured critique template figure, since it was asked for. It is in the discussion rather than the abstract, which is why the version circulating is stronger than the paper is.

Reading the surrounding paragraph is worth the two minutes. The authors are more careful than their summarisers.

4 likes 2mo
NN
n.nakamuraTL27 Jun 2026#28

A criticism that would apply equally to every trial in the field is worth stating once and is not a reason to discount a particular paper.

The disagreement above is smaller than it looks once the terms are fixed.

13 likes 2mo
ZO
z.okonkwoTL29 Jun 2026#29

I think the structured critique template question is answerable and has not been answered, which is a more optimistic position than most of this thread.

0 likes 2mo
SS
system_suitabilityTL3Analytical chemist10 Jun 2026#30

Generalisability: do the inclusion/exclusion criteria narrow the population so much that results do not apply to real people asking about it? This is a fair criticism but requires specificity about which real people and why the difference matters.

4 likes 2mo