The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Trials · continued

Adjudicated events and why the definition matters — the long version posts 61–90

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

HE
h.espinozaTL223 Mar 2025#61
dietitian_hollis, post #8: The figure that circulates in coverage is almost always whichever estimand gives the larger effect. That is not fraud; it is selection, and it is why the paper matters more than the summary. Go to post

The figure that circulates in coverage is almost always whichever estimand gives the larger effect. That is not fraud; it is selection, and it is why the paper matters more than the summary.

0 likes in reply to #8 16mo
ST
slow_titratorTL2Regular24 Mar 2025#62

Answering the Adjudicated events question as asked, then the question I think is meant. As asked: yes, with the qualification below. As meant: it depends on how the first measurement was taken.

20 likes 16mo
RM
r.mensahTL224 Mar 2025#63

Reading back through the Adjudicated events threads from last year, the same three questions come up every time and only one of them has ever been answered properly. That seems like a documentation gap rather than a knowledge gap.

9 likes 16mo
YM
y.mensahTL3Wiki editor25 Mar 2025#64

Post #61 is the version of this I will quote in future. One addition.

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

A single observation, in a thread that deserves better than single observations.

2 likes 16mo
PD
p.dialloTL225 Mar 2025#65
j.steiner, post #1: Adjudicated events and why the definition matters — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Adjudicated events, deliberately narrow, because the broad version has been asked here four times and produced four long threads and no answer. One question,… Go to post

Answering the question post #61 raises rather than the one it answers.

The reason Adjudicated events keeps being re-asked is that the answer is conditional and people quote it without the condition. It is not that the answer is unknown.

29 likes in reply to #1 16mo
BJ
b.jankowiakTL3Regular26 Mar 2025#66

That is a cleaner way of putting what I was circling around.

14 likes 16mo
BW
b.wikstromTL227 Mar 2025#67

Taking Adjudicated events seriously for a moment rather than deflecting: the honest position is that the community has observations and no controlled comparison, and those two things support very different sentences.

5 likes 16mo
BE
bench_entryTL3Regular27 Mar 2025 · edited#68
s.stavrianos, post #16: A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers. Old habit: I write down the expected answer before I calculate it. Go to post

Subgroup analyses are hypothesis-generating unless pre-specified and adequately powered, and almost none are the second. The interaction test matters more than the subgroup point estimate.

That is one dataset and I would not build a rule on it.

0 likes in reply to #16 16mo
ER
e.roosTL228 Mar 2025#69

Adjudicated events: I would want to see the raw numbers rather than the summary before agreeing. Summaries lose exactly the information that would settle this.

21 likes 16mo
BS
buffer_sheetTL3Regular29 Mar 2025#70
dietitian_hollis, post #8: The figure that circulates in coverage is almost always whichever estimand gives the larger effect. That is not fraud; it is selection, and it is why the paper matters more than the summary. Go to post

Narrowing post #69, because the general version has more than one answer.

An observation about Adjudicated events that I cannot explain and am posting anyway, on the principle that unexplained observations are more useful public than private.

9 likes in reply to #8 16mo
EL
endpoint_lineTL3Regular29 Mar 2025#71
DSakamoto, post #18: Where I part company with post #16, and it is a narrow parting. Adjudicated events sits at the boundary between what this community can usefully discuss and what it cannot, and I think it falls on the discussable side, narrowly. Go to post

Multiplicity and multiple comparisons: if a trial tests many hypotheses, the chance of a false positive on at least one by random chance increases. This is why pre-specification of the primary endpoint matters and why secondary endpoints are weaker evidence.

0 likes in reply to #18 16mo
IG
in.guerreroTL230 Mar 2025#72

Seconded. It reads as careful rather than confident, which is the right register.

3 likes 16mo
R
RidgewayTL3Regular30 Mar 2025#73

Building on post #71 rather than restating it.

I think the Adjudicated events question is answerable and has not been answered, which is a more optimistic position than most of this thread.

10 likes 16mo
ID
i.dumitruTL231 Mar 2025#74
e.ferreira, post #2: The opening post is the version of this I will quote in future. One addition. Adjudicated events: I have looked for the primary source twice and failed twice. Either it does not exist or it is somewhere I do not know to look, and I would like to know which. Go to post

Post #70 put the caveat in the right place and I want to underline it.

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

One case, stated as one case.

22 likes in reply to #2 16mo
EF
erratum_fileTL3Regular1 Apr 2025#75

Adjudicated events would be much easier to settle if anyone reported the denominator. Almost nobody reports the denominator.

0 likes 16mo
IG
i.grimaldiTL21 Apr 2025#76
CP
citation_peakTL3Regular2 Apr 2025#77

Taking post #75 at face value and following it one step further.

Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.

Take it as a starting point and not as a specification.

6 likes 16mo
AC
a.cabreraTL22 Apr 2025#78
bench_notes, post #10: Where I would push back on the Adjudicated events consensus is the confidence, not the direction. The direction looks right. The confidence is borrowed. Go to post

Dropout is information: high dropout rates can indicate tolerability problems or lower efficacy than the summary suggests. Where the analysis handled dropouts matters. An intention-to-treat analysis with many dropouts can give a smaller apparent effect than per-protocol analysis.

One more caveat and then I will stop qualifying: the sample selected itself.

16 likes in reply to #10 16mo
KR
k.redgraveTL2Member3 Apr 2025#79
i.boateng, post #3: A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers. I would put this at better than even and not much better. Go to post

That is clearer than the version I had in my head. Thank you.

31 likes in reply to #3 16mo
SI
s.ivaturiTL24 Apr 2025#80
i.wojcik, post #21: Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit. If anyone has run this properly I would rather read that than my own guess. Go to post

Reframing Adjudicated events slightly, because I think the disagreement is about the question rather than the answer. If the question is "does it happen", yes. If it is "how often", nobody here knows.

0 likes in reply to #21 16mo
P
PSkarbekTL3Regular4 Apr 2025#81

Post #80 describes the usual case. This is about the unusual one.

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

Not disagreeing with anyone above, just adding the bit I keep having to look up.

0 likes 16mo
KH
k.haddadTL25 Apr 2025#82

Adding the measurement that post #80 says would settle it.

The figure that circulates in coverage is almost always whichever estimand gives the larger effect. That is not fraud; it is selection, and it is why the paper matters more than the summary.

It is worth stating the boring hypothesis before the interesting one.

18 likes 16mo
BM
buffer_marginTL3Regular5 Apr 2025#83

The honest answer on Adjudicated events is that it depends, and the useful part is the list of what it depends on. Four items, in rough order of how much they matter.

Most people get the first two right and then argue about the fourth.

4 likes 16mo
AH
a.hartmannTL26 Apr 2025#84
y.mensah, post #64: Post #61 is the version of this I will quote in future. One addition. Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers. A single observation, in a thread that deserves better than single observations. Go to post

Fair, and the limits you put on it are the part I will remember.

0 likes in reply to #64 16mo
EC
excursion_checkTL3Regular7 Apr 2025#85

Reporting rather than recommending, on Adjudicated events. What happened is above. Whether it should have is a different question and not one I am qualified to answer.

26 likes 16mo
MA
m.agyemanTL27 Apr 2025#86

Picking up post #83: that is the part I would want checked first.

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

It is worth checking rather than assuming, which costs nothing.

12 likes 16mo
TT
taper_tableTL3Regular8 Apr 2025#87

Counterpoint on Adjudicated events, offered without confidence: the same observation is consistent with a much duller explanation, and nobody has ruled the dull one out.

2 likes 16mo
TV
t.verhoevenTL28 Apr 2025#88
j.asante, post #58: Something worth flagging about Adjudicated events: the strongest-sounding claims in this thread are the ones with no source attached, which is the usual pattern and not a coincidence. Go to post

The most useful reply I ever got about Adjudicated events was a request to state my units. It sounds like pedantry and it has saved me twice.

0 likes in reply to #58 16mo
H
HRouhaniTL1Member9 Apr 2025#89

Noted, and thank you for writing it out rather than summarising it.

19 likes 16mo
EM
e.mensaTL29 Apr 2025 · edited#90

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

8 likes 16mo