Topic summary

Coming back to: Measurement error in a self-reported exposure

Evidence › Study critique risk of bias observational data effect size disputed

This is a generated summary. It shows the 5 most-liked posts from a topic of 28, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.

h.bhattacharyaTL221 Apr 2026#8

buffer_review, post #7: Statistical significance and clinical importance are different and both are needed. A significant difference below the minimal important difference is a real finding of no practical consequence. The right answer here may simply be that it has not been measured. Go to post

The most useful thing anyone has posted about Measurement error in this category was a table of what had been measured and by whom. That is what I would want again.

22 likes in reply to #7 3mo

ThibodeauTL3Regular22 Apr 2026#11

Attrition is the failure mode most likely to invalidate a result and the least likely to be discussed. Differential attrition between arms is the specific thing to look for.

I would want to see it done twice before believing it once.

32 likes 3mo

CSagredoTL3Regular24 Apr 2026#15

This follows post #13 rather than contradicting it.

The version of Measurement error that I was taught turned out to be a teaching simplification. Useful, and not true in the way I had assumed it was.

24 likes 3mo

f.fontaineTL227 Apr 2026#22

Adding the measurement that post #19 says would settle it.

Generalisability and validity are separate axes. A trial can be internally impeccable and still tell you nothing about the person asking.

Where I would look next, rather than where I would stop.

24 likes 3mo

c.balogunTL228 Apr 2026#26

Picking up post #23: that is the part I would want checked first.

Criticism is more useful when it is narrower. "The trial answers a different question from the one being asked" is actionable; "the trial is flawed" is not.

That is the honest state of it as of this week.

32 likes 3mo

Read the full topic (28 posts)

Suggested topics

Topic	Participants	Replies	Views	Activity
A structured critique template this community uses Evidence › Study critique observational data effect size risk of bias A structured critique template this community uses — setting out what I have, and where I think it stops being reliable. Structured critique template — I have the observation and I do not trust my…		2	18k	1d
About the Study critique category Evidence › Study critique risk of bias confounding observational data Pinned Wiki Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…		4	114	16mo
Selection into a registry and what it does to the estimate Evidence › Study critique risk of bias disputed observational data Selection into a registry and what it does to the estimate — setting out what I have, and where I think it stops being reliable. Working notes on selection rather than a conclusion. I would rather post the…		2	55k	7mo
Selection into a registry and what it does to the estimate — a second dataset Evidence › Study critique confounding risk of bias effect size disputed Solved Posting this under the heading it deserves: Selection into a registry and what it does to the estimate — a second dataset Everything below is what sits behind that. Posting a small dataset on Selection. It is…	+28	32	1.3k	1d
Immortal time bias in a claims-database study Evidence › Study critique risk of bias observational data disputed confounding Closed Immortal time bias in a claims-database study — setting out what I have, and where I think it stops being reliable. Asking about immortal time bias directly, because I have read four threads on it and each…	+29	34	28k	11mo

Related topics — sharing the tags risk of bias, observational data, effect size

Topic	Participants	Replies	Views	Activity
Journal club: semaglutide in MASH, and surrogate endpoints — does this still hold? Evidence › Journal club estimand randomised trial number needed to treat effect size Solved Closed Journal club: semaglutide in MASH, and surrogate endpoints — does this still hold? I have a specific reason for asking rather than idle curiosity, and the context is below. A narrow question about semaglutide…		3	28k	6mo
Confounding by indication, explained with a concrete example Evidence › Study critique confounding observational data disputed On the subject in the title: Confounding by indication, explained with a concrete example Working notes rather than a conclusion. Comparing SURMOUNT-1 ( N Engl J Med , 2022) with SURPASS-2 ( N Engl J Med ,…	+21	25	21k	11mo
Risk-of-bias tools and the judgement they conceal Evidence › Meta-analyses meta-analysis heterogeneity publication bias effect size Wiki Risk-of-bias tools and the judgement they conceal Writing it up because I had to work it out twice and would rather nobody else did. I have spent a fortnight trying to pin risk-of-bias tools down and I want…	+8	12	21k	11mo
Coming back to: Prediction intervals and why they are more honest than confidence intervals Evidence › Meta-analyses publication bias heterogeneity effect size risk of bias Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Prediction intervals — I have the observation and…		2	65	22mo
Journal club: STEP 3 and the intensive behavioural therapy floor — does this still hold? Evidence › Journal club journal club effect size number needed to treat Solved The question in the title: Journal club: STEP 3 and the intensive behavioural therapy floor — does this still hold? I will give what I have already checked below so nobody repeats it. Asking about STEP 3 on…		2	15k	10mo