The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Topic summary

Risk-of-bias tools and the judgement they conceal

This is a generated summary. It shows the 5 most-liked posts from a topic of 13, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
HA
h.amankwahTL26 May 2025#2

Speaking only to risk-of-bias tools as I have actually seen it, rather than as it is usually described: the effect is real, it is smaller than the thread suggests, and the variance between people is larger than the effect.

18 likes 15mo
RM
r.molnarTL227 Jun 2025#6

Post #5 is right about the mechanism and I think understates the practical bit.

Double extraction with disagreement resolution is standard and is worth checking for, because single extraction errors are common and non-random.

25 likes 13mo
MO
m.onwukaTL228 Jul 2025#9
k.brandl_de, post #1: Risk-of-bias tools and the judgement they conceal Writing it up because I had to work it out twice and would rather nobody else did. I have spent a fortnight trying to pin risk-of-bias tools down and I want to set out where I have got to, because I suspect the honest answer is duller than the thread this will produce. What I have: a… Go to post

Post #5 put the caveat in the right place and I want to underline it.

The most useful thing anyone has posted about risk-of-bias tools in this category was a table of what had been measured and by whom. That is what I would want again.

19 likes in reply to #1 12mo
MP
mira.patelTL4 Admin7 Aug 2025#10
f.chowdhury, post #8: What would change my mind on risk-of-bias tools is a second dataset collected by someone with no stake in the first. Until then I hold it loosely and I would rather say so than pretend to more. Go to post

Study quality and weighting: some meta-analyses weight all studies equally; others weight by study size or study quality. The choice affects the result and should be stated and justified.

8 likes in reply to #8 12mo
AR
a.reyesTL4 Admin5 Sep 2025 · edited#13

Post #10 answers the question as asked. The question underneath it is different.

Double extraction with disagreement resolution is standard and is worth checking for, because single extraction errors are common and non-random.

9 likes 11mo

Read the full topic (13 posts)

Suggested topics

TopicParticipantsRepliesViewsActivity
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. The question about pooling buys that I actually want answered is the…
MDEHDHPMNA+74 83 6.6k 8mo
Coming back to: Prediction intervals and why they are more honest than confidence intervals
Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Prediction intervals — I have the observation and…
TDIBB 2 65 22mo
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Network meta-analysis, from the point of view of someone…
MVMBC 2 27k 4h
Follow-up: Individual participant data versus aggregate data
Individual participant data versus aggregate data — setting out what I have, and where I think it stops being reliable. A follow-up question about Individual participant data versus aggregate that I did not…
HDAPRSGVRV+101 111 23k 18mo
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Posting a small dataset on Random versus fixed effects. It…
NCJVSDBSEF+95 106 20k 17mo

Related topics — sharing the tags meta-analysis, heterogeneity, publication bias

TopicParticipantsRepliesViewsActivity
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Network meta-analysis, from the point of view of someone…
MVMBC 2 27k 4h
[2026 update] Journal club: is percentage weight change the right endpoint?
Journal club: is percentage weight change the right endpoint? — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what the numbers mean rather than what…
MLSCNHHRS+105 118 18k 11mo
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. The question about STEP 4 that I actually want…
AWFLAWCFZL+81 90 54k 9mo
Measurement error in home scales, with a worked standard deviation
Measurement error in home scales, with a worked standard deviation Writing it up because I had to work it out twice and would rather nobody else did. What changes if the standard account of measurement error…
TKSTVMDEB+26 31 4.3k 4mo
Journal club: STEP 8 and the fairness of the comparator dose — a second dataset
Posting this under the heading it deserves: Journal club: STEP 8 and the fairness of the comparator dose — a second dataset Everything below is what sits behind that. Posting a small dataset on STEP 8. It is…
OLIADSRFDO+18 22 656 13h