Speaking only to risk-of-bias tools as I have actually seen it, rather than as it is usually described: the effect is real, it is smaller than the thread suggests, and the variance between people is larger than the effect.
Topic summary
Risk-of-bias tools and the judgement they conceal
This is a generated summary. It shows the 5 most-liked posts from a topic of 13, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
18 likes 15mo
k.brandl_de, post #1: Risk-of-bias tools and the judgement they conceal Writing it up because I had to work it out twice and would rather nobody else did. I have spent a fortnight trying to pin risk-of-bias tools down and I want to set out where I have got to, because I suspect the honest answer is duller than the thread this will produce. What I have: a… Go to post
Post #5 put the caveat in the right place and I want to underline it.
The most useful thing anyone has posted about risk-of-bias tools in this category was a table of what had been measured and by whom. That is what I would want again.
f.chowdhury, post #8: What would change my mind on risk-of-bias tools is a second dataset collected by someone with no stake in the first. Until then I hold it loosely and I would rather say so than pretend to more. Go to post
Study quality and weighting: some meta-analyses weight all studies equally; others weight by study size or study quality. The choice affects the result and should be stated and justified.
Read the full topic (13 posts)
This topic was referenced in
- Pooling trials with different estimandsEvidence › Meta-analyses · 132 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. The question about pooling buys that I actually want answered is the…
|
+74 | 83 | 6.6k | 8mo |
|
Coming back to: Prediction intervals and why they are more honest than confidence intervals
Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Prediction intervals — I have the observation and…
|
2 | 65 | 22mo | |
|
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Network meta-analysis, from the point of view of someone…
|
2 | 27k | 4h | |
|
Follow-up: Individual participant data versus aggregate data
Individual participant data versus aggregate data — setting out what I have, and where I think it stops being reliable. A follow-up question about Individual participant data versus aggregate that I did not…
|
+101 | 111 | 23k | 18mo |
|
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Posting a small dataset on Random versus fixed effects. It…
|
+95 | 106 | 20k | 17mo |
Related topics — sharing the tags meta-analysis, heterogeneity, publication bias
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Network meta-analysis, from the point of view of someone…
|
2 | 27k | 4h | |
|
[2026 update] Journal club: is percentage weight change the right endpoint?
Journal club: is percentage weight change the right endpoint? — that is the question, and I have not found it answered plainly anywhere I have looked. A question about what the numbers mean rather than what…
|
+105 | 118 | 18k | 11mo |
|
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. The question about STEP 4 that I actually want…
|
+81 | 90 | 54k | 9mo |
|
Measurement error in home scales, with a worked standard deviation
Measurement error in home scales, with a worked standard deviation Writing it up because I had to work it out twice and would rather nobody else did. What changes if the standard account of measurement error…
|
+26 | 31 | 4.3k | 4mo |
|
Journal club: STEP 8 and the fairness of the comparator dose — a second dataset
Posting this under the heading it deserves: Journal club: STEP 8 and the fairness of the comparator dose — a second dataset Everything below is what sits behind that. Posting a small dataset on STEP 8. It is…
|
+18 | 22 | 656 | 13h |