Topic summary

Publication bias detection and its low power — does this still hold?

Evidence › Meta-analyses publication bias risk of bias meta-analysis heterogeneity Solved

This is a generated summary. It shows the 5 most-liked posts from a topic of 29, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.

s.perrinTL2 Solution3 Jan 2026#5

Post #3 describes the usual case. This is about the unusual one.

The practical version of Publication bias detection is three sentences long. The rigorous version is three pages and reaches the same conclusion with the conditions attached.

9 likes 7mo

an.kirchnerTL216 Jan 2026 · edited#7

Two questions I would want answered before drawing anything from the Publication bias detection data above: how were the cases selected, and what happened to the ones that dropped out.

29 likes 6mo

s.beaulieuTL23 Mar 2026#15

Marking my uncertainty on Publication bias detection explicitly. I am confident about the direction, much less confident about the size, and not confident at all that it generalises past the case in the first post.

25 likes 5mo

l.parkinsonTL2Member16 Apr 2026#24

Seconded. It reads as careful rather than confident, which is the right register.

23 likes 3mo

NLoughranTL3Regular5 May 2026#28

Double extraction with disagreement resolution is standard and is worth checking for, because single extraction errors are common and non-random.

I am aware this is the third time this month I have made this point.

31 likes 3mo

Read the full topic (29 posts)

This topic was referenced in

Pooling trials with different estimandsEvidence › Meta-analyses · 132 replies
Reading a meta-analysis you disagree with, fairlyEvidence › Meta-analyses · 13 replies

Suggested topics

Topic	Participants	Replies	Views	Activity
What pooling buys you and what it destroys Evidence › Meta-analyses publication bias risk of bias meta-analysis heterogeneity Solved The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. The question about pooling buys that I actually want answered is the…	+74	83	6.6k	8mo
Heterogeneity as information rather than as a nuisance Evidence › Meta-analyses heterogeneity risk of bias meta-analysis effect size Posting this under the heading it deserves: Heterogeneity as information rather than as a nuisance Everything below is what sits behind that. An honest uncertainty about heterogeneity rather than a disguised…	+88	95	1.2k	6mo
When a network meta-analysis is defensible and when it is not Evidence › Meta-analyses effect size heterogeneity publication bias Solved When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Network meta-analysis, from the point of view of someone…		2	27k	4h
Prediction intervals and why they are more honest than confidence intervals Evidence › Meta-analyses heterogeneity risk of bias effect size publication bias Solved Closed Posting this under the heading it deserves: Prediction intervals and why they are more honest than confidence intervals Everything below is what sits behind that. I have spent a fortnight trying to pin…	+21	25	46k	4mo
Publication bias detection and its low power Evidence › Meta-analyses heterogeneity publication bias effect size On the subject in the title: Publication bias detection and its low power Working notes rather than a conclusion. Working notes on publication bias detection rather than a conclusion. I would rather post the…		2	3.2k	1d

Related topics — sharing the tags publication bias, risk of bias, meta-analysis

Topic	Participants	Replies	Views	Activity
Tracking a preprint to publication: a worked example — the long version Evidence › Preprints risk of bias preprint effect size Posting this under the heading it deserves: Tracking a preprint to publication: a worked example — the long version Everything below is what sits behind that. A preprint question rather than a question about…	+38	47	560	22mo
Why a preprint's supplementary material is often the best part Evidence › Preprints needs a source risk of bias preprint effect size Why a preprint's supplementary material is often the best part I have a specific reason for asking rather than idle curiosity, and the context is below. A question about how this site should cite something…	+38	42	863	22mo
Measurement error in home scales, with a worked standard deviation Research Methods › Statistics effect size heterogeneity number needed to treat confounding Solved Wiki Measurement error in home scales, with a worked standard deviation Writing it up because I had to work it out twice and would rather nobody else did. What changes if the standard account of measurement error…	+26	31	4.3k	4mo
How this community labels and discusses unrefereed work Evidence › Preprints risk of bias effect size preprint needs a source How this community labels and discusses unrefereed work — that is the question, and I have not found it answered plainly anywhere I have looked. Reading an unrefereed manuscript properly, and asking whether I…	+112	119	1.3k	2y
The "under review" status pill and when a moderator applies it Evidence › Preprints risk of bias effect size preprint Posting this under the heading it deserves: The "under review" status pill and when a moderator applies it Everything below is what sits behind that. A question about how this site should cite something that…	+96	119	17k	3mo