The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Documentation · Doc review

Revisiting: Review: an evidence digest and the citation check that delayed it

Solved Closed
Solved by GDashwood in post #3
The opening post and I disagree about the size of the effect, not about the direction. Review date disputes: if a maintained page's review date is approaching and it has not been updated, post a note so the maintainers notice.

Jump to the accepted answer →

JM
j.mwangiTL4 Moderator12 Jul 2025#1

Revisiting: Review: an evidence digest and the citation check that delayed it — setting out what I have, and where I think it stops being reliable.

Proposing that evidence digest deserves a maintained page rather than a recurring topic, and drafting the skeleton here so that the argument about scope happens before the writing rather than after.

What I think belongs on it, what does not, and the three claims that would need a citation each.

54 likes 13mo
JT
j.teixeiraTL221 Jul 2025 · edited#2

Nothing to add on the substance. Thank you for taking the question at face value.

14 likes 12mo
G
GDashwoodTL3Regular Solution28 Jul 2025#3

The opening post and I disagree about the size of the effect, not about the direction.

Review date disputes: if a maintained page's review date is approaching and it has not been updated, post a note so the maintainers notice.

12 likes 12mo
SS
s.solbergTL23 Aug 2025#4

Fact-checking: if you see a factual claim in a maintained page that you have evidence contradicts, post the evidence here. The maintainer will review and correct if you are right.

Second-hand, so weight it accordingly.

0 likes 12mo
NS
n.stanescuTL28 Aug 2025#5

Nothing in a maintained document is medical advice and the review should confirm the page says so where it matters rather than only in a footer.

It is a small point and it changes the answer, which is an awkward combination.

21 likes 12mo
LC
lu.cabreraTL213 Aug 2025#6
j.mwangi, post #1: Revisiting: Review: an evidence digest and the citation check that delayed it — setting out what I have, and where I think it stops being reliable. Proposing that evidence digest deserves a maintained page rather than a recurring topic, and drafting the skeleton here so that the argument about scope happens before the writing rather… Go to post

Agreed on evidence digest, with one qualification that I think matters. The reasoning holds for the case as described. Change the starting assumption and it does not, and the starting assumption is the part nobody states.

9 likes in reply to #1 11mo
VS
v.salgadoTL218 Aug 2025#7

Post #3 put the caveat in the right place and I want to underline it.

The limitations section is the part most often thin at review and most often load-bearing afterwards.

2 likes 11mo
MS
m.silvaTL222 Aug 2025#8

Building on post #7 rather than restating it.

Where the review finds the content is right but the framing overstates it, that is the most valuable catch available at this stage.

0 likes 11mo
VM
v.milanoviTL3Regular27 Aug 2025 · edited#9
j.mwangi, post #1: Revisiting: Review: an evidence digest and the citation check that delayed it — setting out what I have, and where I think it stops being reliable. Proposing that evidence digest deserves a maintained page rather than a recurring topic, and drafting the skeleton here so that the argument about scope happens before the writing rather… Go to post

I had written a reply contradicting post #7 and deleted it. Here is what survived.

Check the links. Promotion frequently breaks a cross-reference because the source topic now points at the document rather than the reverse.

Adding a source would improve this post and I do not have one to hand.

0 likes in reply to #1 11mo
FP
f.petrovTL231 Aug 2025#10

Where content is lifted from a topic, attribution should be in the document rather than only in the review thread.

Not disagreeing with anyone above, just adding the bit I keep having to look up.

28 likes 11mo
HA
h.agyemanTL25 Sep 2025#11

The failure mode on evidence digest is boring rather than dramatic. It is almost always the step everyone assumes was done correctly because it is too simple to get wrong.

29 likes 11mo
DH
dietitian_hollisTL3Dietitian9 Sep 2025#12
j.mwangi, post #1: Revisiting: Review: an evidence digest and the citation check that delayed it — setting out what I have, and where I think it stops being reliable. Proposing that evidence digest deserves a maintained page rather than a recurring topic, and drafting the skeleton here so that the argument about scope happens before the writing rather… Go to post

The four criteria are that the question recurs, that the content is correct and sourced or labelled as community practice, that somebody will be named as maintainer with a review date, and that no unresolved substantive objection stands.

0 likes in reply to #1 11mo
SM
s.mbekiTL213 Sep 2025#13
n.stanescu, post #5: Nothing in a maintained document is medical advice and the review should confirm the page says so where it matters rather than only in a footer. It is a small point and it changes the answer, which is an awkward combination. Go to post

Evidence synthesis requests: if you think a page should summarise the state of evidence on a question, and you think the information exists but is scattered, suggest how it could be brought together.

That matches what I was told, which is not the same as knowing it.

2 likes in reply to #5 10mo
NA
n.abernathyTL3Analytical chemist17 Sep 2025#14

Where I part company with post #10, and it is a narrow parting.

Adding a reference point for evidence digest. Mine is a single case, collected without controls, and I am posting the method alongside it so it can be discounted appropriately.

9 likes 10mo
SC
s.cabreraTL221 Sep 2025 · edited#15

Citation checking: if a maintained page cites a paper, the citation should match what the paper actually says. If you notice a mismatch, post it here.

Speaking for myself and not for anyone else who has posted here.

22 likes 10mo
PW
PharmNotes_WhitfieldTL4Pharmacist25 Sep 2025#16

The most useful review comment names a sentence and says what is wrong with it. General approval and general concern are both hard to act on.

The variance between people here is larger than the effect being discussed.

0 likes 10mo
VB
v.baptistaTL229 Sep 2025#17
v.milanovi, post #9: I had written a reply contradicting post #7 and deleted it. Here is what survived. Check the links. Promotion frequently breaks a cross-reference because the source topic now points at the document rather than the reverse. Adding a source would improve this post and I do not have one to hand. Go to post

Confirming post #16 from a second method, which matters more than confirming it from a second person.

Two people in this thread mean different things by evidence digest and are disagreeing about the definition while believing they are disagreeing about the facts. Worth pausing to define it.

1 like in reply to #9 10mo
BN
bench_notesTL4 Moderator2 Oct 2025#18

I had written a reply contradicting post #14 and deleted it. Here is what survived.

The version of evidence digest that circulates here is a simplification of a simplification. It is not wrong, but it has lost the conditions under which it holds, and those conditions are where the interesting cases live.

6 likes 10mo
KF
k.fonsecaTL26 Oct 2025#19
j.teixeira, post #2: Nothing to add on the substance. Thank you for taking the question at face value. Go to post

Right, and stated more narrowly than I would have dared to state it.

15 likes in reply to #2 10mo
KV
k.vanheckeTL210 Oct 2025#20

I read post #18 twice before replying, because I had assumed the opposite.

Reviewing your own nomination is fine and is not sufficient. Somebody else has to read it for the process to mean anything.

A qualification I should have led with rather than closed on.

30 likes 10mo
SO
s.okonkwoTL214 Oct 2025#21

Worth separating two things that post #20 runs together.

Check the arithmetic in every worked example by hand. A wrong worked example is worse than no example and survives longer.

0 likes 9mo
HK
h.kjeldsenTL1Member17 Oct 2025#22

This follows post #20 rather than contradicting it.

Check that each claim is sourced or explicitly labelled as community practice. Unmarked practice claims read as sourced ones.

Caveat: everything above assumes the paperwork is what it says it is.

0 likes 9mo
MN
m.ndiayeTL221 Oct 2025#23
n.stanescu, post #5: Nothing in a maintained document is medical advice and the review should confirm the page says so where it matters rather than only in a footer. It is a small point and it changes the answer, which is an awkward combination. Go to post

Review of promoted topics: when a topic is nominated for promotion to a maintained documentation page, the draft is posted here. Community review happens before promotion. Objections are welcome.

The strength of my opinion here exceeds the strength of my evidence.

12 likes in reply to #5 9mo
BP
bench_peakTL3Regular24 Oct 2025#24
m.ndiaye, post #23: Review of promoted topics: when a topic is nominated for promotion to a maintained documentation page, the draft is posted here. Community review happens before promotion. Objections are welcome. The strength of my opinion here exceeds the strength of my evidence. Go to post

Reviewing your own nomination is fine and is not sufficient. Somebody else has to read it for the process to mean anything.

4 likes in reply to #23 9mo
ND
n.dziedzicTL228 Oct 2025#25

Post #23 and I disagree about the size of the effect, not about the direction.

For anyone finding this later: the short answer on evidence digest is that it depends on one thing, and the rest of the thread is people identifying which thing.

1 like 9mo
SS
stopper_shiftTL1Member31 Oct 2025 · edited#26

Evidence digest is one of those subjects where the general answer and the answer for a specific case diverge, and the thread will go in circles until someone says which one is being asked for.

0 likes 9mo
TV
to.vargaTL24 Nov 2025#27

Noted, and thank you for writing it out rather than summarising it.

18 likes 9mo
CD
cohort_driftTL3Regular7 Nov 2025#28
j.teixeira, post #2: Nothing to add on the substance. Thank you for taking the question at face value. Go to post

Narrowing post #26, because the general version has more than one answer.

Ask what the page would look like if it were wrong. A document with no stated failure conditions is hard to review and harder to maintain.

7 likes in reply to #2 9mo
HC
h.castellanosTL211 Nov 2025#29

Review the scope as well as the content. A page attempting too much is the commonest structural problem at this stage.

The literature is thinner on this than the confidence in the thread implies.

4 likes 9mo
FE
footnote_entryTL3Regular14 Nov 2025#30

Before the thread moves on from evidence digest — what is the sample size behind the claim? I am not being difficult; I have seen the same figure quoted from an n of four and from an n of four hundred.

0 likes 8mo