Writ attention-review / paper.md / Merging #1
Document
reconnecting Sign in
Skip to the comparison

Merging · submission #1

Submitted

Tighten the page-length claim in Results · r-kaur · yesterday

2 sentence edits across 2 groups.

  • Meaning changed
  • 0 approvals
  • 1 open finding
Log in to finish this submission.

Tighten the page-length claim in Results

#1 R-

3. Results

Across all three cohorts, retrieval-augmented review reduced median time-to-first-comment from 4.2 days to 1.6 days.

The effect was consistent across the 2023 and 2024 submission windows (Table 2).

Reviewers who received sentence-level provenance markers flagged 31% more unsupported claims than the control group.

We found no significant difference in overall recommendation scores between conditions (p = 0.41).

Finding attached. The improvement holds for submissions under twelve pages, and attenuates beyond that length.

4. Discussion

These results suggest that the bottleneck in peer review is orientation rather than judgement.

Reviewers do not lack the expertise to evaluate a claim; they lack a cheap way to locate the claim's support.

Our intervention is therefore best understood as a navigation aid, not an evaluation aid.

Changed wording. The 31% increase in flagged claims is the headline result.

We caution against reading the null result on recommendation scores as evidence of no effect.

Power to detect a difference smaller than 0.4 points was low in all three cohorts.

Sentence comparison

  1. Reworded Meaning changed
    Before

    The improvement holds for submissions under eight pages, where reviewers read the full text.

    Submitted

    The improvement holds for submissions under twelve pages, and attenuates beyond that length.

  2. Reworded Meaning changed
    Before

    The 31% increase in flagged claims is obviously the headline result.

    Submitted

    The 31% increase in flagged claims is the headline result.

d88ae44submitted version