Writ attention-review / paper.md / Merging #9
Document
reconnecting Sign in
Skip to the comparison

Merging · submission #9

Submitted

llm probe · r-kaur · 3h ago

Substantially removes reported results, the Discussion heading, and the full Discussion paragraph, while replacing the length-boundary result with a different claim (under twenty pages, attenuating beyond).

  • Meaning changed
  • 0 approvals
  • 6 open findings
Log in to finish this submission.

llm probe

#9 R-

3. Results

Finding attached. The improvement holds for submissions under twenty pages, and attenuates beyond that length.

Sentence comparison

  1. Removed Meaning changed fact evidence
    Before

    Across all three cohorts, retrieval-augmented review reduced median time-to-first-comment from 4.2 days to 1.6 days.

    Submitted

    Sentence removed

  2. Changed Meaning changed fact evidence
    Before

    No earlier sentence

    Submitted

    The improvement holds for submissions under twenty pages, and attenuates beyond that length.

  3. Removed Meaning changed fact evidence
    Before

    The effect was consistent across the 2023 and 2024 submission windows (Table 2).

    Submitted

    Sentence removed

  4. Removed Meaning changed fact evidence
    Before

    Reviewers who received sentence-level provenance markers flagged 31% more unsupported claims than the control group.

    Submitted

    Sentence removed

  5. Removed Meaning changed fact evidence
    Before

    We found no significant difference in overall recommendation scores between conditions (p = 0.41).

    Submitted

    Sentence removed

  6. Removed Meaning changed fact evidence
    Before

    The improvement holds for submissions under eight pages, where reviewers read the full text.

    Submitted

    Sentence removed

  7. Removed Meaning changed other
    Before

    ## 4. Discussion

    Submitted

    Sentence removed

  8. Removed Meaning changed claim
    Before

    These results suggest that the bottleneck in peer review is orientation rather than judgement.

    Submitted

    Sentence removed

  9. Removed Meaning changed claim
    Before

    Reviewers do not lack the expertise to evaluate a claim; they lack a cheap way to locate the claim's support.

    Submitted

    Sentence removed

  10. Removed Meaning changed claim
    Before

    Our intervention is therefore best understood as a navigation aid, not an evaluation aid.

    Submitted

    Sentence removed

  11. Removed Meaning changed claim
    Before

    The 31% increase in flagged claims is obviously the headline result.

    Submitted

    Sentence removed

  12. Removed Meaning changed claim
    Before

    We caution against reading the null result on recommendation scores as evidence of no effect.

    Submitted

    Sentence removed

  13. Removed Meaning changed claim
    Before

    Power to detect a difference smaller than 0.4 points was low in all three cohorts.

    Submitted

    Sentence removed

524d535submitted version