Signals Manuscript Checks at JMIR Publications

JMIR Publications, SignalsBuilt by: vendor working with a publisherStatus: LiveYear: 2025

Last updated November 2026

Overview

JMIR Publications screens every new submission to its journals with Signals Manuscript Checks, which evaluates manuscripts automatically to identify research integrity issues. Signals describes its evaluations as combining network analysis, expert knowledge and AI, and the tool enables AI-supported investigations of manuscripts through Sleuth AI, Signals’ AI-powered research integrity assistant. The checks used at JMIR cover:

  • the authors’ publication and retraction history
  • retraction rates at the authors’ institutions
  • whether the cited references are valid
  • self-citation and citation-clustering patterns
  • some automated checks of the manuscript content.

Signals and JMIR built an integration between Signals Manuscript Checks and JMIR’s editorial management system in late 2025, and since January 2026 every new submission across the JMIR portfolio has been screened automatically. Each manuscript is rated Looks Good, Caution or Alert, and the editorial team reviews the rating during desk triage. Manuscripts rated Caution or Alert go to JMIR’s research integrity team, which investigates, recommends a next step and passes its findings to the handling editor. Of the three ratings, Alert is the one that stops a manuscript before editorial assessment. Signals reports that it analyses thousands of JMIR submissions each month, and that JMIR’s research integrity team investigated over 150 Alerts in the month before the post was published. By November 2026 JMIR had also started using Signals in its final manuscript quality checks before an acceptance decision.

Benefits and outcomes

  • Signals reports that newly submitted manuscripts rated Alert are more than twice as likely as those rated Caution or Looks Good to be rejected on verified grounds.
  • Signals reports that since the beginning of 2026 its Author History signal has flagged over 900 manuscripts by authors with a history of retractions or articles flagged by the Problematic Paper Screener.

Notes and quotes

  • “Signals does not make editorial decisions: it surfaces potential issues and supporting evidence.” Signals, November 2026.
  • Some updates to Signals’ models temporarily increased false positives.
  • When new signal types such as Author History were introduced, the number of alerts rose, which affected live workflows and the integrity team’s workload.
  • JMIR found problems with author name disambiguation, which Signals then corrected.
  • Thresholds and scoring had to be tuned to fit JMIR’s workflow; the post says “integrity-screening thresholds aren’t one-size-fits-all”.
  • “Integrating Signals Manuscript Checks across our portfolio is a major step forward.” Tiffany Leung, Scientific Editorial Director, JMIR Publications, November 2025.

Sources

This entry was written with the help of AI, from the sources listed. Please check the sources before relying on it, and let us know if anything needs correcting.