Reviewer3 is an AI manuscript-review platform aimed at authors, giving pre-submission feedback as simulated peer-review comments so problems are caught while they're still most correctable. It is a multi-agent system — each "reviewer" is itself a multi-agent workflow, with specialised agents for study design, reproducibility, context and limitations, plus verifying agents that double-check the work — deliberately confined to objective, verifiable technical checks (invalid references, AI-generated text, unsupported claims, statistics, missing figure labels) rather than judgements of novelty or significance.
Benefits & outcomes
Catches technical and integrity issues before papers enter the backlogged review system, when they're still fixable and before they can be cited if flawed.
Processes ~7,000 manuscripts a month (mostly direct-to-researcher / B2C).
A dedicated hallucination-dropping agent removes ~1 in 100 comments — roughly the known frontier-LLM hallucination rate.
Privacy-first: encryption, no AI training on manuscripts.
Notes & quotes
Founder Natalie Khalil, a former researcher. Model-agnostic via SDKs across frontier models (benchmarked GPT-5.2 and Gemini 3). Deliberately avoids novelty/significance calls: "a lot of science is serendipitous… we should just do more science." Evaluated in ReviewBench (bioRxiv, 2026) alongside frontier LLMs.
Source: PurePub.ai "AI Reviewers" panel, 14 May 2026 (Natalie Khalil), plus reviewer3.com.
At PurePub.ai's preprint-servers panel (19 May 2026), Khalil detailed a benchmark of 145,000+ human and AI review comments, each labelled by critique type: humans skew toward contribution and clarity (taste/judgement), AI reviewers toward validity, sufficiency and transparency (technical verification) — evidence the two are complementary. Reviewer3 has also built a hallucinated-reference checker aligned with arXiv's screening policy, and uses the scite API to reach paywalled literature where OpenAlex (open only) falls short.
Publisher / company: Reviewer3 (Natalie Khalil)
Date of mention: 14/05/2026
Source: https://reviewer3.com/