Seeking arXiv Endorsement for CS.CL / CS.AI - Multi-Agent Literature-Review Generation & Citation Verification [R](reddit.com)

Hi everyone, I am a researcher looking for an arXiv endorsement in the Computer Science (Computation and Language—cs.CL) or Artificial Intelligence (cs.AI) category for my upcoming paper. My paper addresses the critical issue of hallucinated/fabricated citations when using LLMs for systematic literature reviews. I propose a four-agent framework built on CrewAI (Academic Retriever, Critical Reviewer, Technical Writer, and Editor/Verifier) that implements an explicit, claim-level citation verification layer. Here are the details of the paper: Title: Claim-Level Citation Verification in Multi-Agent Literature-Review Generation: Architecture, Implementation, and Pilot Evaluation Abstract: "Large language models (LLMs) can accelerate systematic literature review, but single-model pipelines are prone to fabricated or unsupported citations. We present a four-agent framework, built on CrewAI, an Academic Retriever, a Critical Reviewer, a Technical Writer, and an Editor/Verifier, that decomposes review generation into role-specialized stages and adds an independently executed citation-verification step with a confidence-gated escalation rule. We contribute a tested reference implementation (seventy-two automated tests, a live-verified retrieval tool, a deterministic citation checker, and an LLM-as-judge claim-verification layer with an explicit six-class support taxonomy) and a four-condition, sixty-trial pilot against a live LLM backend. The two ablation conditions without an Editor pass reach a 100% citation-existence-and-metadata validity rate; the complete system, the only condition whose Editor checks claim-level entailment rather than mere citation existence, flags 23% of its 291 checked citations as unsupported or only partially supported. This asymmetric comparison does not show the complete system fabricates more, since the other conditions were never checked for this failure mode, but it also does not show the complete system reduces citation errors relative to a fair, uniformly-checked baseline; a topic-level permutation test on the observed gap does not reach conventional significance (p = 0.062, Holm-adjusted p = 0.186), and the pilot’s five-topic sample size limits our ability to determine whether it would generalize. The Editor-to-Writer revision loop specified in the design was never exercised in this pilot’s data: every non-approved trial escalated to human review rather than entering revision, so the results support a confidence-gated detector that surfaces unsupported claims and escalates uncertain cases, not a demonstrated self-correction mechanism. Blinded human validation of the Editor’s own judgments was not collected. We report these boundaries explicitly, together with the reference implementation, the pilot data, and a discussion of the uniformly-checked comparison and revision-loop experiment a stronger evaluation would require." Keywords: Multi-agent systems, large language models, CrewAI, systematic literature review, retrieval-augmented generation, claim-level citation verification, LLM-as-judge. The paper has already been formatted and prepared for submission. If you are a qualified endorser in cs.CL or cs.AI and willing to help, please let me know! I would be delighted to share the full PDF preprint or send the endorsement link via DM. Thank you so much for your time and support! submitted by /u/FanTax98 [link] [Kommentare]