I'm begging you, we already have more papers than we can read, why are tools for automatically writing papers still popping up everywhere!
Recently, GitHub has once again launched a new AI paper generation tool—
Open Academic Paper Gen.
Don't swipe away just yet!
Besides being able to automatically generate a first draft with references, Open Academic Paper Gen has another feature you must pay attention to—
When it can obtain the full text of a paper, it will search the full text(underline this) for evidence to verify the cited viewpoints within the paper.
To be honest, this is super useful.
Because writing a paper often starts with a research topic, followed by continuously organizing arguments, searching for evidence, and then adjusting one's own judgments based on the literature.
With AI, it can help you brainstorm arguments and also help you search for sources of evidence.
But the problem is, sometimes the arguments or papers are real, but once you put the (AI-given) "argument" back into the full text and read it in context, you might find that the author probably didn't mean that at all.
So, to solve this problem, after obtaining the full text of a paper, Open Academic Paper Gen further locates relevant paragraphs to judge whether that paper can actually support the corresponding argument.
If there's page number information, it will also mark the corresponding PDF page number in the notes, making it easier for people to look it up later.
In other words, it not only checks "if this paper exists," but also checks "if this paper actually said that."
A Multi-Agent Workflow for Generating First Drafts of Papers
Overall, Open Academic Paper Gen is a multi-agent workflow for generating first drafts of papers, breaking down the process from topic selection to export into nine stages:
Define research scope, search for literature, clean and filter, analyze trends, find entry points, outline, write, verify, and finally export.

Similar to other AI paper writing tools, you give it a research topic, like "RSI in the Physical World."
It then breaks down this topic into specific research questions, generates corresponding Chinese and English keywords, and searches for papers in OpenAlex, Crossref, Semantic Scholar, and arXiv.
The retrieved literature is further deduplicated and scored, then filtered for relevance by the model. When encountering highly relevant papers, it continues searching by following their references and later studies that cite them.
It's like grabbing one paper and then following the trail to supplement a batch. The idea is actually a bit like the old CONNECTED PAPERS.
(If you know, you know).

Next, the collected literature is organized into an evidence table, summarizing each paper's research question, method, data, conclusions, and limitations.
With these materials, the system analyzes research trends and proposes possible research angles, gaps, and hypotheses.
There's also a quite interesting step here called Innovativeness Diagnosis.
Open Academic Paper Gen evaluates the entry point from dimensions like problem, method, data, and perspective, points out the most similar existing work in the literature pool, and gives possible critiques reviewers might raise.
(This is like, when you think you've created ResNet, the AI first helps you check if someone else has already done it.)
Specifically, these judgments are based on the literature retrieved this time, but not finding it in the pool doesn't mean no one in the world has done it~
Finally, once the research angle is determined, the system continues to generate an outline and draft sections.
After the first draft is written, it enters the citation verification and simulated peer review stages, and can finally export to Markdown or LaTeX, as well as reference formats like RIS and BibTeX.
Regarding the specific operation mode, in the default mode, Open Academic Paper Gen will pause at major stages, waiting for you to review, edit, and confirm before proceeding.
If you want to test the AI's research capabilities, you can also let it run automatically by choosing the fully automatic mode.
Lastly, friends ready to give it a try should also pay attention to the model configuration:
The project currently supports OpenAI and Zhipu GLM, but for the steps of argument verification, citationless statement checking, and simulated peer review, an OpenAI API Key is still required.
How Does the Citation Check Get into the Sentence?
Honestly, automatically searching for literature, writing a first draft, and then having AI review it is already a common combination in many paper writing projects.
Some of them also incorporate citation verification and manual confirmation to minimize model hallucinations.
Within this workflow, Open Academic Paper Gen further refines the checking and modification of citations.
After all, attaching references to a first draft is one thing; proving that these references can actually support the main text is another.
Specifically, it breaks verification down into three checks.
First, check if the cited paper can be found in the literature pool.
During writing, each citation marker must correspond to a paper already collected.
If the model fabricates a non-existent citation identifier, the system will mark it for easy location and correction.
Second, verify the identity of the cited paper.
Papers with a DOI are first cross-checked with Crossref records; if not found, confirmation is sought at doi.org.
Mismatches in title, author, year, etc., will trigger corresponding warnings.
Third, check if the source text actually supports the statement.
Here, the check truly moves from "paper metadata" into "paper content."
After obtaining the full text, the system finds the paragraph(s) most relevant to the cited argument and feeds them, along with the paper's abstract, to the model to judge whether the source text can support the statement in the main text.
If the full text is unavailable, the abstract or excerpts are used. When page number data exists, warnings can also indicate the corresponding PDF page number, making it easier for people to look it up.
Of course, the model not finding sufficient evidence does not mean it has proven the statement is wrong.
According to Open Academic Paper Gen's handling, when evidence is insufficient, it can be marked as "Unable to judge."
Literature with too little text to verify at all is marked as "Not verified," rather than directly counted as passed.
So, looking at it overall, compared to "writing the paper with one click," the idea of linking literature organization, evidence location, and citation self-check is indeed clever.
Especially when facing arguments and evidence generated by AI, and feeling "it seems plausible, but I don't dare to just trust it," being able to find the corresponding original text at least provides another handle for verification.
By the way, this project is from an individual developer Cat Uncle. Besides Open Academic Paper Gen, he has previously released several projects including an AI scriptwriter and an AI researcher.

Reference Links
[1]https://github.com/mmlong818/open-academic-paper-gen
This article is from the WeChat public account "QbitAI", author: henry





