02 Bib Verify
Verify a BibTeX file for hallucinated or fabricated references by cross-checking every...
Install
npx skills add agentscope-ai/OpenJudge --skill 02-bib-verify -g -a claude-code -y- Repository
- agentscope-ai/OpenJudge1k
- Category
- Engineering
- Updated
- 5d ago
- License
- Apache-2.0
- Context cost
- Lightabout 569 tokens
- Runs scripts
- No, instructions only
What it does
Verify a BibTeX file for hallucinated or fabricated references by cross-checking every entry against CrossRef, arXiv, and DBLP. Reports each reference as verified, suspect, or not found, with field-level mismatch details (title, authors, year, DOI). Use when the user wants to check a .bib file for fake citations, validate references in a paper, or audit bibliography entries for accuracy.
BibTeX Verification Skill
Check every entry in a .bib file against real academic databases using the
OpenJudge PaperReviewPipeline in BibTeX-only mode:
- Parse, extract all entries from the
.bibfile - Lookup, query CrossRef, arXiv, and DBLP for each reference
- Match, compare title, authors, year, and DOI
- Report, flag each entry as
verified,suspect, ornot_found
Prerequisites
pip install py-openjudge litellm
Gather from user before running
| Info | Required? | Notes |
|---|---|---|
| BibTeX file path | Yes | .bib file to verify |
| CrossRef email | No | Improves CrossRef API rate limits |
Quick start
# Verify a standalone .bib file
python -m cookbooks.paper_review --bib_only references.bib
# With CrossRef email for better rate limits
python -m cookbooks.paper_review --bib_only references.bib --email your@email.com
# Save report to a custom path
python -m cookbooks.paper_review --bib_only references.bib \
--email your@email.com --output bib_report.md
Relevant options
| Flag | Default | Description |
|---|---|---|
--bib_only | , | Path to .bib file (required for standalone verification) |
--email | , | CrossRef mailto, improves rate limits, recommended |
--output | auto | Output .md report path |
--language | en | Report language: en or zh |
Interpreting results
Each reference entry is assigned one of three statuses:
| Status | Meaning |
|---|---|
verified | Found in CrossRef / arXiv / DBLP with matching fields |
suspect | Title or authors do not match any real paper, likely hallucinated or mis-cited |
not_found | No match in any database, treat as fabricated |
