01 Paper Review
Review academic papers for correctness, quality, and novelty using OpenJudge's...
Install
npx skills add agentscope-ai/OpenJudge --skill 01-paper-review -g -a claude-code -y- Repository
- agentscope-ai/OpenJudge1k
- Category
- Documents
- Updated
- 5d ago
- License
- Apache-2.0
- Context cost
- Mediumabout 2,254 tokens
- Runs scripts
- No, instructions only
What it does
Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.
Paper Review Skill
Multi-stage academic paper review using the OpenJudge PaperReviewPipeline:
- Safety check, jailbreak detection + format validation
- Correctness, objective errors (math, logic, data inconsistencies)
- Review, quality, novelty, significance (score 1, 6)
- Criticality, severity of correctness issues
- BibTeX verification, cross-checks references against CrossRef/arXiv/DBLP
Prerequisites
# Install OpenJudge
pip install py-openjudge
# Extra dependency for paper_review
pip install litellm
pip install pypdfium2 # only if using vision mode (use_vision_for_pdf=True)
Gather from user before running
| Info | Required? | Notes |
|---|---|---|
| Paper file path | Yes | PDF or .tar.gz/.zip TeX package |
| API key | Yes | Env var preferred: OPENAI_API_KEY, ANTHROPIC_API_KEY, etc. |
| Model name | No | gpt-5.2, anthropic/claude-opus-4-6, dashscope/qwen-vl-plus. See Model selection below |
| Discipline | No | If not given, uses general CS/ML-oriented prompts |
| Venue | No | e.g. "NeurIPS 2025", "The Lancet" |
| Instructions | No | Free-form reviewer guidance, e.g. "Focus on experimental design" |
| Language | No | "en" (default) or "zh" for Simplified Chinese output |
| BibTeX file | No | Required only for reference verification |
| CrossRef email | No | Improves API rate limits for BibTeX verification |
Quick start
File type is auto-detected: .pdf → PDF review, .tar.gz/.zip → TeX review, .bib → BibTeX verification.
# Basic PDF review
python -m cookbooks.paper_review paper.pdf
# With discipline and venue
python -m cookbooks.paper_review paper.pdf \
--discipline cs --venue "NeurIPS 2025"
# Chinese output
python -m cookbooks.paper_review paper.pdf --language zh
# Custom reviewer instructions
python -m cookbooks.paper_review paper.pdf \
--instructions "Focus on experimental design and reproducibility"
