# 01 Paper Review

Review academic papers for correctness, quality, and novelty using OpenJudge's...

- Repository: https://github.com/agentscope-ai/OpenJudge (1020 stars)
- Category: Documents
- License: Apache-2.0
- Last updated: 2026-10-30
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add agentscope-ai/OpenJudge --skill 01-paper-review -g -a claude-code -y`
Codex: `npx skills add agentscope-ai/OpenJudge --skill 01-paper-review -g -a codex -y`
Cursor: `npx skills add agentscope-ai/OpenJudge --skill 01-paper-review -g -a cursor -y`
Gemini CLI: `npx skills add agentscope-ai/OpenJudge --skill 01-paper-review -g -a gemini-cli -y`

## Description

Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Paper Review Skill

Multi-stage academic paper review using the OpenJudge `PaperReviewPipeline`:

1. **Safety check**, jailbreak detection + format validation
2. **Correctness**, objective errors (math, logic, data inconsistencies)
3. **Review**, quality, novelty, significance (score 1, 6)
4. **Criticality**, severity of correctness issues
5. **BibTeX verification**, cross-checks references against CrossRef/arXiv/DBLP

## Prerequisites

```bash
# Install OpenJudge
pip install py-openjudge

# Extra dependency for paper_review
pip install litellm
pip install pypdfium2  # only if using vision mode (use_vision_for_pdf=True)
```

## Gather from user before running

| Info | Required? | Notes |
|------|-----------|-------|
| Paper file path | Yes | PDF or .tar.gz/.zip TeX package |
| API key | Yes | Env var preferred: `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, etc. |
| Model name | No | `gpt-5.2`, `anthropic/claude-opus-4-6`, `dashscope/qwen-vl-plus`. See **Model selection** below |
| Discipline | No | If not given, uses general CS/ML-oriented prompts |
| Venue | No | e.g. `"NeurIPS 2025"`, `"The Lancet"` |
| Instructions | No | Free-form reviewer guidance, e.g. `"Focus on experimental design"` |
| Language | No | `"en"` (default) or `"zh"` for Simplified Chinese output |
| BibTeX file | No | Required only for reference verification |
| CrossRef email | No | Improves API rate limits for BibTeX verification |

## Quick start

File type is auto-detected: `.pdf` → PDF review, `.tar.gz`/`.zip` → TeX review, `.bib` → BibTeX verification.

```bash
# Basic PDF review
python -m cookbooks.paper_review paper.pdf

# With discipline and venue
python -m cookbooks.paper_review paper.pdf \
  --discipline cs --venue "NeurIPS 2025"

# Chinese output
python -m cookbooks.paper_review paper.pdf --language zh

# Custom reviewer instructions
python -m cookbooks.paper_review paper.pdf \
  --instructions "Focus on experimental design and reproducibility"

The rest: https://github.com/agentscope-ai/OpenJudge/blob/HEAD/skills/academic-eval/01-paper-review/SKILL.md