8000 Release v0.13.0: executable single-GPU PPO by DaoyuanLi2816 · Pull Request #115 · DaoyuanLi2816/mini-verl · GitHub
[go: up one dir, main page]

Skip to content

Release v0.13.0: executable single-GPU PPO - #115

Merged
DaoyuanLi2816 merged 4 commits into
mainfrom
v0.13.0-ppo-full-rl
Sep 8, 2026
Merged

DaoyuanLi2816 merged 4 commits into
mainfrom
v0.13.0-ppo-full-rl

Conversation

@DaoyuanLi2816
Copy link
Copy Markdown
Owner

Summary

  • implement executable single-GPU PPO/GAE with an independent trainable critic, clipped value updates, actor KL, entropy, temporal role scheduling and exact dual-role resume
  • add the immutable verl-rl-v0.9-single-gpu-v2 compiler plus pinned upstream numerical/gradient/optimizer conformance
  • add a pinned local Hugging Face sequence-classifier reward role and a bidirectional v0.9 RL handoff bundle with explicit readiness states
  • extend the exact-wheel RTX 4080 qualification chain with PPO, reward-model and handoff evidence
  • update the English/Chinese product docs, compatibility pages and runtime diagrams for v0.13.0

Validation

  • ruff check . and ruff format --check .
  • mypy src/miniverl
  • 2,585 non-GPU/non-network tests, 14 Windows skips, 83% branch coverage
  • 10 local RTX 4080 GPU tests
  • 16 network tests
  • pinned official verl v0.9 conformance from commit 483b8a009ba3a97563edee3a19887e4862b8094a
  • extracted-sdist suite: 2,582 passed, 17 context/platform skips
  • clean core and [train] installs plus fast demo
  • strict MkDocs build and Chromium visual gate across 1440, 1024, 820 and 390 px widths
  • actionlint v1.7.12, Markdown/link, text-integrity, generated-artifact and Twine checks

The release remains gated on an attempt-1 full qualification of the exact post-merge release SHA. The frozen benchmark JSON/JSONL corpus and the published v1 compiler artifacts are unchanged; the calculator benchmark still hashes to 53fc1d4d5b7adee09618d77ad62d4086ba56b78569832d6fc7c3bcd5c2695bbc.

@DaoyuanLi2816
DaoyuanLi2816 merged commit 89f4027 into main Sep 8, 2026
16 checks passed
@DaoyuanLi2816
DaoyuanLi2816 deleted the v0.13.0-ppo-full-rl branch September 8, 2026 10:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet
4555

Development

Successfully merging this pull request may close these issues.

1 participant

0