8000 Add transactional grouped rollout semantics by DaoyuanLi2816 · Pull Request #93 · DaoyuanLi2816/mini-verl · GitHub
[go: up one dir, main page]

Skip to content

Add transactional grouped rollout semantics - #93

Merged
DaoyuanLi2816 merged 1 commit into
mainfrom
v0.11.0-grouped-rollouts
Aug 29, 2026
Merged

DaoyuanLi2816 merged 1 commit into
mainfrom
v0.11.0-grouped-rollouts

Conversation

@DaoyuanLi2816
Copy link
Copy Markdown
Owner

Summary

  • add trajectory schema v3 with typed group, sample, seed, backend, and rollout-policy identity while retaining v1/v2 readers
  • make complete prompt-group publication journaled, crash-recoverable, and replay-idempotent
  • support independent n > 1 Parquet prompt samples through new direct-GKD and sampled-k1 grouped profiles without changing the measured n = 1 profiles
  • bind prompt/group cursors, trajectory count, backend synchronization, cache identity, checkpoint state, metrics, and export provenance to grouped semantics
  • upgrade all newly written trajectories to schema v3, preserving prior logical IDs as legacy provenance

The grouped samples are independent current-policy trajectories. This does not add a group baseline, GRPO, a new reward, or a new benchmark. The two grouped profiles are conformance-only.

Validation

  • git diff --check
  • ruff check .
  • ruff format --check .
  • mypy src/miniverl
  • actionlint 1.7.12
  • pytest -q -m "not gpu and not network" --cov=miniverl: 2423 passed, 9 platform skips, 83% coverage
  • pytest -q -m gpu: 10 passed
  • pytest -q -m network: 16 passed
  • exact grouped interruption/resume: prompt order, group/sample IDs, output tokens, sampled log-probabilities, teacher-cache tensors, optimizer tensors, and final adapter match
  • generated documentation checks, Markdown/link and text-integrity checks
  • mkdocs build --strict
  • browser visual gate: 44 SVG instances across 1440, 1024, 820, and 390 px viewports
  • package build and twine check
  • clean core wheel install with torch absent

Local development build hashes:

  • wheel: c32542c884a9f582b26e0229c62b5da3a72867148311799b29cfc61a00c2b2f9
  • sdist: a3bf8b3625c868f4d0ff44ec61768e76816741ac204def3ce3db54a8fd28f4fd

Frozen evidence remains byte-identical:

  • calculator: 53fc1d4d5b7adee09618d77ad62d4086ba56b78569832d6fc7c3bcd5c2695bbc
  • rollout baseline: b25daee7ee726b7a7be18d7dbe26590fb61325bf212cfd9e7110b69f5fa8889c

@DaoyuanLi2816
DaoyuanLi2816 merged commit d43a9df into main Aug 29, 2026
16 checks passed
@DaoyuanLi2816
DaoyuanLi2816 deleted the v0.11.0-grouped-rollouts branch August 29, 2026 12:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

0