Repository navigation
Expand file tree
/
Copy pathmkdocs.yml
More file actions
108 lines (108 loc) · 3.76 KB
/
Copy pathmkdocs.yml
File metadata and controls
108 lines (108 loc) · 3.76 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
site_name: miniVERL
site_description: 'verl for a single consumer GPU: PPO, GRPO and on-policy distillation'
site_url: https://daoyuanli2816.github.io/mini-verl/
repo_url: https://github.com/DaoyuanLi2816/mini-verl
repo_name: DaoyuanLi2816/mini-verl
edit_uri: edit/main/docs/
exclude_docs: |
history/*
theme:
name: material
custom_dir: docs/overrides
language: en
font: false
icon:
repo: fontawesome/brands/github
palette:
- media: "(prefers-color-scheme: light)"
scheme: default
primary: indigo
accent: cyan
toggle:
icon: material/weather-night
name: Switch to dark mode
- media: "(prefers-color-scheme: dark)"
scheme: slate
primary: indigo
accent: cyan
toggle:
icon: material/weather-sunny
name: Switch to light mode
features:
- content.code.copy
- content.code.annotate
- navigation.footer
- navigation.indexes
- navigation.sections
- navigation.top
- search.highlight
- search.suggest
plugins:
- search
nav:
- Home: index.md
- Choose a workflow: comparisons.md
- For verl users: for-verl-users.md
- Run a verl config directly: direct-verl-config.md
- PPO and GRPO walkthrough: local-rl-workflow.md
- Upstream compatibility corpus: verl-compatibility-corpus.md
- Single-GPU verl RL: verl-rl-runtime.md
- Compatibility profiles: profiles/index.md
- PG-k1 semantic ADR: adr/0010-verl-v0.8-pg-k1-contract.md
- Config overrides: config-overrides.md
- Immutable plans: immutable-plans.md
- Hardware planning: hardware-planning.md
- On-policy distillation: verl-opd-runtime.md
- Run verl-style OPD: opd-quickstart.md
- RTX 4080 developer workload: verl-opd-reference-workload.md
- SmolLM2 developer workload: smollm2-opd-workload.md
- RTX 4080 PG-k1 workload: verl-pg-k1-workload.md
- Start on one GPU: single-gpu-guide.md
- Release qualification: release-qualification.md
- Align:
- "External Alignment Gate v1: early stop": alignment-external/alignment-external-v1.md
- When OPD should follow SFT: alignment-lab/when-opd-should-follow-sft.md
- "Alignment Lab v1: saturated case study": alignment-lab/alignment-lab-v1.md
- External benchmark governance: alignment-external/benchmark-governance.md
- Distill locally:
- Consumer runtime: consumer-runtime/index.md
- Runtime benchmarking: benchmarking.md
- RecoveryBench: recoverybench/recoverybench-v1.md
- Scale out:
- Current OPD scale-out: verl-opd-scaleout.md
- Materialize a handoff: scaleout-materialization.md
- Launch requirements: verl-bridge-launch.md
- Demo recording script: verl-bridge-demo.md
- Legacy environment/PPO bridge: legacy-verl-bridge.md
- Community benchmarks: community-benchmarks.md
- Rollout Runtime v2:
- Runtime contract: rollout-runtime-v2.md
- Competitive landscape: competitive-landscape.md
- Benchmark method: benchmarks/rollout-runtime-v2-method.md
- Frozen HF baseline: benchmarks/rollout-runtime-v2.md
- Maintainer:
- Architecture: maintainer-architecture.md
- Upstream support policy: upstream-support-policy.md
- v1 readiness: v1-readiness.md
- Repository settings audit: repository-settings.md
- v0.10.1 security review: security-review-v0.10.1.md
- Schemas:
- Trajectories: trajectory-schema.md
- Benchmark results: benchmarking.md
- Limitations: limitations.md
markdown_extensions:
- admonition
- attr_list
- md_in_html
- tables
- toc:
permalink: true
- pymdownx.details
- pymdownx.highlight:
anchor_linenums: true
- pymdownx.superfences
extra_css:
- assets/stylesheets/extra.css
extra_javascript:
- assets/javascripts/versioning.js
copyright: miniVERL · verl for a single consumer GPU · Apache-2.0