Commit ·
1e308ec
1
Parent(s): a251104
Update model references: Llama 3.3 70B → Llama 3.1 8B Instant, runtime 19.8min → ~10min
Browse files- README.md +2 -2
- config/tasks.yaml +2 -2
- server/app.py +3 -3
README.md
CHANGED
|
@@ -209,7 +209,7 @@ Report best grader score across all rollouts
|
|
| 209 |
|
| 210 |
### Benchmark Scores
|
| 211 |
|
| 212 |
-
Results from `baseline/run.py` (Llama 3.
|
| 213 |
|
| 214 |
| Task | Greedy (D0) | LLM+GRPO | Lift |
|
| 215 |
| --- | --- | --- | --- |
|
|
@@ -285,7 +285,7 @@ cascade-containment/
|
|
| 285 |
| HF Space deploys | ✅ |
|
| 286 |
| `inference.py` at root | ✅ |
|
| 287 |
| `[START][STEP][END]` structured logs | ✅ |
|
| 288 |
-
| Runtime < 20 minutes | ✅ ~
|
| 289 |
| `API_BASE_URL`, `MODEL_NAME`, `HF_TOKEN` env vars | ✅ |
|
| 290 |
| OpenAI client for all LLM calls | ✅ |
|
| 291 |
| Grader scores in `[0.0, 1.0]` | ✅ |
|
|
|
|
| 209 |
|
| 210 |
### Benchmark Scores
|
| 211 |
|
| 212 |
+
Results from `baseline/run.py` (Llama 3.1 8B Instant via Groq, runtime ~10 minutes):
|
| 213 |
|
| 214 |
| Task | Greedy (D0) | LLM+GRPO | Lift |
|
| 215 |
| --- | --- | --- | --- |
|
|
|
|
| 285 |
| HF Space deploys | ✅ |
|
| 286 |
| `inference.py` at root | ✅ |
|
| 287 |
| `[START][STEP][END]` structured logs | ✅ |
|
| 288 |
+
| Runtime < 20 minutes | ✅ ~~10 minutes |
|
| 289 |
| `API_BASE_URL`, `MODEL_NAME`, `HF_TOKEN` env vars | ✅ |
|
| 290 |
| OpenAI client for all LLM calls | ✅ |
|
| 291 |
| Grader scores in `[0.0, 1.0]` | ✅ |
|
config/tasks.yaml
CHANGED
|
@@ -85,7 +85,7 @@ benchmark:
|
|
| 85 |
hard: {score: 0.353, breach_rate: 1.00}
|
| 86 |
llm_grpo:
|
| 87 |
easy: {score: 0.885, model: llama-3.1-8b-instant}
|
| 88 |
-
medium: {score: 0.
|
| 89 |
-
hard: {score: 0.
|
| 90 |
average: 0.794
|
| 91 |
runtime_seconds: 1134
|
|
|
|
| 85 |
hard: {score: 0.353, breach_rate: 1.00}
|
| 86 |
llm_grpo:
|
| 87 |
easy: {score: 0.885, model: llama-3.1-8b-instant}
|
| 88 |
+
medium: {score: 0.780, model: llama-3.1-8b-instant}
|
| 89 |
+
hard: {score: 0.611, model: llama-3.1-8b-instant}
|
| 90 |
average: 0.794
|
| 91 |
runtime_seconds: 1134
|
server/app.py
CHANGED
|
@@ -760,13 +760,13 @@ body{font-family:var(--mono);background:var(--bg);color:var(--text);min-height:1
|
|
| 760 |
<div>
|
| 761 |
<div style="display:flex;align-items:center;gap:0.75rem;margin-bottom:1rem;">
|
| 762 |
<div style="background:var(--blue-dim);border:1px solid rgba(74,158,255,0.25);border-radius:6px;padding:0.2rem 0.6rem;font-size:0.62rem;letter-spacing:0.08em;text-transform:uppercase;color:var(--blue);">Eval 2 of 3</div>
|
| 763 |
-
<div style="font-size:0.82rem;font-weight:700;color:#fff;">LLM + GRPO Agent (Llama 3.
|
| 764 |
</div>
|
| 765 |
<div style="font-size:0.72rem;color:var(--muted);margin-bottom:1rem;line-height:1.7;">
|
| 766 |
-
Llama 3.
|
| 767 |
Each rollout injects advantage-gated memory from prior rollouts into the prompt.
|
| 768 |
Reproduced by running <code style="color:var(--text);">python baseline/run.py</code>.
|
| 769 |
-
Llama 3.
|
| 770 |
Total runtime: <strong style="color:var(--text);">~10 minutes</strong>.
|
| 771 |
</div>
|
| 772 |
<div class="grid-3" style="margin-bottom:1rem;">
|
|
|
|
| 760 |
<div>
|
| 761 |
<div style="display:flex;align-items:center;gap:0.75rem;margin-bottom:1rem;">
|
| 762 |
<div style="background:var(--blue-dim);border:1px solid rgba(74,158,255,0.25);border-radius:6px;padding:0.2rem 0.6rem;font-size:0.62rem;letter-spacing:0.08em;text-transform:uppercase;color:var(--blue);">Eval 2 of 3</div>
|
| 763 |
+
<div style="font-size:0.82rem;font-weight:700;color:#fff;">LLM + GRPO Agent (Llama 3.1 8B Instant)</div>
|
| 764 |
</div>
|
| 765 |
<div style="font-size:0.72rem;color:var(--muted);margin-bottom:1rem;line-height:1.7;">
|
| 766 |
+
Llama 3.1 8B Instant via Groq, with GRPO-style episodic memory across 2–3 rollouts per task.
|
| 767 |
Each rollout injects advantage-gated memory from prior rollouts into the prompt.
|
| 768 |
Reproduced by running <code style="color:var(--text);">python baseline/run.py</code>.
|
| 769 |
+
Llama 3.1 8B Instant via Groq, with GRPO-style episodic memory across 2–3 rollouts per task.
|
| 770 |
Total runtime: <strong style="color:var(--text);">~10 minutes</strong>.
|
| 771 |
</div>
|
| 772 |
<div class="grid-3" style="margin-bottom:1rem;">
|