RohitChandramouli6618 commited on
Commit
1e308ec
·
1 Parent(s): a251104

Update model references: Llama 3.3 70B → Llama 3.1 8B Instant, runtime 19.8min → ~10min

Browse files
Files changed (3) hide show
  1. README.md +2 -2
  2. config/tasks.yaml +2 -2
  3. server/app.py +3 -3
README.md CHANGED
@@ -209,7 +209,7 @@ Report best grader score across all rollouts
209
 
210
  ### Benchmark Scores
211
 
212
- Results from `baseline/run.py` (Llama 3.3 70B via Groq, runtime ~19.8 minutes):
213
 
214
  | Task | Greedy (D0) | LLM+GRPO | Lift |
215
  | --- | --- | --- | --- |
@@ -285,7 +285,7 @@ cascade-containment/
285
  | HF Space deploys | ✅ |
286
  | `inference.py` at root | ✅ |
287
  | `[START][STEP][END]` structured logs | ✅ |
288
- | Runtime < 20 minutes | ✅ ~19.8 minutes |
289
  | `API_BASE_URL`, `MODEL_NAME`, `HF_TOKEN` env vars | ✅ |
290
  | OpenAI client for all LLM calls | ✅ |
291
  | Grader scores in `[0.0, 1.0]` | ✅ |
 
209
 
210
  ### Benchmark Scores
211
 
212
+ Results from `baseline/run.py` (Llama 3.1 8B Instant via Groq, runtime ~10 minutes):
213
 
214
  | Task | Greedy (D0) | LLM+GRPO | Lift |
215
  | --- | --- | --- | --- |
 
285
  | HF Space deploys | ✅ |
286
  | `inference.py` at root | ✅ |
287
  | `[START][STEP][END]` structured logs | ✅ |
288
+ | Runtime < 20 minutes | ✅ ~~10 minutes |
289
  | `API_BASE_URL`, `MODEL_NAME`, `HF_TOKEN` env vars | ✅ |
290
  | OpenAI client for all LLM calls | ✅ |
291
  | Grader scores in `[0.0, 1.0]` | ✅ |
config/tasks.yaml CHANGED
@@ -85,7 +85,7 @@ benchmark:
85
  hard: {score: 0.353, breach_rate: 1.00}
86
  llm_grpo:
87
  easy: {score: 0.885, model: llama-3.1-8b-instant}
88
- medium: {score: 0.766, model: llama-3.1-8b-instant}
89
- hard: {score: 0.688, model: llama-3.1-8b-instant}
90
  average: 0.794
91
  runtime_seconds: 1134
 
85
  hard: {score: 0.353, breach_rate: 1.00}
86
  llm_grpo:
87
  easy: {score: 0.885, model: llama-3.1-8b-instant}
88
+ medium: {score: 0.780, model: llama-3.1-8b-instant}
89
+ hard: {score: 0.611, model: llama-3.1-8b-instant}
90
  average: 0.794
91
  runtime_seconds: 1134
server/app.py CHANGED
@@ -760,13 +760,13 @@ body{font-family:var(--mono);background:var(--bg);color:var(--text);min-height:1
760
  <div>
761
  <div style="display:flex;align-items:center;gap:0.75rem;margin-bottom:1rem;">
762
  <div style="background:var(--blue-dim);border:1px solid rgba(74,158,255,0.25);border-radius:6px;padding:0.2rem 0.6rem;font-size:0.62rem;letter-spacing:0.08em;text-transform:uppercase;color:var(--blue);">Eval 2 of 3</div>
763
- <div style="font-size:0.82rem;font-weight:700;color:#fff;">LLM + GRPO Agent (Llama 3.3 70B)</div>
764
  </div>
765
  <div style="font-size:0.72rem;color:var(--muted);margin-bottom:1rem;line-height:1.7;">
766
- Llama 3.3 70B via Groq, with GRPO-style episodic memory across 2&ndash;3 rollouts per task.
767
  Each rollout injects advantage-gated memory from prior rollouts into the prompt.
768
  Reproduced by running <code style="color:var(--text);">python baseline/run.py</code>.
769
- Llama 3.3 70B via Groq, with GRPO-style episodic memory across 2&ndash;3 rollouts per task.
770
  Total runtime: <strong style="color:var(--text);">~10 minutes</strong>.
771
  </div>
772
  <div class="grid-3" style="margin-bottom:1rem;">
 
760
  <div>
761
  <div style="display:flex;align-items:center;gap:0.75rem;margin-bottom:1rem;">
762
  <div style="background:var(--blue-dim);border:1px solid rgba(74,158,255,0.25);border-radius:6px;padding:0.2rem 0.6rem;font-size:0.62rem;letter-spacing:0.08em;text-transform:uppercase;color:var(--blue);">Eval 2 of 3</div>
763
+ <div style="font-size:0.82rem;font-weight:700;color:#fff;">LLM + GRPO Agent (Llama 3.1 8B Instant)</div>
764
  </div>
765
  <div style="font-size:0.72rem;color:var(--muted);margin-bottom:1rem;line-height:1.7;">
766
+ Llama 3.1 8B Instant via Groq, with GRPO-style episodic memory across 2&ndash;3 rollouts per task.
767
  Each rollout injects advantage-gated memory from prior rollouts into the prompt.
768
  Reproduced by running <code style="color:var(--text);">python baseline/run.py</code>.
769
+ Llama 3.1 8B Instant via Groq, with GRPO-style episodic memory across 2&ndash;3 rollouts per task.
770
  Total runtime: <strong style="color:var(--text);">~10 minutes</strong>.
771
  </div>
772
  <div class="grid-3" style="margin-bottom:1rem;">