Spaces:
Running
Running
Add submission card
Browse files- SUBMISSION.md +44 -0
SUBMISSION.md
ADDED
|
@@ -0,0 +1,44 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Counsel-Env Submission Card
|
| 2 |
+
|
| 3 |
+
## Public Links
|
| 4 |
+
|
| 5 |
+
- Space: https://huggingface.co/spaces/heavycoderhh/counsel-env
|
| 6 |
+
- Live demo: https://heavycoderhh-counsel-env.hf.space/demo
|
| 7 |
+
- Trained checkpoint: https://huggingface.co/heavycoderhh/counsel-env-qwen3-0.6b-grpo-run2
|
| 8 |
+
- Trained eval artifacts: https://huggingface.co/heavycoderhh/counsel-env-qwen3-0.6b-grpo-run2/tree/main/eval
|
| 9 |
+
|
| 10 |
+
## Verification Snapshot
|
| 11 |
+
|
| 12 |
+
- Space visibility: public
|
| 13 |
+
- Space runtime: `RUNNING` on `cpu-basic`
|
| 14 |
+
- Checkpoint visibility: public
|
| 15 |
+
- Checkpoint SHA: `a4b4693e0615e97e78e13318d5389c30aabddcc0`
|
| 16 |
+
- Space SHA: `8fb858c9f441779893e0d4383b362cfd8820bd66`
|
| 17 |
+
|
| 18 |
+
## Held-Out Results
|
| 19 |
+
|
| 20 |
+
| Agent | Episodes | Avg Reward | Primary Reward | Trigger Rate | Surface Rate |
|
| 21 |
+
| --- | ---: | ---: | ---: | ---: | ---: |
|
| 22 |
+
| random | 30 | 0.000 | 0.000 | 0.000 | 0.000 |
|
| 23 |
+
| keyword_spam | 30 | 0.073 | 0.000 | 0.678 | 0.000 |
|
| 24 |
+
| present_all | 30 | 0.000 | 0.000 | 0.000 | 0.000 |
|
| 25 |
+
| trained_sft_grpo_run2 | 30 | 0.387 | 0.461 | 0.589 | 0.461 |
|
| 26 |
+
| scripted_oracle | 30 | 0.902 | 0.950 | 0.950 | 0.950 |
|
| 27 |
+
|
| 28 |
+
## Local Proof Artifacts
|
| 29 |
+
|
| 30 |
+
- `assets/trained_eval/trained_eval_summary.json`
|
| 31 |
+
- `assets/trained_eval/trained_eval_rows.csv`
|
| 32 |
+
- `assets/trained_eval/trained_eval_rows.jsonl`
|
| 33 |
+
- `assets/trained_eval/trained_eval_transcripts.md`
|
| 34 |
+
- `assets/heldout_eval_summary.json`
|
| 35 |
+
- `assets/transcripts/before_after_pairs.md`
|
| 36 |
+
- `assets/demo/video_script.md`
|
| 37 |
+
- `assets/demo/blog_draft.md`
|
| 38 |
+
|
| 39 |
+
## Local Validation
|
| 40 |
+
|
| 41 |
+
```bash
|
| 42 |
+
python pre_hf_validate.py
|
| 43 |
+
python -m pytest -p no:cacheprovider -q
|
| 44 |
+
```
|