Spaces:
Sleeping
Sleeping
Upload folder using huggingface_hub
Browse files- Blog.md +1 -1
- ENV_README.md +8 -4
- README.md +1 -1
Blog.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
|
| 3 |
*A Sunday-morning postmortem on teaching a 3B model to do enterprise IT triage with GRPO.*
|
| 4 |
|
| 5 |
-
It's
|
| 6 |
|
| 7 |
A flat loss in supervised learning means convergence. A flat loss in reinforcement learning usually means something else: your model has found a way to game your reward function, and it is now sitting in a local optimum, smug about it.
|
| 8 |
|
|
|
|
| 2 |
|
| 3 |
*A Sunday-morning postmortem on teaching a 3B model to do enterprise IT triage with GRPO.*
|
| 4 |
|
| 5 |
+
It's 1 AM on a Sunday. The Meta Γ PyTorch OpenEnv Hackathon submission is due at 5 PM. My training logs show a loss curve that's been flat at 0.0 for the last thirty minutes.
|
| 6 |
|
| 7 |
A flat loss in supervised learning means convergence. A flat loss in reinforcement learning usually means something else: your model has found a way to game your reward function, and it is now sitting in a local optimum, smug about it.
|
| 8 |
|
ENV_README.md
CHANGED
|
@@ -20,11 +20,15 @@ An OpenEnv reinforcement learning environment where an LLM agent resolves enterp
|
|
| 20 |
|
| 21 |
The accompanying training script fine-tunes **Qwen2.5-3B-Instruct β [yahid/triage-agent-qwen3b](https://huggingface.co/yahid/triage-agent-qwen3b)** using GRPO on this environment.
|
| 22 |
|
|
|
|
| 23 |
## Links
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
-
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
---
|
| 30 |
|
|
|
|
| 20 |
|
| 21 |
The accompanying training script fine-tunes **Qwen2.5-3B-Instruct β [yahid/triage-agent-qwen3b](https://huggingface.co/yahid/triage-agent-qwen3b)** using GRPO on this environment.
|
| 22 |
|
| 23 |
+
|
| 24 |
## Links
|
| 25 |
+
|
| 26 |
+
| | |
|
| 27 |
+
|---|---|
|
| 28 |
+
| π₯οΈ **Live Demo** | [yahid/triage_agent_env on HF Spaces](https://huggingface.co/spaces/yahid/triage_agent_env) |
|
| 29 |
+
| π§ **Trained Model** | [yahid/triage-agent-qwen3b](https://huggingface.co/yahid/triage-agent-qwen3b) |
|
| 30 |
+
| π **Training Notebook (Colab)** | [Open in Colab](https://colab.research.google.com/drive/1vqkxsp7euJ45cbv4AxfXr5dr-FTOSA3l?usp=sharing) | [Available in this repo](./training/train_grpo_colab_openenvHackathon_finale.ipynb)
|
| 31 |
+
| π **Full Blog Post** | [When my RL agent started writing about Star Wars...](https://huggingface.co/spaces/yahid/triage_agent_env/blob/main/Blog.md) |
|
| 32 |
|
| 33 |
---
|
| 34 |
|
README.md
CHANGED
|
@@ -93,7 +93,7 @@ Unanswerable tickets: `escalate=True` earns full primary reward.
|
|
| 93 |
|---|---|
|
| 94 |
| π₯οΈ **Live Demo** | [yahid/triage_agent_env on HF Spaces](https://huggingface.co/spaces/yahid/triage_agent_env) |
|
| 95 |
| π§ **Trained Model** | [yahid/triage-agent-qwen3b](https://huggingface.co/yahid/triage-agent-qwen3b) |
|
| 96 |
-
| π **Training Notebook (Colab)** | [Open in Colab](https://colab.research.google.com/drive/1vqkxsp7euJ45cbv4AxfXr5dr-FTOSA3l?usp=sharing) |
|
| 97 |
| π **Full Blog Post** | [When my RL agent started writing about Star Wars...](https://huggingface.co/spaces/yahid/triage_agent_env/blob/main/Blog.md) |
|
| 98 |
|
| 99 |
---
|
|
|
|
| 93 |
|---|---|
|
| 94 |
| π₯οΈ **Live Demo** | [yahid/triage_agent_env on HF Spaces](https://huggingface.co/spaces/yahid/triage_agent_env) |
|
| 95 |
| π§ **Trained Model** | [yahid/triage-agent-qwen3b](https://huggingface.co/yahid/triage-agent-qwen3b) |
|
| 96 |
+
| π **Training Notebook (Colab)** | [Open in Colab](https://colab.research.google.com/drive/1vqkxsp7euJ45cbv4AxfXr5dr-FTOSA3l?usp=sharing) | [Available in this repo](./training/train_grpo_colab_openenvHackathon_finale.ipynb)
|
| 97 |
| π **Full Blog Post** | [When my RL agent started writing about Star Wars...](https://huggingface.co/spaces/yahid/triage_agent_env/blob/main/Blog.md) |
|
| 98 |
|
| 99 |
---
|