Arijit-07 commited on
Commit
e774b09
·
verified ·
1 Parent(s): d90671e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -13
README.md CHANGED
@@ -1,21 +1,41 @@
1
  ---
2
- base_model: unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit
 
 
3
  tags:
4
- - text-generation-inference
5
- - transformers
 
 
 
6
  - unsloth
7
- - llama
8
- license: apache-2.0
9
- language:
10
- - en
11
  ---
12
 
13
- # Uploaded finetuned model
 
14
 
15
- - **Developed by:** Arijit-07
16
- - **License:** apache-2.0
17
- - **Finetuned from model :** unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit
18
 
19
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: unsloth/Meta-Llama-3.1-8B-Instruct
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
  tags:
6
+ - grpo
7
+ - reinforcement-learning
8
+ - devops
9
+ - incident-response
10
+ - openenv
11
  - unsloth
 
 
 
 
12
  ---
13
 
14
+ # ARIA — DevOps Incident Response Agent
15
+ ### Llama-3.1-8B fine-tuned with GRPO
16
 
17
+ Trained on the [ARIA DevOps Incident Response](https://huggingface.co/spaces/Arijit-07/devops-incident-response)
18
+ live RL environment using GRPO.
 
19
 
20
+ ## Training Results
21
 
22
+ | Task | Baseline | Fine-tuned | Improvement |
23
+ |---|---|---|---|
24
+ | easy | 0.320 | 0.685 | **+0.365** |
25
+ | medium | 0.050 | 0.378 | **+0.328** |
26
+ | hard | 0.190 | 0.869 | **+0.679** |
27
+ | bonus | 0.152 | 0.682 | **+0.530** |
28
+
29
+ ![Training Curve](training_curve_8b.png)
30
+
31
+ ## Setup
32
+ - Algorithm: GRPO
33
+ - Base: Llama-3.1-8B-Instruct
34
+ - LoRA rank: 32, alpha: 64
35
+ - Episodes: 160 (40 per task)
36
+ - GPU: NVIDIA L4, 162 minutes
37
+ - Framework: Unsloth + HuggingFace TRL
38
+
39
+ ## Links
40
+ - Environment: https://huggingface.co/spaces/Arijit-07/devops-incident-response
41
+ - GitHub: https://github.com/Twilight-13/devops-incident-response