Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -105,6 +105,18 @@ Okay, here's one: Why don't scientists trust atoms? Because they make up everyth
|
|
| 105 |
|
| 106 |
Trained using the [TRL](https://github.com/huggingface/trl) library with LoRA adapters on 2x RTX 4090 GPUs.
|
| 107 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 108 |
## License
|
| 109 |
|
| 110 |
This model inherits the [Gemma license](https://ai.google.dev/gemma/terms) from the base model.
|
|
|
|
| 105 |
|
| 106 |
Trained using the [TRL](https://github.com/huggingface/trl) library with LoRA adapters on 2x RTX 4090 GPUs.
|
| 107 |
|
| 108 |
+
### Loss Curve
|
| 109 |
+
|
| 110 |
+
|
| 111 |
+
|
| 112 |
+
| Metric | Value |
|
| 113 |
+
|--------|-------|
|
| 114 |
+
| **Start Loss** | 3.56 |
|
| 115 |
+
| **Final Loss** | 0.69 |
|
| 116 |
+
| **Reduction** | 80.7% |
|
| 117 |
+
| **Training Time** | 1h 42m |
|
| 118 |
+
| **Hardware** | 2x NVIDIA RTX 4090 |
|
| 119 |
+
|
| 120 |
## License
|
| 121 |
|
| 122 |
This model inherits the [Gemma license](https://ai.google.dev/gemma/terms) from the base model.
|