zeeshaan-ai commited on
Commit
bb15e2c
·
verified ·
1 Parent(s): 32debd9

Add Solo model card

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: google/gemma-3-270m-it
4
+ tags: [solo, fine-tuned, lora, unsloth]
5
+ datasets: [GetSoloTech/Code-Reasoning]
6
+ pipeline_tag: text-generation
7
+ ---
8
+
9
+ <a href="https://hub.getsolo.tech"><img src="https://raw.githubusercontent.com/GetSoloTech/solo-cli/main/media/solo-banner.png" alt="Solo" width="200"></a>
10
+
11
+ ## Model Details
12
+
13
+ | | |
14
+ |---|---|
15
+ | **Base Model** | [google/gemma-3-270m-it](https://huggingface.co/google/gemma-3-270m-it) |
16
+ | **Method** | LoRA (PEFT) |
17
+ | **Parameters** | 0.27B |
18
+
19
+ ## Training Hyperparameters
20
+
21
+ | | |
22
+ |---|---|
23
+ | **Epochs** | 1 |
24
+ | **Max Steps** | 100 |
25
+ | **Batch Size** | 4 |
26
+ | **Gradient Accumulation** | 4 |
27
+ | **Learning Rate** | 0.0002 |
28
+ | **LoRA r** | 4 |
29
+ | **LoRA Alpha** | 4 |
30
+ | **Max Sequence Length** | 2048 |
31
+ | **Training Duration** | 41m 11s |
32
+
33
+ ## Dataset
34
+
35
+ [GetSoloTech/Code-Reasoning](https://huggingface.co/datasets/GetSoloTech/Code-Reasoning)
36
+
37
+ ---
38
+
39
+ <sub>Trained with <a href="https://hub.getsolo.tech">Solo</a></sub>