real-jiakai commited on
Commit
f40855a
·
verified ·
1 Parent(s): 2958745

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -22,8 +22,11 @@ A math-focused fine-tuned version of SmolLM3-3B, optimized for step-by-step math
22
  ## Highlights
23
 
24
  📚 **Math-First**: Trained on ~7K high-quality math and reasoning samples
 
25
  🧠 **Chain-of-Thought**: Supports `/think` mode for detailed reasoning
 
26
  ⚡ **Lightweight**: 3B parameters, runs on consumer GPUs
 
27
  ## Training Details
28
 
29
  | Parameter | Value |
@@ -37,6 +40,7 @@ A math-focused fine-tuned version of SmolLM3-3B, optimized for step-by-step math
37
  | Epochs | 2 |
38
  | Learning Rate | 2e-4 (cosine) |
39
  | Effective Batch Size | 16 |
 
40
  ## Usage
41
  ```python
42
  from transformers import AutoModelForCausalLM, AutoTokenizer
 
22
  ## Highlights
23
 
24
  📚 **Math-First**: Trained on ~7K high-quality math and reasoning samples
25
+
26
  🧠 **Chain-of-Thought**: Supports `/think` mode for detailed reasoning
27
+
28
  ⚡ **Lightweight**: 3B parameters, runs on consumer GPUs
29
+
30
  ## Training Details
31
 
32
  | Parameter | Value |
 
40
  | Epochs | 2 |
41
  | Learning Rate | 2e-4 (cosine) |
42
  | Effective Batch Size | 16 |
43
+
44
  ## Usage
45
  ```python
46
  from transformers import AutoModelForCausalLM, AutoTokenizer