BoyBarley_X
Fine-tuned from BoyBarley-v32 (494M params) via Knowledge Distillation on 50,000 samples.
Training
| Config | Value |
|---|---|
| Base model | BoyBarley/BoyBarley-v32 |
| Dataset | 50,000 samples |
| Categories | SQL, Logic, Math, Reasoning |
| Epochs | 3 |
| Learning rate | 1e-5 |
| Precision | BF16 |
| Best val loss | 0.0672 |
Benchmark vs v32
| Task | v32 | BoyBarley_X |
|---|---|---|
| SQL basic | โ | โ More consistent |
| SQL aggregate | โ ๏ธ | โ ๏ธ Partial |
| Math basic | โ ๏ธ | โ Improved |
| Probability | โ | โ Correct |
| Syllogism | โ ๏ธ | โ Improved |
| Trick questions | โ ๏ธ | โ Improved |
| Fibonacci/Pattern | โ | โ Still weak |
| Multi-step math | โ | โ Still weak |
Next: BoyBarley_X2
- Chain-of-thought dataset for math and logic
- Fibonacci and sequence training data
- Compound percentage problems
- Target: 100k samples
- Downloads last month
- 42
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for BoyBarley/BoyBarley_X
Base model
BoyBarley/BoyBarley-v32