BoyBarley_X

Fine-tuned from BoyBarley-v32 (494M params) via Knowledge Distillation on 50,000 samples.

Training

Config Value
Base model BoyBarley/BoyBarley-v32
Dataset 50,000 samples
Categories SQL, Logic, Math, Reasoning
Epochs 3
Learning rate 1e-5
Precision BF16
Best val loss 0.0672

Benchmark vs v32

Task v32 BoyBarley_X
SQL basic โœ… โœ… More consistent
SQL aggregate โš ๏ธ โš ๏ธ Partial
Math basic โš ๏ธ โœ… Improved
Probability โŒ โœ… Correct
Syllogism โš ๏ธ โœ… Improved
Trick questions โš ๏ธ โœ… Improved
Fibonacci/Pattern โŒ โŒ Still weak
Multi-step math โŒ โŒ Still weak

Next: BoyBarley_X2

  • Chain-of-thought dataset for math and logic
  • Fibonacci and sequence training data
  • Compound percentage problems
  • Target: 100k samples
Downloads last month
42
Safetensors
Model size
0.5B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for BoyBarley/BoyBarley_X

Finetuned
(1)
this model