| library_name: pytorch | |
| # Slayer 11B pilot weights | |
| Private backup of an experimental approximately 11.18B-parameter model trained from scratch on a subset of SlayerLab/slayer-pl-8x3b. This is an early pilot, not a finished or evaluated model. | |
| `weights-only.pt` is a PyTorch dictionary containing `model`, `config`, and `step`. It preserves the original weight precision, but does not contain the optimizer state and cannot resume the original training state exactly. This uses the custom `train_gpt.py` architecture, not Transformers format; the reference tokenizer is SlayerLab/Slayer1B-1.00. Load PyTorch files only from trusted sources. The file appears after export and upload finish. | |