Instructions to use AlexWortega/moe100m-physics-tinybpe with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AlexWortega/moe100m-physics-tinybpe with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AlexWortega/moe100m-physics-tinybpe", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "final_train_loss": 1.7106709480285645, | |
| "best_eval_loss": 1.6925994396209716, | |
| "steps": 17280, | |
| "tokens_seen": 139501568, | |
| "active_M": 92.829508, | |
| "total_M": 246.183748, | |
| "wall_hours": 0.19512769089804755, | |
| "planned_tokens": 700000000.0, | |
| "total_steps": 85449 | |
| } |