YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
EvoTransformer sovereign model
Trained on the sovereign corpus.
- Architecture (evolved): 256-d, 6 layers, 4 heads (kv 4), relu2, rope, 4 memory tokens — 7.79M params
- Validation perplexity: 2.3082
- Trained on 11,999,232 tokens; 15 architectures explored during evolution.
Load & generate
import torch
from evotransformer.build import load_model
model, genome = load_model("path/to/this/bundle")
out = model.generate(torch.zeros(1, 1, dtype=torch.long), max_new_tokens=64)
Every number here was produced by training real weights.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support