Omibranch's picture
Upload README.md with huggingface_hub
af07900 verified
|
Raw
History Blame Contribute Delete
1.09 kB
---
license: other
license_name: polyform-noncommercial-1.0.0
license_link: https://github.com/Omibranch/Harmonic/blob/main/LICENSE
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
tags:
- state-space-models
- ssm
- long-context
pipeline_tag: text-generation
---
# Hallamonic 1B — Phase 1 checkpoint (intermediate)
Intermediate checkpoint from **Phase 1** (SSM warmup, 10K steps, FFN frozen) of
training Hallamonic 1B. This is provided for reproducibility/research into the
training dynamics. For the final model, use
**[Omibranch/harmonic-checkpoints-phase2-final](https://huggingface.co/Omibranch/harmonic-checkpoints-phase2-final)**.
Paper: [arxiv.org/abs/2606.24650](https://arxiv.org/abs/2606.24650). Code:
[Omibranch/Harmonic](https://github.com/Omibranch/Harmonic).
## License
Dual-licensed: free for noncommercial use under the
[PolyForm Noncommercial License 1.0.0](https://github.com/Omibranch/Harmonic/blob/main/LICENSE).
Commercial use requires a separate license — see
[LICENSE-COMMERCIAL.md](https://github.com/Omibranch/Harmonic/blob/main/LICENSE-COMMERCIAL.md).