---
library_name: transformers
datasets:
- monology/pile-uncopyrighted
base_model:
- state-spaces/mamba-2.8b-hf
pipeline_tag: text-generation
---

# MambaConstrict Base

MambaConstrict Base model trained without auxiliary loss term (i.e. $\lambda = 0$).

For inquiring, please contact teilers@student.ethz.ch