File size: 2,972 Bytes
dc3f380 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 | ---
library_name: transformers
inference: false
extra_gated_description: >-
To learn more about how we process your personal data, please read our <a
href="https://poolside.ai/legal/privacy">Privacy Policy</a>.
tags:
- laguna-s-2.1
license: openmdw-1.1
pipeline_tag: text-generation
---
<p align="center">
<img alt="poolside-banner" src="https://poolside.ai/assets/laguna/laguna-s-2-1-banner.svg" width="800px">
</p>
<p align="center">
<a href="https://openrouter.ai/poolside/laguna-s-2.1"><strong>Use on OpenRouter</strong></a> ·
<a href="https://vercel.com/ai-gateway/models/laguna-s-2.1"><strong>Use on Vercel AI Gateway</strong></a> ·
<a href="https://poolside.ai/blog/introducing-laguna-s-2-1"><strong>Release blog post</strong></a>
</p>
<br>
# Laguna S 2.1-base
Laguna S 2.1-base is the base (pre-trained, not post-trained) model behind
[Laguna S 2.1](https://huggingface.co/poolside/Laguna-S-2.1). It is a 118B total
parameter Mixture-of-Experts model with roughly 8B activated parameters per token,
using interleaved full and sliding-window attention over 48 layers, with 256 routed
experts and 1 shared expert.
Please note that we are not making the base model available publicly. Researchers who
wish to use the model can reach out to us at models@poolside.ai.
This is a base model. It has not been instruction tuned and has no chat, reasoning
or tool-calling behaviour. For those, use [Laguna S 2.1](https://huggingface.co/poolside/Laguna-S-2.1).
## Benchmark results
Short context:
| Benchmark | Score |
|---|---|
| PIQA | 84.8% |
| WinoGrande | 84.5% |
| ARC-e | 98.2% |
| ARC-c | 93.8% |
| HellaSwag | 85.8% |
| MMLU | 82.9% |
| GPQA-D | 43.6% |
| MultiPL-E | 60.4% |
| EvalPlus | 71.6% |
| BigCodeBench | 57.0% |
| MATH | 64.7% |
| GSM8K | 88.7% |
| APT-Bench 4k | 39.9% |
Long context:
| Benchmark | Score |
|---|---|
| APT-Bench 32k | 58.8% |
| RULER 32k | 81.6% |
| GSM-Infinite 16k | 33.8% |
| LongBench 32k | 41.6% |
| APT-Bench 128k | 47.5% |
| RULER 128k | 72.8% |
| GSM-Infinite 64k | 24.3% |
| LongBench 128k | 37.3% |
| HELMET 128k | 51.2% |
## License
This model is licensed under the [OpenMDW-1.1 License](https://huggingface.co/poolside/Laguna-S-2.1-base/blob/main/LICENSE.md).
## Intended and Responsible Use
Laguna S 2.1-base is designed for software engineering and agentic coding use cases, and you are responsible for confirming that it is appropriate for your intended application. Laguna S 2.1-base is subject to the [OpenMDW-1.1 License](https://huggingface.co/poolside/Laguna-S-2.1-base/blob/main/LICENSE.md), and should be used consistently with Poolside's [Acceptable Use Policy](https://poolside.ai/legal/acceptable-use-policy). We advise against circumventing Laguna S 2.1-base safety guardrails without implementing substantially equivalent mitigations appropriate for your use case.
Please report security vulnerabilities or safety concerns to [security@poolside.ai](mailto:security@poolside.ai).
|