Instructions to use poolside/Laguna-S-2.1-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use poolside/Laguna-S-2.1-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="poolside/Laguna-S-2.1-base")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("poolside/Laguna-S-2.1-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use poolside/Laguna-S-2.1-base with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "poolside/Laguna-S-2.1-base" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "poolside/Laguna-S-2.1-base", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/poolside/Laguna-S-2.1-base
- SGLang
How to use poolside/Laguna-S-2.1-base with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "poolside/Laguna-S-2.1-base" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "poolside/Laguna-S-2.1-base", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "poolside/Laguna-S-2.1-base" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "poolside/Laguna-S-2.1-base", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use poolside/Laguna-S-2.1-base with Docker Model Runner:
docker model run hf.co/poolside/Laguna-S-2.1-base
Use on OpenRouter · Use on Vercel AI Gateway · Release blog post
Laguna S 2.1-base
Laguna S 2.1-base is the base (pre-trained, not post-trained) model behind Laguna S 2.1. It is a 118B total parameter Mixture-of-Experts model with roughly 8B activated parameters per token, using interleaved full and sliding-window attention over 48 layers, with 256 routed experts and 1 shared expert.
Please note that we are not making the base model available publicly. Researchers who wish to use the model can reach out to us at models@poolside.ai.
This is a base model. It has not been instruction tuned and has no chat, reasoning or tool-calling behaviour. For those, use Laguna S 2.1.
Benchmark results
Short context:
| Benchmark | Score |
|---|---|
| PIQA | 84.8% |
| WinoGrande | 84.5% |
| ARC-e | 98.2% |
| ARC-c | 93.8% |
| HellaSwag | 85.8% |
| MMLU | 82.9% |
| GPQA-D | 43.6% |
| MultiPL-E | 60.4% |
| EvalPlus | 71.6% |
| BigCodeBench | 57.0% |
| MATH | 64.7% |
| GSM8K | 88.7% |
| APT-Bench 4k | 39.9% |
Long context:
| Benchmark | Score |
|---|---|
| APT-Bench 32k | 58.8% |
| RULER 32k | 81.6% |
| GSM-Infinite 16k | 33.8% |
| LongBench 32k | 41.6% |
| APT-Bench 128k | 47.5% |
| RULER 128k | 72.8% |
| GSM-Infinite 64k | 24.3% |
| LongBench 128k | 37.3% |
| HELMET 128k | 51.2% |
License
This model is licensed under the OpenMDW-1.1 License.
Intended and Responsible Use
Laguna S 2.1-base is designed for software engineering and agentic coding use cases, and you are responsible for confirming that it is appropriate for your intended application. Laguna S 2.1-base is subject to the OpenMDW-1.1 License, and should be used consistently with Poolside's Acceptable Use Policy. We advise against circumventing Laguna S 2.1-base safety guardrails without implementing substantially equivalent mitigations appropriate for your use case.
Please report security vulnerabilities or safety concerns to security@poolside.ai.