image/LOAD.md

Image

laguna-vllm-v0.19.0-overlay.tar.gz is vllm/vllm-openai:v0.19.0 plus the Laguna model file (vllm.model_executor.models.laguna), the poolside_v1 tool parser (vllm.tool_parsers.poolside_v1_tool_parser), the poolside_v1 reasoning parser (vllm.reasoning.poolside_v1_reasoning_parser), and LagunaConfig (vllm.transformers_utils.configs.laguna). No CUDA kernels are rebuilt — the base image's SM90/SM90A binaries are used unchanged.

Load

gunzip -c laguna-vllm-v0.19.0-overlay.tar.gz | docker load

The loaded image is tagged vllm-laguna:v0.19.0-overlay-port.

Integrity check

sha256sum laguna-vllm-v0.19.0-overlay.tar.gz
# expected: 4266d7fc0fda731e774beeb932493cc4f2de1a9c6030babd32eae30f7dc60b3a

What's inside

• Base: vllm/vllm-openai:v0.19.0 (PyTorch, CUDA, Triton, FlashAttention, compressed-tensors, etc.)
• Added Python modules:
  • vllm/model_executor/models/laguna.py — LagunaForCausalLM
  • vllm/tool_parsers/poolside_v1_tool_parser.py — PoolsideV1ToolParser
  • vllm/reasoning/poolside_v1_reasoning_parser.py — PoolsideV1ReasoningParser
  • vllm/transformers_utils/configs/laguna.py — LagunaConfig
• Registry patches: LagunaForCausalLM added to the model registry; "poolside_v1" added to the tool-parser and reasoning-parser lazy-register dicts; "laguna" added to the config registry (so checkpoints don't need a remote configuration_laguna.py and can be served without --trust-remote-code).
• transformers_utils/config.py::patch_rope_parameters is patched to leave a nested rope_parameters dict (e.g. {full_attention: {...}, sliding_attention: {...}}) intact instead of overwriting it with the flat rope_scaling. Without this, interleaved-attention configs raise KeyError 'full_attention' at the per-layer attention site on transformers <5.
• Bundled convenience scripts:
  • /usr/local/bin/serve-laguna.sh — Laguna-M serve wrapper (TP=4)
  • /usr/local/bin/run_bench_multiple.py — multi-config benchmark runner

Entrypoint

Default entrypoint is vllm serve, same as the base image. The first positional argument is the model path (mount a checkpoint dir into /model).