joerowell commited on
Commit
f8fdfcd
·
verified ·
1 Parent(s): 0761412

Promote RC2->main: 1M context + fused-MoE ignore regex for cross-engine load; card updates (SGLang NVFP4 note, sampling defers to generation_config, new-checkpoint note)

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +20 -18
  2. config.json +102 -116
  3. configuration_laguna.py +3 -10
  4. generation_config.json +8 -8
  5. model-00015-of-00015.safetensors → model-00001-of-00049.safetensors +2 -2
  6. model-00002-of-00015.safetensors → model-00002-of-00049.safetensors +2 -2
  7. model-00001-of-00015.safetensors → model-00003-of-00049.safetensors +2 -2
  8. model-00003-of-00015.safetensors → model-00004-of-00049.safetensors +2 -2
  9. model-00005-of-00015.safetensors +0 -3
  10. model-00004-of-00015.safetensors → model-00005-of-00049.safetensors +2 -2
  11. model-00006-of-00015.safetensors +0 -3
  12. model-00006-of-00049.safetensors +3 -0
  13. model-00007-of-00015.safetensors +0 -3
  14. model-00007-of-00049.safetensors +3 -0
  15. model-00008-of-00015.safetensors +0 -3
  16. model-00008-of-00049.safetensors +3 -0
  17. model-00009-of-00015.safetensors +0 -3
  18. model-00009-of-00049.safetensors +3 -0
  19. model-00010-of-00015.safetensors +0 -3
  20. model-00010-of-00049.safetensors +3 -0
  21. model-00011-of-00015.safetensors +0 -3
  22. model-00011-of-00049.safetensors +3 -0
  23. model-00012-of-00015.safetensors +0 -3
  24. model-00012-of-00049.safetensors +3 -0
  25. model-00013-of-00015.safetensors +0 -3
  26. model-00013-of-00049.safetensors +3 -0
  27. model-00014-of-00015.safetensors +0 -3
  28. model-00014-of-00049.safetensors +3 -0
  29. model-00015-of-00049.safetensors +3 -0
  30. model-00016-of-00049.safetensors +3 -0
  31. model-00017-of-00049.safetensors +3 -0
  32. model-00018-of-00049.safetensors +3 -0
  33. model-00019-of-00049.safetensors +3 -0
  34. model-00020-of-00049.safetensors +3 -0
  35. model-00021-of-00049.safetensors +3 -0
  36. model-00022-of-00049.safetensors +3 -0
  37. model-00023-of-00049.safetensors +3 -0
  38. model-00024-of-00049.safetensors +3 -0
  39. model-00025-of-00049.safetensors +3 -0
  40. model-00026-of-00049.safetensors +3 -0
  41. model-00027-of-00049.safetensors +3 -0
  42. model-00028-of-00049.safetensors +3 -0
  43. model-00029-of-00049.safetensors +3 -0
  44. model-00030-of-00049.safetensors +3 -0
  45. model-00031-of-00049.safetensors +3 -0
  46. model-00032-of-00049.safetensors +3 -0
  47. model-00033-of-00049.safetensors +3 -0
  48. model-00034-of-00049.safetensors +3 -0
  49. model-00035-of-00049.safetensors +3 -0
  50. model-00036-of-00049.safetensors +3 -0
README.md CHANGED
@@ -27,6 +27,8 @@ base_model:
27
  # Laguna S 2.1-NVFP4
28
  Laguna S 2.1-NVFP4 is a 117.6B total parameter Mixture-of-Experts model with 8.5B activated parameters per token designed for agentic coding and long-horizon work on a local machine. It uses Sliding Window Attention with per-head gating in 36 out of 48 layers for fast inference and low KV cache requirements.
29
 
 
 
30
 
31
  ## Highlights
32
  - **Mixed SWA and global attention layout**: Laguna S 2.1 uses softplus gating with per-layer rotary scales, enabling mixed SWA (Sliding Window Attention) and global attention layers in a 3:1 ratio (across 48 total layers)
@@ -46,7 +48,7 @@ Laguna S 2.1-NVFP4 is a 117.6B total parameter Mixture-of-Experts model with 8.5
46
  - Experts: 256 experts with 1 shared expert
47
  - Sliding Window: 512 tokens
48
  - Modality: text-to-text
49
- - Context window: 262,144 tokens
50
  - Reasoning support: interleaved thinking with preserved thinking
51
 
52
 
@@ -74,30 +76,30 @@ Benchmarks as of 21 July 2026. Laguna S 2.1 in **bold**; a dash (-) marks a benc
74
 
75
  ### Context length
76
 
77
- This checkpoint ships configured for a 262,144-token (256K) context window. This is the configuration we recommend for best output quality.
78
 
79
- The weights are native 1M checkpoints: training included a long-context extension stage up to 1,048,576 tokens, and quantization was calibrated at the 1M configuration. If you need more than 256K of context, restore the 1M configuration by editing `config.json`:
80
 
81
  ```json
82
  "rope_parameters": {
83
  "full_attention": {
84
- "factor": 128.0,
85
- "attention_factor": 1.4852030263919618
86
  }
87
  },
88
- "max_position_embeddings": 1048576
89
  ```
90
 
91
- You may experience quality degradation with the 1M configuration. If you use it, we recommend sampling with `temperature <= 0.7` and `top_p <= 0.95`.
92
 
93
- ### Recommended sampling
94
 
95
- For the best balance of quality and reliability we recommend sampling with `temperature 0.7` and `top_p 0.95`.
96
 
97
 
98
  ### Local deployment
99
 
100
- Laguna S 2.1-NVFP4 is supported in vLLM, SGLang and Transformers, and TRT-LLM thanks to the support of the team at NVIDIA. Use Laguna-S 2.1 with Ollama (with MLX support) or Llama.cpp (BF16 and Q4\_K\_M only) for the best results on your local machine.
101
 
102
  #### vLLM
103
 
@@ -179,7 +181,6 @@ vllm serve poolside/Laguna-S-2.1-NVFP4 \
179
  --enable-auto-tool-choice \
180
  --tool-call-parser poolside_v1 \
181
  --reasoning-parser poolside_v1 \
182
- --override-generation-config '{"temperature":0.7,"top_p":0.95}' \
183
  --max-num-seqs 32 \
184
  --max-model-len 262144 \
185
  --gpu-memory-utilization 0.85 \
@@ -189,12 +190,11 @@ vllm serve poolside/Laguna-S-2.1-NVFP4 \
189
  - You do not need backend flags: auto-selection picks FlashInferCutlass, which
190
  runs natively on `sm_121`. Do not set `--linear-backend flashinfer_b12x` on
191
  0.25.1; the opt-in is broken there and it is slower anyway.
192
- - Keep the `--override-generation-config`. Many clients send no sampling
193
- parameters, and the raw defaults degrade output on the NVFP4 quantization. The
194
- model's `generation_config.json` sets `top_k 20` (eval-certified truncation),
195
- which handles that. Do not add `min_p`: vLLM rejects `min_p` and `logit_bias`
196
- under speculative decoding, so putting it in the defaults returns a 400 on
197
- every sampled request.
198
  - `--max-num-seqs 32` is required: DFlash crashes vLLM at the default of 256.
199
  - The first start takes about 15 minutes (weight load from NVMe, JIT, and graph
200
  capture).
@@ -229,7 +229,9 @@ network.
229
 
230
  #### SGLang
231
 
232
- Laguna S 2.1 is supported in SGLang via [sgl-project/sglang#24204](https://github.com/sgl-project/sglang/pull/24204). Quantization is detected automatically from `quantization_config`, so no extra flags are required. See the [SGLang cookbook entry](https://docs.sglang.io/cookbook/autoregressive/Poolside/Laguna-S-2.1) and the main [Laguna S 2.1 model card](https://huggingface.co/poolside/Laguna-S-2.1) for a serving recipe.
 
 
233
 
234
  #### Transformers
235
 
 
27
  # Laguna S 2.1-NVFP4
28
  Laguna S 2.1-NVFP4 is a 117.6B total parameter Mixture-of-Experts model with 8.5B activated parameters per token designed for agentic coding and long-horizon work on a local machine. It uses Sliding Window Attention with per-head gating in 36 out of 48 layers for fast inference and low KV cache requirements.
29
 
30
+ > **Updated release (August 2026).** This is a new checkpoint that supersedes the earlier version of this repository. The weights have changed, not only the config, so if you downloaded a previous copy please re-download to pick up the current checkpoint.
31
+
32
 
33
  ## Highlights
34
  - **Mixed SWA and global attention layout**: Laguna S 2.1 uses softplus gating with per-layer rotary scales, enabling mixed SWA (Sliding Window Attention) and global attention layers in a 3:1 ratio (across 48 total layers)
 
48
  - Experts: 256 experts with 1 shared expert
49
  - Sliding Window: 512 tokens
50
  - Modality: text-to-text
51
+ - Context window: 1,048,576 tokens
52
  - Reasoning support: interleaved thinking with preserved thinking
53
 
54
 
 
76
 
77
  ### Context length
78
 
79
+ This checkpoint ships configured for a 1,048,576-token (1M) context window. The weights are native 1M checkpoints: training included a long-context extension stage up to 1,048,576 tokens, and quantization was calibrated at the 1M configuration.
80
 
81
+ If you prefer to cap the context at 262,144 tokens (256K), edit `config.json`:
82
 
83
  ```json
84
  "rope_parameters": {
85
  "full_attention": {
86
+ "factor": 32.0,
87
+ "attention_factor": 1.3465735902799727
88
  }
89
  },
90
+ "max_position_embeddings": 262144
91
  ```
92
 
93
+ At long context you may experience some quality degradation.
94
 
95
+ ### Sampling
96
 
97
+ The sampling defaults in the checkpoint's `generation_config.json` are authoritative (`top_k 20` is eval-certified truncation). Serve with those defaults rather than setting a separate temperature or top_p.
98
 
99
 
100
  ### Local deployment
101
 
102
+ Laguna S 2.1-NVFP4 is supported in vLLM, Transformers, and TRT-LLM thanks to the support of the team at NVIDIA. NVFP4 does not currently run correctly on SGLang (see the SGLang note below). Use Laguna-S 2.1 with Ollama (with MLX support) or Llama.cpp (BF16 and Q4\_K\_M only) for the best results on your local machine.
103
 
104
  #### vLLM
105
 
 
181
  --enable-auto-tool-choice \
182
  --tool-call-parser poolside_v1 \
183
  --reasoning-parser poolside_v1 \
 
184
  --max-num-seqs 32 \
185
  --max-model-len 262144 \
186
  --gpu-memory-utilization 0.85 \
 
190
  - You do not need backend flags: auto-selection picks FlashInferCutlass, which
191
  runs natively on `sm_121`. Do not set `--linear-backend flashinfer_b12x` on
192
  0.25.1; the opt-in is broken there and it is slower anyway.
193
+ - Sampling comes from the checkpoint's `generation_config.json` (`top_k 20`
194
+ eval-certified truncation); serve with those defaults rather than overriding
195
+ them. Do not add `min_p`: vLLM rejects `min_p` and `logit_bias` under
196
+ speculative decoding, so putting it in the defaults returns a 400 on every
197
+ sampled request.
 
198
  - `--max-num-seqs 32` is required: DFlash crashes vLLM at the default of 256.
199
  - The first start takes about 15 minutes (weight load from NVMe, JIT, and graph
200
  capture).
 
229
 
230
  #### SGLang
231
 
232
+ > **NVFP4 is not currently working on SGLang.** On Blackwell GPUs the model loads but its NVFP4 (W4A4) fused-MoE kernel produces NaN and degenerate output, so generations are corrupted. This is a SGLang engine issue, not a checkpoint problem: the same weights serve correctly on vLLM and TRT-LLM, and we have a fix in progress upstream. For SGLang today, serve the [FP8 checkpoint](https://huggingface.co/poolside/Laguna-S-2.1-FP8) instead.
233
+
234
+ The Laguna S 2.1 architecture is supported in SGLang via [sgl-project/sglang#24204](https://github.com/sgl-project/sglang/pull/24204). Quantization is detected automatically from `quantization_config`, so no extra flags are required. See the [SGLang cookbook entry](https://docs.sglang.io/cookbook/autoregressive/Poolside/Laguna-S-2.1) and the main [Laguna S 2.1 model card](https://huggingface.co/poolside/Laguna-S-2.1) for a serving recipe.
235
 
236
  #### Transformers
237
 
config.json CHANGED
@@ -2,61 +2,72 @@
2
  "architectures": [
3
  "LagunaForCausalLM"
4
  ],
 
 
5
  "auto_map": {
6
  "AutoConfig": "configuration_laguna.LagunaConfig",
7
  "AutoModelForCausalLM": "modeling_laguna.LagunaForCausalLM"
8
  },
9
- "model_type": "laguna",
10
- "vocab_size": 100352,
11
- "hidden_size": 3072,
12
- "intermediate_size": 12288,
13
- "num_hidden_layers": 48,
14
- "num_attention_heads": 48,
15
- "num_key_value_heads": 8,
16
- "head_dim": 128,
17
- "max_position_embeddings": 262144,
18
- "attention_bias": false,
19
- "attention_dropout": 0.0,
20
- "rms_norm_eps": 1e-06,
21
- "num_experts": 256,
22
- "num_experts_per_tok": 10,
23
- "moe_intermediate_size": 1024,
24
- "shared_expert_intermediate_size": 1024,
25
- "norm_topk_prob": true,
26
- "router_aux_loss_coef": 0.0,
27
- "moe_router_logit_softcapping": 0.0,
28
- "decoder_sparse_step": 1,
29
- "mlp_only_layers": [
30
- 0
31
- ],
32
  "bos_token_id": 2,
 
33
  "eos_token_id": [
34
  2,
35
  24
36
  ],
37
- "pad_token_id": 9,
38
- "tie_word_embeddings": false,
39
- "use_cache": true,
40
- "torch_dtype": "bfloat16",
41
  "gating": "per-head",
42
- "sliding_window": 512,
43
- "rope_parameters": {
44
- "full_attention": {
45
- "rope_theta": 500000.0,
46
- "rope_type": "yarn",
47
- "factor": 32.0,
48
- "original_max_position_embeddings": 8192,
49
- "beta_slow": 1.0,
50
- "beta_fast": 32.0,
51
- "attention_factor": 1.3465735902799727,
52
- "partial_rotary_factor": 0.5
53
- },
54
- "sliding_attention": {
55
- "rope_type": "default",
56
- "rope_theta": 10000.0,
57
- "partial_rotary_factor": 1.0
58
- }
59
- },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
  "layer_types": [
61
  "full_attention",
62
  "sliding_attention",
@@ -107,7 +118,7 @@
107
  "sliding_attention",
108
  "sliding_attention"
109
  ],
110
- "moe_apply_router_weight_on_input": false,
111
  "mlp_layer_types": [
112
  "dense",
113
  "sparse",
@@ -158,57 +169,16 @@
158
  "sparse",
159
  "sparse"
160
  ],
161
- "gating_types": [
162
- "per_head",
163
- "per_head",
164
- "per_head",
165
- "per_head",
166
- "per_head",
167
- "per_head",
168
- "per_head",
169
- "per_head",
170
- "per_head",
171
- "per_head",
172
- "per_head",
173
- "per_head",
174
- "per_head",
175
- "per_head",
176
- "per_head",
177
- "per_head",
178
- "per_head",
179
- "per_head",
180
- "per_head",
181
- "per_head",
182
- "per_head",
183
- "per_head",
184
- "per_head",
185
- "per_head",
186
- "per_head",
187
- "per_head",
188
- "per_head",
189
- "per_head",
190
- "per_head",
191
- "per_head",
192
- "per_head",
193
- "per_head",
194
- "per_head",
195
- "per_head",
196
- "per_head",
197
- "per_head",
198
- "per_head",
199
- "per_head",
200
- "per_head",
201
- "per_head",
202
- "per_head",
203
- "per_head",
204
- "per_head",
205
- "per_head",
206
- "per_head",
207
- "per_head",
208
- "per_head",
209
- "per_head"
210
  ],
 
 
 
211
  "moe_routed_scaling_factor": 2.5,
 
 
 
212
  "num_attention_heads_per_layer": [
213
  48,
214
  72,
@@ -259,6 +229,11 @@
259
  72,
260
  72
261
  ],
 
 
 
 
 
262
  "quantization_config": {
263
  "config_groups": {
264
  "group_0": {
@@ -269,7 +244,7 @@
269
  "dynamic": "local",
270
  "group_size": 16,
271
  "num_bits": 4,
272
- "observer": "minmax",
273
  "observer_kwargs": {},
274
  "scale_dtype": "torch.float8_e4m3fn",
275
  "strategy": "tensor_group",
@@ -279,7 +254,6 @@
279
  },
280
  "output_activations": null,
281
  "targets": [
282
- "re:.*experts\\.[0-9]+\\.(gate_proj|up_proj|down_proj)$",
283
  "re:.*experts\\.[0-9]+\\.(gate_proj|up_proj|down_proj)$"
284
  ],
285
  "weights": {
@@ -302,37 +276,49 @@
302
  "global_compression_ratio": null,
303
  "ignore": [
304
  "lm_head",
305
- "model.layers.0.mlp.gate_proj",
306
- "model.layers.0.mlp.up_proj",
307
- "model.layers.0.mlp.down_proj",
308
  "re:.*\\.self_attn\\.q_proj$",
309
  "re:.*\\.self_attn\\.k_proj$",
310
  "re:.*\\.self_attn\\.v_proj$",
311
  "re:.*\\.self_attn\\.o_proj$",
312
  "re:.*\\.self_attn\\.g_proj$",
313
  "re:.*\\.mlp\\.gate$",
 
 
 
314
  "re:.*\\.mlp\\.shared_expert\\.gate_proj$",
315
  "re:.*\\.mlp\\.shared_expert\\.up_proj$",
316
- "re:.*\\.mlp\\.shared_expert\\.down_proj$"
 
317
  ],
318
- "kv_cache_scheme": {
319
- "actorder": null,
320
- "block_structure": null,
321
- "dynamic": false,
322
- "group_size": null,
323
- "num_bits": 8,
324
- "observer": "minmax",
325
- "observer_kwargs": {},
326
- "scale_dtype": null,
327
- "strategy": "tensor",
328
- "symmetric": true,
329
- "type": "float",
330
- "zp_dtype": null
331
- },
332
  "quant_method": "compressed-tensors",
333
  "quantization_status": "compressed",
334
  "sparsity_config": {},
335
  "transform_config": {},
336
  "version": "0.14.1.dev11+gf2ee47b"
337
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
338
  }
 
2
  "architectures": [
3
  "LagunaForCausalLM"
4
  ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
  "auto_map": {
8
  "AutoConfig": "configuration_laguna.LagunaConfig",
9
  "AutoModelForCausalLM": "modeling_laguna.LagunaForCausalLM"
10
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  "bos_token_id": 2,
12
+ "decoder_sparse_step": 1,
13
  "eos_token_id": [
14
  2,
15
  24
16
  ],
 
 
 
 
17
  "gating": "per-head",
18
+ "gating_types": [
19
+ "per_head",
20
+ "per_head",
21
+ "per_head",
22
+ "per_head",
23
+ "per_head",
24
+ "per_head",
25
+ "per_head",
26
+ "per_head",
27
+ "per_head",
28
+ "per_head",
29
+ "per_head",
30
+ "per_head",
31
+ "per_head",
32
+ "per_head",
33
+ "per_head",
34
+ "per_head",
35
+ "per_head",
36
+ "per_head",
37
+ "per_head",
38
+ "per_head",
39
+ "per_head",
40
+ "per_head",
41
+ "per_head",
42
+ "per_head",
43
+ "per_head",
44
+ "per_head",
45
+ "per_head",
46
+ "per_head",
47
+ "per_head",
48
+ "per_head",
49
+ "per_head",
50
+ "per_head",
51
+ "per_head",
52
+ "per_head",
53
+ "per_head",
54
+ "per_head",
55
+ "per_head",
56
+ "per_head",
57
+ "per_head",
58
+ "per_head",
59
+ "per_head",
60
+ "per_head",
61
+ "per_head",
62
+ "per_head",
63
+ "per_head",
64
+ "per_head",
65
+ "per_head",
66
+ "per_head"
67
+ ],
68
+ "head_dim": 128,
69
+ "hidden_size": 3072,
70
+ "intermediate_size": 12288,
71
  "layer_types": [
72
  "full_attention",
73
  "sliding_attention",
 
118
  "sliding_attention",
119
  "sliding_attention"
120
  ],
121
+ "max_position_embeddings": 1048576,
122
  "mlp_layer_types": [
123
  "dense",
124
  "sparse",
 
169
  "sparse",
170
  "sparse"
171
  ],
172
+ "mlp_only_layers": [
173
+ 0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
174
  ],
175
+ "model_type": "laguna",
176
+ "moe_apply_router_weight_on_input": false,
177
+ "moe_intermediate_size": 1024,
178
  "moe_routed_scaling_factor": 2.5,
179
+ "moe_router_logit_softcapping": 0.0,
180
+ "norm_topk_prob": true,
181
+ "num_attention_heads": 48,
182
  "num_attention_heads_per_layer": [
183
  48,
184
  72,
 
229
  72,
230
  72
231
  ],
232
+ "num_experts": 256,
233
+ "num_experts_per_tok": 10,
234
+ "num_hidden_layers": 48,
235
+ "num_key_value_heads": 8,
236
+ "pad_token_id": 9,
237
  "quantization_config": {
238
  "config_groups": {
239
  "group_0": {
 
244
  "dynamic": "local",
245
  "group_size": 16,
246
  "num_bits": 4,
247
+ "observer": "static_minmax",
248
  "observer_kwargs": {},
249
  "scale_dtype": "torch.float8_e4m3fn",
250
  "strategy": "tensor_group",
 
254
  },
255
  "output_activations": null,
256
  "targets": [
 
257
  "re:.*experts\\.[0-9]+\\.(gate_proj|up_proj|down_proj)$"
258
  ],
259
  "weights": {
 
276
  "global_compression_ratio": null,
277
  "ignore": [
278
  "lm_head",
 
 
 
279
  "re:.*\\.self_attn\\.q_proj$",
280
  "re:.*\\.self_attn\\.k_proj$",
281
  "re:.*\\.self_attn\\.v_proj$",
282
  "re:.*\\.self_attn\\.o_proj$",
283
  "re:.*\\.self_attn\\.g_proj$",
284
  "re:.*\\.mlp\\.gate$",
285
+ "model.layers.0.mlp.gate_proj",
286
+ "model.layers.0.mlp.up_proj",
287
+ "model.layers.0.mlp.down_proj",
288
  "re:.*\\.mlp\\.shared_expert\\.gate_proj$",
289
  "re:.*\\.mlp\\.shared_expert\\.up_proj$",
290
+ "re:.*\\.mlp\\.shared_expert\\.down_proj$",
291
+ "re:^model\\.layers\\.4[0-7]\\.mlp\\.experts(\\..*)?$"
292
  ],
 
 
 
 
 
 
 
 
 
 
 
 
 
 
293
  "quant_method": "compressed-tensors",
294
  "quantization_status": "compressed",
295
  "sparsity_config": {},
296
  "transform_config": {},
297
  "version": "0.14.1.dev11+gf2ee47b"
298
+ },
299
+ "rms_norm_eps": 1e-06,
300
+ "rope_parameters": {
301
+ "full_attention": {
302
+ "attention_factor": 1.4852030263919618,
303
+ "beta_fast": 32.0,
304
+ "beta_slow": 1.0,
305
+ "factor": 128.0,
306
+ "original_max_position_embeddings": 8192,
307
+ "partial_rotary_factor": 0.5,
308
+ "rope_theta": 500000.0,
309
+ "rope_type": "yarn"
310
+ },
311
+ "sliding_attention": {
312
+ "partial_rotary_factor": 1.0,
313
+ "rope_theta": 10000.0,
314
+ "rope_type": "default"
315
+ }
316
+ },
317
+ "router_aux_loss_coef": 0.0,
318
+ "shared_expert_intermediate_size": 1024,
319
+ "sliding_window": 512,
320
+ "tie_word_embeddings": false,
321
+ "torch_dtype": "bfloat16",
322
+ "use_cache": true,
323
+ "vocab_size": 100352
324
  }
configuration_laguna.py CHANGED
@@ -12,16 +12,9 @@
12
  # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
13
  # See the License for the specific language governing permissions and
14
  # limitations under the License.
15
- from transformers.configuration_utils import PretrainedConfig as PreTrainedConfig
16
- try:
17
- from transformers.modeling_rope_utils import RopeParameters
18
- except ImportError:
19
- RopeParameters = dict
20
- try:
21
- from transformers.utils.import_utils import is_causal_conv1d_available, is_flash_linear_attention_available
22
- except ImportError:
23
- def is_causal_conv1d_available(): return False
24
- def is_flash_linear_attention_available(): return False
25
 
26
 
27
  class LagunaConfig(PreTrainedConfig):
 
12
  # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
13
  # See the License for the specific language governing permissions and
14
  # limitations under the License.
15
+ from transformers.configuration_utils import PreTrainedConfig
16
+ from transformers.modeling_rope_utils import RopeParameters
17
+ from transformers.utils.import_utils import is_causal_conv1d_available, is_flash_linear_attention_available
 
 
 
 
 
 
 
18
 
19
 
20
  class LagunaConfig(PreTrainedConfig):
generation_config.json CHANGED
@@ -8,17 +8,17 @@
8
  "pad_token_id": 9,
9
  "temperature": 1.0,
10
  "top_p": 1.0,
11
- "speculative_config": {
12
- "method": "dflash",
13
- "source": "huggingface",
14
- "model": "poolside/Laguna-S-2.1-DFlash-NVFP4",
15
- "num_speculative_tokens": 15
16
- },
17
  "tool_call_parser": "poolside_v1",
18
  "reasoning_parser": "poolside_v1",
19
  "default_chat_template_kwargs": {
20
  "enable_thinking": true
21
  },
22
- "top_k": 20,
23
- "min_p": 0.0
 
 
 
 
24
  }
 
8
  "pad_token_id": 9,
9
  "temperature": 1.0,
10
  "top_p": 1.0,
11
+ "min_p": 0.0,
12
+ "top_k": 20,
 
 
 
 
13
  "tool_call_parser": "poolside_v1",
14
  "reasoning_parser": "poolside_v1",
15
  "default_chat_template_kwargs": {
16
  "enable_thinking": true
17
  },
18
+ "speculative_config": {
19
+ "method": "dflash",
20
+ "source": "huggingface",
21
+ "model": "poolside/Laguna-S-2.1-DFlash",
22
+ "num_speculative_tokens": 15
23
+ }
24
  }
model-00015-of-00015.safetensors → model-00001-of-00049.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd81d64092e4da18e97492afdfade1d1cd1b8e46e2fcc1c623e8c183dee6da2b
3
- size 233635672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bafa5ef7ccfde8cd63db88f74f9461aba9035370b3c86ccb754fc6f2ba010041
3
+ size 509720000
model-00002-of-00015.safetensors → model-00002-of-00049.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29769ce86e021d92d788ed7c9f35e5ce62ea9a0ac46df50352fd0128cb258afc
3
- size 5120328828
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d91f55c3c81b5aadec0b826ee817e8b410d0b659c045898f1c84ba9e5d167725
3
+ size 588356928
model-00001-of-00015.safetensors → model-00003-of-00049.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c8591d5d36f8dcc6acf60dfdb57b1ba11ee133a3a19de1d4f3ffad0ae6e43c60
3
- size 5116269068
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80e0783d4e23806821eb5e1f5240230fd5c509e071a883270949f051ec3ada99
3
+ size 2982209384
model-00003-of-00015.safetensors → model-00004-of-00049.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4c4143771eece564da2e8f2166dcd5cde38f692691c624473794904d3449669f
3
- size 5120530032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3ee5dbe50a75da5776ff2e5b94b846e80964a083582696ffbbd3b4912e5050d
3
+ size 5115055792
model-00005-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a6c393d8ab17abdbd4c28f2656c56d998f6d2d123ea2e97e8816b8ec918e19f
3
- size 5120542216
 
 
 
 
model-00004-of-00015.safetensors → model-00005-of-00049.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a4460d1b13f24e9ef0aac71aed1479c90f55b997180592a0b86433ad2aef96e1
3
- size 5120531224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88bb23dc4e9a56b102db5a7e96a0151521b7680eb3df783c83a32bfca203284e
3
+ size 5115055792
model-00006-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:209cbcb8960e9f2987fc780beac5f2f7db7216c8b265e38a9c0fb153d386b273
3
- size 5120541608
 
 
 
 
model-00006-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44d5cc53e65d78f86ef8fca5f51af06eae98bf24a9084545bd007bd24d6509f9
3
+ size 5115055792
model-00007-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c0597b0d9ce14215f1393c4be305402901328a9e517b850a9ed2deba14310574
3
- size 5120541600
 
 
 
 
model-00007-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1a371ec20caa5311788f59b4650f540f5792128e499f6d84317d99eab765b4b
3
+ size 5115055792
model-00008-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f2b57043b744e36cc07d06d4e9051226736d1ececabe259a424868040515795a
3
- size 5120542112
 
 
 
 
model-00008-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df485c3c09d7f0f2d3748b9db400dd53b0cd8b952e7e560e563b2992bb415354
3
+ size 5115055792
model-00009-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b10777318e89e836ee63ee408e71c9fd9268e62fc7e2e312b8ab3288f51d86bb
3
- size 5120542424
 
 
 
 
model-00009-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3460f9cd677c6ba9e7f7d06d474a19dd1bcfd8605e4688a9cb6010f8329e1810
3
+ size 5115055792
model-00010-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c609513bc62fb1c0e1b06765252e806fcef9fd28a533c53b656c47ff3c9c0311
3
- size 5120541600
 
 
 
 
model-00010-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5143801097f26d20e8f1f30d8b9fc1f38bc3ccae9e5fb37e12e31a7f4c9a0f71
3
+ size 4982932568
model-00011-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:bde2636d5f14a7883768002dec05b81d8efeffad8499a55ad5dce8b61b611ce6
3
- size 5120541608
 
 
 
 
model-00011-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50ed03d6c8ead6938c4dd21e39aa6ee61892ebfca2db74181284bc81d3ac702c
3
+ size 4570085320
model-00012-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4ddbd51880dbbf0d93e479866124ce3038205c9012467c6869630d13b0d33e2
3
- size 5120541904
 
 
 
 
model-00012-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3b0c9afde987635b22a7777046188c1946beefb01115bb2e7ff69392bc8d884
3
+ size 2970115792
model-00013-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a5d7c9e0023da16e297b577d2ef2611019ee23aef687b5c2cab7bd3fe98684d
3
- size 5120542312
 
 
 
 
model-00013-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83f91b41d1bc72b0fe4c9d0dc7f6ce241a1e2da8692483afec16246c1082eaef
3
+ size 1438983752
model-00014-of-00015.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7e1fb566bfb4315c9f38977f02efddc1cb15b465fcdd24c590a59e28f1644684
3
- size 5120541912
 
 
 
 
model-00014-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7335bd2c696ed2ac8bb1b7aa007c805c10ad35dfb8adcc02a6dae48ef6cb8e9d
3
+ size 1438983752
model-00015-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:419dbbcd9abad0c5f70bda0c592dba5e852a4d526b0573585b76e871ed3af074
3
+ size 1438983752
model-00016-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bc0b91dd99412d36811950e8727b3e48aad0dece6ff025aae3aed59b6b0c6b7
3
+ size 1438983752
model-00017-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33295ddcae4328168e2aac3f36457afa8058e966f7738a78c6d9239727ad808c
3
+ size 1438983752
model-00018-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86262f28e4be8b57fde0931d3a5b1c138309127cba1afc3dce23e701f8ce9969
3
+ size 1438983752
model-00019-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12d70338ab96a189cc5eecc328e07562bfd07a80ea660eff708c87d06750d1d6
3
+ size 1438983752
model-00020-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6f56b5670234436dc949940ddfb86a471690d5081620a47e462d44ab6086f23
3
+ size 1438983752
model-00021-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec304cbc979e3606446ba236a3ae577324c6e51f91d94f3855b989bb0b0e437a
3
+ size 1438986752
model-00022-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2dc96ac8104cea542bfbd0eacbbfbaf041b7f7b1ef3c852fcaab0bed1f467ee6
3
+ size 1438986784
model-00023-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:039a3eeedd0a5f5985eca6a052202e3872259b21adbe0319ec2cf3f0df39fae1
3
+ size 1438986808
model-00024-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:caf75a44fa15c0c79900b171e0051a64a3a40b1b5213d0019bd6e2269bb541fe
3
+ size 1438986824
model-00025-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c4e33932c116d3ffc2f9187536c778617c1da53b356068fc32617ff57beee7e
3
+ size 1438986824
model-00026-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1399e19f57ce3c1b315055457564ed89673d7ae1a34a2847209fda20047ec26c
3
+ size 1438986824
model-00027-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4e9fdc200593f301dc0ebe5c973ad4d3d72940ecec9521eb6e2e09f2f1ac000
3
+ size 1438986824
model-00028-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce15771b0aebb9d930cdc64aabec9f7857dc6c5697daa072242e74e129e53d32
3
+ size 1438986824
model-00029-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16a2c631593187c0ee53fa8dd5e5ed13eb906102cefc42ca2c8b8cf9eb87654d
3
+ size 1438986992
model-00030-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b580ce6dd5346afa4c797054c6d1953e3a8d64bfe56824d67d116894c19953ca
3
+ size 1438987000
model-00031-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38f197c2cdb310b796e9159ae94c3cff7aafc9b4d308292561f93042eed61ded
3
+ size 1438987000
model-00032-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2e6dbb74fb87cdad3efa291735c2b9e8cc087846aa957b07dd6e00530f45373
3
+ size 1438987000
model-00033-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05b86a9e41d488ebfc276a2cfa95196bd9938205fdd0768c4f093a91447eaf34
3
+ size 1438987000
model-00034-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4b17618337501b7bfa1f8491e3d07db5f92e4dfa0eefe2597f5df705b6b0226
3
+ size 1438987000
model-00035-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:355e7e0a26497c4a23a63ce25e8d191f84abd6ee589fdd140599c96bc8b25e20
3
+ size 1438987000
model-00036-of-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:634998dddce9d1418b802f9718f92cab512dee939fef1c5c35fe8a17bc05e427
3
+ size 1438987000