poolside
/

Laguna-M.1-FP8

Text Generation

Mixture of Experts

compressed-tensors

Model card Files Files and versions

Update README.md

#1

by varunrandery - opened Jun 3

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

initial commit12423dfd

Add files using upload-large-folder toola7228e8c

Add files using upload-large-folder toole73ae897

Push corrected vLLM image (rope_parameters guard + parser registrations)b01da1d2

Add files using upload-large-folder toolac83b476

Upload image/LOAD.md with huggingface_hub0c2b21ca

Upload image/laguna-vllm-v0.19.0-overlay.tar.gz with huggingface_hub853c0cde

Upload chat_template.jinjaf81f3228

Update overlay image with H100 fp8_w8a8 fused-MoE tuned config (E=256,N=512)cd820de8

Update README.mde5de837c

Bump max_position_embeddings to 256K; double yarn rope factor to 64778ee84d

Add mlp_only_layers, decoder_sparse_step, norm_topk_prob; set sliding_window=0 for vLLM 0.21.0 native Laguna42cd8b8b

update sampling parameters to match evalsedcd8127

Poolside org Jun 3

No description provided.

Update README.mdaa9a7152

varunrandery changed pull request status to merged Jun 3

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment