Product-VQ codebook weights (NVFP4-CB / FP8-CB) served by stock vLLM on Blackwell tensor cores. Spec + plugin: github.com/RobTand/gridbook
Rob
rdtand
AI & ML interests
None yet
Recent Activity
updated a model 5 days ago
rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm updated a model 5 days ago
rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm updated a model 5 days ago
rdtand/Qwen3.6-27B-prismaquant-gridbook-5.5bit-vllmOrganizations
None yet
models 18
rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm
Text Generation • 104B • Updated • 67 • 3
rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm
Text Generation • 85B • Updated • 388 • 6
rdtand/Qwen3.6-27B-prismaquant-gridbook-5.5bit-vllm
Image-Text-to-Text • 20B • Updated • 2.09k • 5
rdtand/Gemma4-31B-IT-PrismaQuant-5.5bit-vllm
Text Generation • 19B • Updated • 399 • 1
rdtand/Gemma4-31B-IT-PrismaQuant-6bit-vllm
Text Generation • 22B • Updated • 854 • 1
rdtand/Hy3-295B-A21B-PrismaQuant-5.3bit-2xSpark-vllm
194B • Updated • 1.5k • 1
rdtand/Hy3-295B-A21B-PrismaQuant-2.8bit-gguf-vllm
295B • Updated • 5.7k • 2
rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP
Text Generation • 22B • Updated • 13.7k • 7
rdtand/Qwen3.6-27B-PrismaAURA-5.5bit-vllm
20B • Updated • 42.8k • 26
rdtand/LFM2.5-8B-A1B-PrismaQuant-6.5bit-vllm
7B • Updated • 12
datasets 0
None public yet