dev7a/Laguna-S-2.1-DFlash-GGUF
1B • Updated • 167 • 1
Lev
nekolee
·
AI & ML interests
None yet
Recent Activity
liked a model 16 days ago
dev7a/Laguna-S-2.1-DFlash-GGUF reacted to nwaughachukwuma's post with 🧠 17 days ago
It’s easy to get distracted by benchmarks, throughput (tok/s), and all the hype around frontier model releases.
This is Shiny Model Syndrome, which makes engineers and teams forget the basic physics of production software, i.e., using the right tool for the job and optimizing for ease of integration.
- Teams spend huge amounts of money on frontier models for document parsing, OCR, detection, segmentation, and other task-specific visual AI workflows.
- Inference marketplaces don’t find it profitable to list task-specific models like glm-ocr, paddleocr, or dots.mocr, even though they’re all superior to frontier VLMs for document parsing and OCR.
- Engineers stitch together multiple endpoints for different use cases across the long tail of visual AI. Those who choose to self-host instead deal with painful infrastructure and GPU ops.
At VLM Run, we wanted one place to run OCR models, VLMs, and ViTs that we could confidently use for our own internal agents and evals. The gateway was born out of that need, and we’ve since opened it to the public.
The gateway exposes a single OpenAI-compatible endpoint for the long tail of visual AI across OCR, document parsing, VQA, detection, segmentation, embeddings, and transcription. Simply point the base_url of your OpenAI SDK at gateway.vlm.run/v1/openai, or ask your agent to connect via MCP (gateway.vlm.run/mcp).
You can swap the model name to compare glm-ocr, dots.mocr, paddleocr-vl-1.6, qwen3.8-27b, gemma4-26b-a4b, and more. We handle serving, runtime, and pipelining behind the scenes to give you high-quality visual intelligence.
- https://vlm.run/gateway
- https://huggingface.co/blog/vlm-run/introducing-gateway
- https://www.vlm.run/blog/introducing-gateway upvoted an article about 1 month ago
Performant local mixture-of-experts CPU inference with GPU acceleration in llama.cppOrganizations
None yet
liked a
model 16 days ago
liked 8
models about 2 months ago
unsloth/Muse-Glimmer-30B-GGUF
Image-Text-to-Text • 28B • Updated • 282k • 554
BlivionIaG/Qwen3.5-0.8B-AWQ-INT4
Text Generation • 0.8B • Updated • 237 • 1
cyankiwi/Laguna-S-2.1-AWQ-INT4
Text Generation • 118B • Updated • 774 • 4
olka-fi/Laguna-S-2.1-MXFP4
Text Generation • 64B • Updated • 313 • 3
wimmmm/poolside-Laguna-S-2.1-DFlash-GGUF
1B • Updated • 525 • 3
unsloth/Laguna-S-2.1-GGUF
Text Generation • 118B • Updated • 16k • 310
jcbtc/Laguna-S-2.1-Chadrock-ROCmFP4-StrixKVSpine-V4-GGUF
Text Generation • 118B • Updated • 476 • 35
poolside/Laguna-S-2.1-GGUF
118B • Updated • 636k • 177
liked 6
models 3 months ago
Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF
Image-Text-to-Text • 0.4B • Updated • 415k • 244
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF
Text Generation • 12B • Updated • 469k • 2.91k
unsloth/Qwen3-Coder-Next-GGUF
Text Generation • 80B • Updated • 190k • 858
Jackrong/Qwopus3.6-27B-Coder-GGUF
Image-Text-to-Text • 27B • Updated • 1.45k • 85
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 619k • 440
SC117/gemma-4-26B-A4B-it-qat-heretic-GGUF
25B • Updated • 8.68k • 31
liked 4
models 4 months ago
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 526k • 195
SC117/gemma-4-E4B-it-heretic-QAT-GGUF
7B • Updated • 3.12k • 22
unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 759k • 547
Jackrong/Qwopus3.5-9B-Coder-MTP-GGUF
Image-Text-to-Text • 0.5B • Updated • 283k • 215