Jeremy Lam

whoisjeremylam's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in ubergarm/Kimi-K2-Thinking-GGUF about 2 months ago

smol-IQ2_KS also passes the official K2 Vendor Verifier test!

🔥 2

1

#15 opened about 2 months ago by

whoisjeremylam

Output not respecting lines breaks?

12

#10 opened 3 months ago by

justj0sh

New activity in ubergarm/Kimi-K2-Instruct-GGUF about 2 months ago

IQ2_KS passes the Moonshot K2 Vendor Verifier test

🔥 3

4

#8 opened 2 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-0905-GGUF 3 months ago

IQ2_KS

79

#1 opened 5 months ago by

gghfez

New activity in cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit 3 months ago

Strange warning on first completion w/ vLLM 0.11.0

#6 opened 3 months ago by

whoisjeremylam

New activity in zai-org/GLM-4.6 3 months ago

How to stop reasoning?

3

#16 opened 4 months ago by

yuchenxie

New activity in cyankiwi/GLM-4.5V-AWQ-4bit 3 months ago

Best local VLM so far that I've found that fits in 96 GB of VRAM

#2 opened 3 months ago by

whoisjeremylam

New activity in Intel/GLM-4.6-gguf-q2ks-mixed-AutoRound 3 months ago

Model quality relative to other quantization techniques?

1

#1 opened 3 months ago by

spanspek

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound 3 months ago

Inference with llama.cpp + Open WebUI gives repeating `?`

4

#1 opened 3 months ago by

whoisjeremylam

New activity in cerebras/Qwen3-Coder-REAP-25B-A3B 3 months ago

Aider Polyglot Benchmark

👍 1

1

#1 opened 3 months ago by

whoisjeremylam

New activity in Intel/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound 5 months ago

Difference between int4-mixed and int4

1

#1 opened 5 months ago by

whoisjeremylam

New activity in ubergarm/DeepSeek-V3.1-GGUF 5 months ago

quant req: 256 GB RAM + 96 GB VRAM

👍 1

28

#1 opened 6 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-GGUF 5 months ago

Neglible loss of PPL when using only 6 of 8 experts

🔥 2

3

#7 opened 5 months ago by

whoisjeremylam

liked a model 5 months ago

meituan-longcat/LongCat-Flash-Chat

Text Generation • 562B • Updated Sep 24, 2025 • 29.4k • 524

liked a model 6 months ago

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • Updated Aug 24, 2025 • 217 • 13

New activity in unsloth/DeepSeek-V3-GGUF 11 months ago

Dynamic quants

3

#13 opened about 1 year ago by

XelotX

liked a model over 1 year ago

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 17, 2024 • 7 • 45