Jeremy Lam

whoisjeremylam's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/GLM-5.2-GGUF about 2 months ago

Issues with UD-Q2_K_XL quant

5

#9 opened about 2 months ago by

labhraighlep

New activity in AesSedai/MiMo-V2.5-Pro-GGUF 3 months ago

MiMo V2.5 Pro might be the most stable IQ2_S quant

🚀❤️ 1

#4 opened 3 months ago by

whoisjeremylam

New activity in ubergarm/GLM-5.1-GGUF 3 months ago

Draft llama.cpp PR for DSA (Deepseek Sparse Attention)

👍 1

1

#8 opened 3 months ago by

whoisjeremylam

New activity in ubergarm/GLM-5.1-GGUF 4 months ago

render_message_to_json: Neither string content nor typed content is supported by the template. This is unexpected and may lead to issues.

4

#7 opened 4 months ago by

whoisjeremylam

New activity in HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive 5 months ago

Thanks. This is by far the best denial stripping I've ever seen.

👍 4

2

#30 opened 5 months ago by

phil111

New activity in unsloth/Qwen3.5-397B-A17B-GGUF 6 months ago

Do the 397B quants need to be downloaded again?

➕ 1

2

#15 opened 6 months ago by

whoisjeremylam

New activity in concavity-ai/superlinear-exp-v0.1 6 months ago

Q8 and smaller quants

3

#1 opened 6 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Thinking-GGUF 8 months ago

smol-IQ2_KS also passes the official K2 Vendor Verifier test!

🔥 2

1

#15 opened 8 months ago by

whoisjeremylam

Output not respecting lines breaks?

12

#10 opened 9 months ago by

justj0sh

New activity in ubergarm/Kimi-K2-Instruct-GGUF 8 months ago

IQ2_KS passes the Moonshot K2 Vendor Verifier test

🔥 3

4

#8 opened 9 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-0905-GGUF 10 months ago

IQ2_KS

79

#1 opened 11 months ago by

gghfez

New activity in cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit 10 months ago

Strange warning on first completion w/ vLLM 0.11.0

#6 opened 10 months ago by

whoisjeremylam

New activity in zai-org/GLM-4.6 10 months ago

How to stop reasoning?

3

#16 opened 10 months ago by

yuchenxie

New activity in INC4AI/GLM-4.6-gguf-q2ks-mixed-AutoRound 10 months ago

Model quality relative to other quantization techniques?

1

#1 opened 10 months ago by

spanspek

New activity in INC4AI/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound 10 months ago

Inference with llama.cpp + Open WebUI gives repeating `?`

4

#1 opened 10 months ago by

whoisjeremylam

New activity in cerebras/Qwen3-Coder-REAP-25B-A3B 10 months ago

Aider Polyglot Benchmark

👍 1

1

#1 opened 10 months ago by

whoisjeremylam

New activity in INC4AI/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound 11 months ago

Difference between int4-mixed and int4

1

#1 opened 11 months ago by

whoisjeremylam

New activity in ubergarm/DeepSeek-V3.1-GGUF 12 months ago

quant req: 256 GB RAM + 96 GB VRAM

👍 1

28

#1 opened 12 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-GGUF 12 months ago

Neglible loss of PPL when using only 6 of 8 experts

🔥 2

3

#7 opened 12 months ago by

whoisjeremylam

New activity in unsloth/DeepSeek-V3-GGUF over 1 year ago

Dynamic quants

3

#13 opened over 1 year ago by

XelotX