Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
443
20
404
John Leimgruber III
PRO
ubergarm
Follow
rinoa's profile picture
MrPippin's profile picture
anza27's profile picture
421 followers
·
65 following
https://blog.aifoundry.org/p/adventures-in-model-quantization
ubergarm
john-leimgruber
AI & ML interests
Open LLMs and Astrophotography image processing.
Recent Activity
new
activity
about 1 hour ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF:
Yay more ik quants!
liked
a model
about 1 hour ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
new
activity
about 16 hours ago
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF:
提速效果不理想
View all activity
Organizations
ubergarm
's activity
All
Models
Datasets
Spaces
Buckets
Papers
Collections
Community
Posts
Upvotes
Likes
Articles
New activity in
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
about 1 hour ago
Yay more ik quants!
#1 opened about 1 hour ago by
ubergarm
liked
a model
about 1 hour ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
Text Generation
•
27B
•
Updated
4 days ago
•
20.4k
•
5
New activity in
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF
about 16 hours ago
提速效果不理想
7
#1 opened 6 days ago by
androidli
liked
a model
about 16 hours ago
Lorbus/Qwen3.6-27B-int4-AutoRound
Image-Text-to-Text
•
6B
•
Updated
14 days ago
•
320k
•
84
New activity in
Lorbus/Qwen3.6-27B-int4-AutoRound
about 16 hours ago
How does this fair against other quants without MTP like unsloth?
👍
1
1
#4 opened 12 days ago by
Crigges
New activity in
ubergarm/Qwen3.6-27B-GGUF
about 19 hours ago
How to use MTP in GGUF?
16
#2 opened 6 days ago by
Friedland
liked
a model
about 22 hours ago
google/gemma-4-31B-it-assistant
Any-to-Any
•
0.5B
•
Updated
about 23 hours ago
•
4.24k
•
103
liked
a model
about 23 hours ago
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF
27B
•
Updated
7 days ago
•
1.21k
•
7
updated
a model
2 days ago
ubergarm/Qwen3.6-27B-GGUF
Text Generation
•
27B
•
Updated
2 days ago
•
8.55k
•
18
New activity in
ubergarm/Qwen3.6-27B-GGUF
5 days ago
Q6_0 use over Q6_K?
2
#3 opened 5 days ago by
resynth
New activity in
ubergarm/Qwen3.6-27B-GGUF
7 days ago
Great model for single GPU use cases.
🔥
4
16
#1 opened 12 days ago by
phakio
liked
a model
9 days ago
XiaomiMiMo/MiMo-V2.5-Pro
Text Generation
•
1T
•
Updated
8 days ago
•
16k
•
452
New activity in
ubergarm/Qwen3.5-122B-A10B-GGUF
9 days ago
How to split this model between 2 (3) GPUs and CPU/RAM ?
30
#12 opened about 2 months ago by
mancub
updated
a model
10 days ago
ubergarm/Kimi-K2.6-GGUF
Text Generation
•
1T
•
Updated
10 days ago
•
5.62k
•
35
liked
a model
12 days ago
bartowski/Qwen_Qwen3.6-27B-GGUF
Image-Text-to-Text
•
27B
•
Updated
13 days ago
•
81.9k
•
31
New activity in
ubergarm/Qwen3.5-35B-A3B-GGUF
12 days ago
Any plans to release Qwen3.6 ?
1
#3 opened 12 days ago by
ittokasso
updated
a model
12 days ago
ubergarm/Qwen3.5-27B-GGUF
Text Generation
•
27B
•
Updated
12 days ago
•
1.98k
•
16
New activity in
ubergarm/Qwen3.5-27B-GGUF
12 days ago
smol-IQ4_NL with turboquant is outstanding for 24GB VRAM
🔥
1
3
#7 opened 13 days ago by
IHaveNoClueAndIMustPost
published
a model
12 days ago
ubergarm/Qwen3.6-27B-GGUF
Text Generation
•
27B
•
Updated
2 days ago
•
8.55k
•
18
New activity in
ubergarm/Kimi-K2.6-GGUF
12 days ago
Much faster IQ2_KS quantization PPL results?
3
#10 opened 13 days ago by
gghfez
Load more