Fabian Heller

Ununnilium's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in lukealonso/GLM-5.2-NVFP4 2 months ago

TP5 RTX 6000?

8

#1 opened 2 months ago by

jpsequeira

New activity in Ununnilium/Qwen3.6-27B-IQ4_XS-pure-GGUF 3 months ago

is possible to create Qwen3.6-27B-IQ4_XS-pure-GGUF with MTP support?

3

#1 opened 3 months ago by

vinimuchulski

New activity in deepseek-ai/DeepSeek-V4-Flash 3 months ago

Running models with vLLM on the RTX Pro 6000 - SM120

👀👍 2

12

#28 opened 3 months ago by

liku2001

New activity in Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound 12 months ago

Works good with vLLM, just no tool calling

1

#1 opened 12 months ago by

Ununnilium

New activity in QuantTrio/GLM-4.5-AWQ about 1 year ago

How many GPU Memory AWQ need?

5

#1 opened about 1 year ago by

hermitg

Does it possible to create a version without MTP layer to save some VRAM

👍 1

1

#3 opened about 1 year ago by

adonishong