Christian Otto Stelter PRO

stelterlab's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ 3 days ago

Qwen3.5-35B-A3B AWQ quant planned?

2

#1 opened 7 days ago by

amidwestnoob

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic 17 days ago

Which transformer version did you use?

#3 opened 17 days ago by

stelterlab

New activity in stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ 18 days ago

tokenizer_config.json missing chat_template field (tool calling broken without workaround)

1

#1 opened 18 days ago by

seanthomaswilliams

Updated tokenizer_config.json now w/ chat_template included

#2 opened 18 days ago by

stelterlab

updated a model about 1 month ago

stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ

Text Generation • 5B • Updated 18 days ago • 50.7k • 5

published a model about 1 month ago

stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ

Text Generation • 5B • Updated 18 days ago • 50.7k • 5

New activity in mistralai/Ministral-3-14B-Instruct-2512 3 months ago

NVFP4 / AWQ Quants or llm-compressor recipe

🤗 1

1

#1 opened 3 months ago by

stelterlab

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 4 months ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

❤️ 👍 2

9

#3 opened 4 months ago by

stelterlab

New activity in cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 6 months ago

Error when running in VLLM

👍 2

21

#1 opened 6 months ago by

d8rt8v

liked a model 7 months ago

janhq/Jan-v1-4B-GGUF

Text Generation • 4B • Updated Aug 13, 2025 • 12.4k • 138

updated a model 7 months ago

stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 46.6k

published a model 7 months ago

stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 46.6k

updated a model 7 months ago

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 71.8k • 5

New activity in stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ 7 months ago

Unable to run the model in VLLM: KeyError: 'layers.14.mlp.gate.qweight'

3

#1 opened 7 months ago by

fredericodeveloper

published a model 7 months ago

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 71.8k • 5

updated a model 8 months ago

stelterlab/UIGEN-X-32B-0727-AWQ

Text Generation • 33B • Updated Jul 28, 2025 • 1 • 1

published a model 8 months ago

stelterlab/UIGEN-X-32B-0727-AWQ

Text Generation • 33B • Updated Jul 28, 2025 • 1 • 1

New activity in stelterlab/DeepSeek-R1-0528-Qwen3-8B-AWQ 8 months ago

Rope Scaling pre-applied?

6

#1 opened 8 months ago by

the1dv

New activity in mistralai/Mistral-Small-3.2-24B-Instruct-2506 8 months ago

AWQ version

👍 14

13

#8 opened 9 months ago by

celsowm

updated a model 8 months ago

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 146 • 2