plz

qenme's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT8 about 22 hours ago

Compatible with vLLM on Ampere?

➕ 4

7

#3 opened about 2 months ago by

HenkTenk

New activity in RedHatAI/gemma-4-31B-it-FP8-Dynamic 13 days ago

Can you add more details to the model card?

6

#1 opened 3 months ago by

bullerwins

New activity in google/gemma-4-31B-it-qat-w4a16-ct 21 days ago

26b with w416a-ct

1

#3 opened 22 days ago by

meganoob1337

New activity in google/gemma-4-31B-it-qat-w4a16-ct 23 days ago

Gemma team in the back making shrimp fried rice!!!!

🔥 1

#1 opened 23 days ago by

qenme

New activity in Minachist/Qwen3.6-27B-INT8-AutoRound 23 days ago

KL divergence benchmark

2

#3 opened 24 days ago by

qenme

New activity in google/gemma-4-31B-it 25 days ago

Tokenizer problems, or just quants?

2

#105 opened about 2 months ago by

nesymerp1

New activity in Minachist/Qwen3.6-27B-INT8-AutoRound about 1 month ago

Me again

3

#2 opened about 1 month ago by

qenme

New activity in AesSedai/Qwen3.6-35B-A3B-GGUF about 1 month ago

MTP support?

👍 1

8

#5 opened about 1 month ago by

Nindaleth

Q6_K?

15

#1 opened 2 months ago by

qenme

New activity in google/gemma-4-26B-A4B-it about 1 month ago

Very bad results with model quant and KV cache quant, only BF16 works well

👍👀 5

4

#34 opened 2 months ago by

qenme

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4 about 1 month ago

F16 or BF16?

5

#6 opened about 1 month ago by

qenme

New activity in unsloth/Qwen3.6-27B-MTP-GGUF about 1 month ago

FYI : --spec-type mtp syntax has changed to --spec-type draft-mtp

👍 3

3

#14 opened about 2 months ago by

qenme

New activity in unsloth/Qwen3.6-27B-MTP-GGUF about 2 months ago

presence-penalty

5

#8 opened about 2 months ago by

owao

New activity in Minachist/Qwen3.6-27B-INT8-AutoRound about 2 months ago

Good quant!

12

#1 opened about 2 months ago by

qenme

New activity in AesSedai/MiMo-V2.5-GGUF about 2 months ago

Working good on 96GB VRAM + DDR5 Setup

❤️ 1

5

#2 opened about 2 months ago by

phakio

New activity in google/gemma-4-31B-it 2 months ago

GOOLE WHERE IS MTP ?

🔥 2

2

#82 opened 2 months ago by

EvilinaMaller

New activity in Qwen/Qwen3.6-27B 2 months ago

10/10

🔥 6

1

#4 opened 2 months ago by

qenme

New activity in unsloth/Qwen3.6-27B-GGUF 2 months ago

thanks!

🤗❤️ 19

2

#1 opened 2 months ago by

qenme

New activity in google/gemma-4-31B-it 2 months ago

Will there be a small model for speculative decoding?

3

#71 opened 2 months ago by

Regrin

New activity in AesSedai/Qwen3.5-35B-A3B-GGUF 4 months ago

Thanks

➕ 8

1

#2 opened 4 months ago by

qenme