Matthew Gammett

Permahuman's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in LGAI-EXAONE/EXAONE-4.0-32B-GGUF 6 months ago

Not loading the gguf

3

#2 opened 6 months ago by

Trilogix1

New activity in bartowski/Qwen_Qwen3-30B-A3B-GGUF 9 months ago

What are folks opinion on 4KM quants? Are they viable?

👍 1

1

#3 opened 9 months ago by

Permahuman

New activity in FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit 9 months ago

test the inference script and quantized model, but have error as below

6

#1 opened 10 months ago by

wikeeyang

New activity in Qwen/Qwen2.5-Omni-7B 10 months ago

Can this be quantized with bitsAndBytes?

8

#6 opened 10 months ago by

Permahuman

New activity in bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF 10 months ago

Does this include the vision capabilities?

4

#1 opened 10 months ago by

x0wllaar

New activity in Tyrannosaurus/TinyGPT-V about 2 years ago

Quants?

1

#1 opened about 2 years ago by

KatyTheCutie