Iwan Kawrakow's picture

18

Iwan Kawrakow

ikawrakow

·

AI & ML interests

None yet

Organizations

None yet

New activity in Thireus/Qwen3-VL-235B-A22B-Thinking-THIREUS-IQ1_BN-SPECIAL_SPLIT 2 months ago

IQ1_BN?

#1 opened 2 months ago by

New activity in ubergarm/DeepSeek-R1-0528-GGUF 3 months ago

Playing with ik_llama params for IQ4_KS_R4 on RTX 5090

#17 opened 7 months ago by

New activity in ubergarm/GLM-4.5-Air-GGUF 6 months ago

Good job

#2 opened 6 months ago by

New activity in ikawrakow/Qwen3-30B-A3B 6 months ago

GitHub account and ik_llama.cpp are down?!

#2 opened 6 months ago by

New activity in unsloth/gemma-3n-E4B-it-GGUF 7 months ago

Gemma 3n fixes for GGUFs and Ollama

#6 opened 7 months ago by

New activity in ikawrakow/validation-datasets-for-llama.cpp over 1 year ago

Error with test data

#2 opened over 1 year ago by

New activity in ikawrakow/various-2bit-sota-gguf almost 2 years ago

What 2bit quantization approach are you using?

#13 opened almost 2 years ago by

New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf almost 2 years ago

Dataset for importance matrix?

#3 opened almost 2 years ago by

New activity in ikawrakow/mixtral-8x7b-quantized-gguf almost 2 years ago

Broken M quants

#2 opened almost 2 years ago by

New activity in ikawrakow/various-2bit-sota-gguf about 2 years ago

What -ctx and -chunks parameters did you use to make the iMatrix of the Lllama 2 70b?

#9 opened about 2 years ago by

Would love a deepseekcode 2bit quant. I bet others would love it too :)

#6 opened about 2 years ago by

[Model request] Saily 100b, Saily 220b

#5 opened about 2 years ago by

Could We combine AWQ and Importance Matrix calculation together to further improve perplexity.

#4 opened about 2 years ago by

New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf about 2 years ago

mixtral-instruct-8x7b-q3k-medium.gguf

#2 opened about 2 years ago by

New activity in ikawrakow/open-hermes-2.5-mistral-7b-quantized-gguf about 2 years ago

SOTA 2-Quant of Nous-Heremes-Solar-10.7B and Nous-Hermes-2-Yi-34B, Please 🙏

#1 opened about 2 years ago by

New activity in ikawrakow/various-2bit-sota-gguf about 2 years ago

Please 3b model rocket 2bit?

#1 opened about 2 years ago by

New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf about 2 years ago

Q5_1 & Q5_K_M quant

#1 opened about 2 years ago by

New activity in ikawrakow/mixtral-8x7b-quantized-gguf about 2 years ago

Mixtral Instruct quant

#1 opened about 2 years ago by

Mixtral Instruct quant

#1 opened about 2 years ago by

New activity in ikawrakow/various-2bit-sota-gguf about 2 years ago

Please 3b model rocket 2bit?

#1 opened about 2 years ago by