ekurtic/lossless-lm-dev-uniform-bw4
Updated
Eldar Kurtić
ekurtic
AI & ML interests
Efficient inference
Recent Activity
updated
a model
about 4 hours ago
RedHatAI/Llama-Guard-4-12B
new activity
about 4 hours ago
meta-llama/Llama-Guard-4-12B:Update ints to floats to suppress warnings
updated
a model
5 days ago
ekurtic/lossless-lm-dev-uniform-bw4
Organizations
ekurtic/Qwen3-8B-kvattn-fp8-tensor
8B
•
Updated
•
11
ekurtic/Qwen3-8B-kvattn-fp8-attn_head
8B
•
Updated
•
8
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-tensor
8B
•
Updated
•
9
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head_layer1_4q2kv
Updated
•
10
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head_layer1
Updated
•
10
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head
8B
•
Updated
•
10
ekurtic/Llama-2-7b-chat-hf-kvattn-fp8-tensor
7B
•
Updated
•
10
ekurtic/Llama-2-7b-chat-hf-kvattn-fp8-attn_head
7B
•
Updated
•
11
ekurtic/qwen3-8b-int4-asym
2B
•
Updated
•
6
ekurtic/qwen3-8b-int4-sym
2B
•
Updated
•
8
ekurtic/llama-3.1-8b-instruct-int4-asym
2B
•
Updated
•
5
ekurtic/llama-3.1-8b-instruct-int4-sym
2B
•
Updated
•
7
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-INT4-fake-quant
8B
•
Updated
•
8
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-INT8-fake-quant
8B
•
Updated
•
17
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-FP8-fake-quant
8B
•
Updated
•
10