nm-testing/tinyllama-oneshot-w8-channel-a8-tensor
Text Generation • 1B • Updated • 1.35k
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
nm-testing/tinyllama-oneshot-w4a16-group128-v2
Text Generation • 1B • Updated • 3.65k
nm-testing/tinyllama-oneshot-w4a16-channel-v2
Text Generation • 1B • Updated • 5.72k • 1
nm-testing/tinyllama-one-shot-w4a16-group-packed
Text Generation • 1B • Updated • 102
nm-testing/tinyllama-marlin24-w4a16-group128
Text Generation • 0.3B • Updated • 93
nm-testing/nonuniform
Text Generation • 8B • Updated • 87
nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt
Text Generation • 0.9B • Updated • 85
nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t
Text Generation • 1B • Updated • 261 • 1
nm-testing/llama3-8b-w8_channel-a8_tensor-compressed
Text Generation • 8B • Updated • 106
nm-testing/llama-3-instruct-w8a8-dyn-per-token-test
Text Generation • 8B • Updated • 87
nm-testing/granite-8b-code-instruct-128k2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 20
nm-testing/granite-3.1-8b-instruct2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 15
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-tensor
1B • Updated • 1.53k
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-attn_head
1B • Updated • 1.31k
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
1B • Updated • 13
nm-testing/SmolLM-360M-Instruct-quantized.w4a16
0.4B • Updated • 16
nm-testing/SmolLM-135M-Instruct-quantized.w4a16
Text Generation • 0.2B • Updated • 120
nm-testing/Qwen2-1.5B-Instruct-FP8W8
Text Generation • 2B • Updated • 998
nm-testing/Qwen2-0.5B-Instruct
Text Generation • 0.6B • Updated • 86
nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e
4B • Updated • 14
nm-testing/Phi-3-mini-128k-instruct-FP8
4B • Updated • 1.41k
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized
47B • Updated • 25
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized
47B • Updated • 20
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized
47B • Updated • 10
nm-testing/Mistral-7B-Instruct-v0.32of4-W8A8-FP8-Dynamic-Per-Token
7B • Updated • 16
nm-testing/Meta-llama3-8b-Instruct-quant-FP8
Text Generation • 8B • Updated • 23
nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8
Text Generation • 8B • Updated • 85
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation • 8B • Updated • 89
nm-testing/Meta-Llama-3-8B-Instruct-spinquantR3-FP8_asym-attn
8B • Updated • 14
nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test
Text Generation • 8B • Updated • 5.21k