NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

nm-autobot updated a model about 5 hours ago

nm-testing/w8a8_static_asym-e2e

nm-autobot updated a model about 5 hours ago

nm-testing/w8a8_dynamic_asym-e2e

nm-autobot updated a model about 5 hours ago

nm-testing/w8a16_grouped_quant-e2e

View all activity

nm-testing 's models 523

nm-testing/DeepSeek-V2.5-1210-quantized.w4a16

238B • Updated Jan 7, 2025 • 5

nm-testing/llama-2-7b-sparse2of4

7B • Updated Jan 4, 2025 • 3

nm-testing/test-w4a16-mixtral-actorder-group

47B • Updated Dec 26, 2024 • 1.07k

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-BitMask

22.2M • Updated Dec 19, 2024 • 6

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-Uncompressed

24.4M • Updated Dec 19, 2024 • 3

nm-testing/gemma-2-9b-it-FP8-dynamic-KV

10B • Updated Dec 18, 2024 • 5

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024 • 4

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024 • 3

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024 • 4

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024 • 3

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024 • 4

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024 • 5

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 162

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024 • 4

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 167

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 161

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 156

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 164

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 161

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 156

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 163

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-Uncompressed

1B • Updated Dec 17, 2024 • 3

nm-testing/pixtral-12b-w4a16-actorder-weight

13B • Updated Dec 16, 2024 • 3

nm-testing/pixtral-12b-w8a8-noactorder

13B • Updated Dec 16, 2024 • 5

nm-testing/pixtral-12b-w4a16-actorder-group

13B • Updated Dec 16, 2024 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned.2of4-Sparse24BitMaskCompressed

0.7B • Updated Dec 13, 2024 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned.2of4-Sparse24ByteMaskCompressed

2B • Updated Dec 12, 2024 • 4

nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse24-BitMaskCompressed

2B • Updated Dec 11, 2024 • 5

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Asym

8B • Updated Dec 11, 2024 • 107